Skip to content

A Triadic Semiotics

Inspired by the computer metaphor and the developing field of linguistics (e.g., Chomsky), the main stream of cognitive science was framed as a science where mind was considered to be a computational, symbol-processing device that was evaluated relative to the norms of logic and mathematics. However, there were a few, such as James Gibson, who followed a different path.

Gibson followed a path that was originally blazed by functional psychology (e.g., James, Dewey) and pragmatist philosophers (e.g., Peirce). Along this path, psychology was framed in the context of natural selection and the central question was to understand the capacity for humans to intelligently adapt to the demands of survival. Thus, the question was framed in terms of the pragmatic consequences of human thinking (e.g., beliefs) for successful adaptation to the demands of their ecology.

An important foundation for Gibson's ecological approach was Peirce's Triadic Semiotics. In contrast with Saussure's Dyadic approach - Peirce framed the problem of semiotics as a pragmatic problem - rather than as a symbol processing problem. Saussure was impressed by the arbitrariness of signs (e.g., C - A - T) and the ultimate interpretation of an observer (e.g., kind of house pet). In contrast, Peirce was curious about how our interpretation of a sign (e.g., pattern of optical flow) provides the basis for beliefs that support successful action in the world (e.g., braking in time to avoid a collision). In addition to considering the observer's interpretation of the sign, this required a consideration of the relation of the sign to the functional ecology (e.g., how well the pattern specifies relative motion of the observer to obstacles - the field of safe travel), and the ultimate pragmatic consequences of the belief or interpretation relative to adaptations to the ecology (e.g., how skillfully the person controls locomotion).

The figure below illustrates the two views of the semiotic system. In comparing these two systems it is important to keep in mind Peirce's admonition that the triadic system has emergent properties that can never be discover from analyses of any of the component dyads. For Peirce the triad was a fundamental primitive with respect to human experience. Thus, arguing that the whole of human experience is more than the sum of the component dyads.

slide2

Mace's Contrast

William 'Bill' Mace provided a clever way to contrast the dyadic framework of conventional approaches to cognition with the triadic framework of ecological approaches to cognition.

The conventional (dyadic) approach frames the question in terms of computational constraints, asking:

                            How do we see the world the way we do?

The ecological (triadic) approach frames the question in terms of the pragmatic constraints, asking:

                            How do we see the world the way it is?

What Matters?

For a laboratory science of mind, either framing of the question might lead to interesting discoveries and eventually some of the discoveries may lead to valuable applications. However, for those with a practical bent, who are interested in a cognitive science that provides a foundation for designing quality human experiences, the second question provides a far more productive path. For example, if the goal is to increase safety and efficiency and to support problem solving in complex domains such as healthcare or transportation, then the ecological framing of the question will be preferred! You can't design either training programs or interfaces to improve piloting without some understanding of the dynamics of flight.

If the goal is to discover what matters in terms of skillful adaptations to the demands of complex ecologies, then a triadic semiotic frame is necessary. To understand skill, it is not enough to know what people think (i.e., awareness), it is also necessary to know how that thinking 'fits' relative to success in the ecological context (i.e., the functional demands of situations).

2

Perspicacity:

Keenness of mental perception and understanding; discernment; penetration.

Knowing versus Seeing

In studying human performance, I have been most curious about expertise or skill; and my original intuitions came from my own experiences in sports. My initial motivation was to discover the 'magical' attribute that separated me from the really excellent athletes. At the start I tended to frame the questions as "What do they know that I don't know?"  But as I began to explore deeper, I quickly reframed the question to "What do they see that I don't see?" Or more generally, "what do they sense; or what are they attuned to that I am not sensitive to?"  This change of perspective was strongly influenced by Eleanor Gibson's work on perceptual learning and de Groot's work on expertise in chess.

I don't think it is necessarily an either/or proposition with respect to knowing versus seeing. I expect that both knowing and seeing are involved, but there is an important difference between these two ways of framing the research question. Approaches focused on knowing tend to see expertise as a result of accrual of knowledge that can be 'added to' the information available through perception that allows better mental computations.  The general implication is that experts have a more extensive data base to tap into.

However, approaches based on seeing, tend to see expertise as reflecting something akin to a coordinate transformation in mathematics (for example a log transform). The benefits of coordinate transformations are that they can make certain patterns easier to pick-up.  A good example is work on visual skill involved in avoiding collisions, landing aircraft, or catching baseballs. This work illustrates that when you look at visual perception in terms of angular coordinates (angles and expansion rates), rather than Euclidean (x,y,z) coordinates then the computations needed to brake, land or catch a ball become relatively simple.

This is why I have chosen to title this blog Perspicacity. As a scientist, the focus of my work is to discover how the underlying coordinate systems or representations that experts use are different from those of non-experts. As a designer, the focus of my work is to create representations (i.e., interfaces) that help people to see phenomena in ways that are more similar to what the experts are seeing. The design goal is to create perspicacious systems.

The other reason that I like the term is that perspicacity suggests an intimacy between perception and cognition (between seeing and knowing) that I think has been lost in a reductionist cognitive science where perception and cognition are seen as independent or at least loosely coupled modules in an information processing system. I believe that a parsing that treats perception and cognition as different phenomena breaks the system in such a way that it will not be possible to put the pieces back together again to achieve a complete understanding of human experience.

 

Perspicacity:

Keenness of mental perception and understanding; discernment; penetration.

About Me: John Flach

john-flach

Hello! My name is John Flach and I am currently a Professor of Psychology at Wright State University in Dayton, OH. For more than 30 years I have been exploring human performance in the context of sociotechnical systems. My work has involved collaborations with engineers, designers, and domain experts in such fields as aviation, healthcare, highway safety, military command and control, and process control. The focus of this work is to explore the capabilities of smart humans and how they are able to succeed (and occasionally fail) in managing complex work.

My explorations have been guided by a hope to better understand everyday human experience and to apply this understanding to the design of technologies that will enhance the quality of human experiences. As a result of these explorations I have developed rather unconventional views about the nature of human experience that I believe have implications for both cognitive science and for design.

I recently teamed with Fred Voorhorst to write a book to introduce our unconventional ideas about What Matters. This book is currently available as a free download through Core Scholar:

http://corescholar.libraries.wright.edu/books/127/

The intent of this blog is to continue the narrative begun in our book and to share our experiences with others who are searching for answers to the question: What Matters?