Explanations in Diagram, Word, and Gesture.

作者: Barbara Tversky , Marie-Paule Daniel , Sandra C. Lozano , Julie Heiser , Paul U. Lee

DOI:

关键词:

摘要: Diagrams serve multiple purposes, among them to explain. Explaining is not simply showing. Explanations have at least three levels: the specific content, ideally critical junctures in change over time; a causal structure linking changes; and narrative that aids organizing material. Using route instructions assembly as examples, we analyze techniques diagrams, words, gestures use convey provide links, structure. Effective explanations break action into major steps, describe, illustrate, or demonstrate just structure, adopt user’s perspective. There are striking parallels ways these expressed spontaneously. Word, Diagram, Gesture What constitutes an effective explanation? consist of content be explained, explain it. The should decomposed parts links parts. turns narrative, with beginning, middle, end. It sounds simpler than it is. Challenges include decomposing composing narrative. implication explanation abstract, can different media. This say each medium equally effective; on contrary. prototype route, how get from here some other point. Close line doing kinds things necessary daily lives. We been studying people design gesture order procedures others, particular, there, assemble simple object. These tasks were chosen because one hand, they typical enact so readily performed by ordinary representative large class explain, including put together, work, operate things. triple goals project intertwined: develop cognitive principles for explanations; reveal underlying devices, systems, procedures; uncover common semantics syntax pragmatics communication paradigm capitalizes extensive experience had communicating each, other, natural user testing refines communications through successes failures. Content Routes. skeleton paths actions landmarks (Denis, 1997). Analysis productions maps descriptions has shown small number elements sufficient create most routes, combined according rules sequencing, much like language (Tversky Lee, 1998, 1999). Moreover, parallel diagrams. core consists of: straight curved expressions such “go down” “follow around”; T, L, + intersections “turn”, “take a,” “make a”; names descriptions. New work (Lozano Tversky, preparation) shows express same that, surprisingly, may more words conveying information.

参考文章(4)
M. Denis, The description of routes : A cognitive approach to the production of spatial discourse Cahiers de psychologie cognitive. ,vol. 16, pp. 409- 458 ,(1997)
Barbara Tversky, Paul U. Lee, How Space Structures Language Lecture Notes in Computer Science. pp. 157- 176 ,(1998) , 10.1007/3-540-69342-4_8
Barbara Tversky, Paul U. Lee, Pictorial and Verbal Tools for Conveying Routes conference on spatial information theory. pp. 51- 64 ,(1999) , 10.1007/3-540-48384-5_4
Julie Heiser, Doantam Phan, Maneesh Agrawala, Barbara Tversky, Pat Hanrahan, Identification and validation of cognitive design principles for automated generation of assembly instructions Proceedings of the working conference on Advanced visual interfaces - AVI '04. pp. 311- 319 ,(2004) , 10.1145/989863.989917