Multimodality in aphasic conversation: Why gestures sometimes do not help

作者: Peter Auer , Angelika Bauer

DOI: 10.1558/JIRCD.V2I2.215

关键词: ConversationFace (sociological concept)AphasiaGestureSemioticsSet (psychology)MultimodalityCommunicationPsychologyAdaptation (computer science)

摘要: The use of gestures is one the reasons for which some aphasics communicate better than they speak. For these as well their partners, multimodality becomes a resource for successful management interaction. However, employment of gesture implies multiple practices adaptation, since there are important differences between gesture in non-impaired and impaired aphasic In faceto- face interaction, mostly accompany language support influence its interpretation various ways. Only rarely do gestures, body movements the manipulation artifacts take lead, even more they replace language entirely (Goodwin 1986, Heath 1982, 1992, Melinger & Levelt 2004). Under conditions of severe non-fluent aphasia (as described here), therefore used functions which cannot easily fulfill. absence language, become substitute (Goodwin 2000, 2003 2006a, b). This uncoupling gestural communication from language usually results complex often lengthy collaborative sequences the participants set out to co-construct what “gesturer” means, with non-impaired speakers providing, way, missing speech linguistically speaker (cf. Damico et al. 2008, Goodwin 2003, 2006). As we will show, processes coconstruction are encumbered not by aphasics’ deficient but rather semiotic nature gesturing itself. We discuss examples unsuccessful gestural communication suggest why fails sometimes, it helps other cases. Our observations lend idea that therapy has respect semiotic characteristics interactional practices necessary order enhance of the visual modality.

参考文章(26)
Amanda Le May, Rachel David, Andrew P. Thomas, The use of spontaneous gesture by aphasic patients Aphasiology. ,vol. 2, pp. 137- 145 ,(1988) , 10.1080/02687038808248899
Akiba A. Cohen, Randall P. Harrison, Intentionality in the use of hand illustrators in face-to-face communication situations. Journal of Personality and Social Psychology. ,vol. 28, pp. 276- 279 ,(1973) , 10.1037/H0035792
MINNA LAAKSO, ANU KLIPPI, A closer look at the 'hint and guess' sequences in aphasic conversation Aphasiology. ,vol. 13, pp. 345- 363 ,(1999) , 10.1080/026870399402136
Jan Peter de Ruiter, Can gesticulation help aphasic people speak, or rather, communicate? Advances in Speech-Language Pathology. ,vol. 8, pp. 124- 127 ,(2006) , 10.1080/14417040600667285
Adam Kendon, Language’s matrix Gesture. ,vol. 9, pp. 355- 372 ,(2009) , 10.1075/GEST.9.3.05KEN
Nina N. Simmons-mackie, Jack S. Damico, Reformulating the definition of compensatory strategies in aphasia Aphasiology. ,vol. 11, pp. 761- 781 ,(1997) , 10.1080/02687039708250455
PETER AUER, On Deixis and Displacement Folia Linguistica. ,vol. 22, pp. 263- 292 ,(1988) , 10.1515/FLIN.1988.22.3-4.263
Victoria L. Scharp, Connie A. Tompkins, Jana M. Iverson, Gesture and aphasia: Helping hands? Aphasiology. ,vol. 21, pp. 717- 725 ,(2007) , 10.1080/02687030701192273
Henning Holle, Thomas C. Gunter, Shirley-Ann Rüschemeyer, Andreas Hennenlotter, Marco Iacoboni, Neural correlates of the processing of co-speech gestures. NeuroImage. ,vol. 39, pp. 2010- 2024 ,(2008) , 10.1016/J.NEUROIMAGE.2007.10.055