Visual speech influences speech perception immediately but not automatically

作者: Holger Mitterer , Eva Reinisch

DOI: 10.3758/S13414-016-1249-6

关键词: GestureAuditory perceptionSpeech recognitionEye trackingSpeech perceptionMotor theory of speech perceptionVisual processingNeurocomputational speech processingVisual perceptionCommunicationPsychology

摘要: Two experiments examined the time course of use auditory and visual speech cues to spoken word recognition using an eye-tracking paradigm. Results first experiment showed that from lipreading is reduced if concurrently presented pictures require a division attentional resources. This reduction was evident even when listeners' eye gaze on speaker rather than (static) pictures. Experiment 2 used deictic hand gesture foster attention speaker. At same time, processing load by keeping display constant over fixed number successive trials. Under these conditions, were used. Moreover, data indicated information immediately earlier information. In combination, indicate are not automatically, but they used, immediately.

参考文章(57)
Alex H. C. van der Heijden, Selective Attention in Vision ,(1991)
Federico Rossano, Penelope Brown, Stephen C. Levinson, Gaze, questioning and culture Sidnell, J. (ed.), Conversation Analysis: Comparative Perspectives. pp. 187- 249 ,(2009) , 10.1017/CBO9780511635670.008
Holger Mitterer, Eva Reinisch, Letters don’t matter: No effect of orthography on the perception of conversational speech Journal of Memory and Language. ,vol. 85, pp. 116- 134 ,(2015) , 10.1016/J.JML.2015.08.005
Martin Paré, Rebecca C. Richler, Martin ten Hove, K. G. Munhall, Gaze behavior in audiovisual speech perception: The influence of ocular fixations on the McGurk effect Perception & Psychophysics. ,vol. 65, pp. 553- 567 ,(2003) , 10.3758/BF03194582
Jeffrey N. Rouder, Paul L. Speckman, Dongchu Sun, Richard D. Morey, Geoffrey Iverson, Bayesian T Tests for Accepting and Rejecting the Null Hypothesis Psychonomic Bulletin & Review. ,vol. 16, pp. 225- 237 ,(2009) , 10.3758/PBR.16.2.225