Do You See What I Am Saying? Exploring Visual Enhancement of Speech Comprehension in Noisy Environments

作者: L. A. Ross , D. Saint-Amour , V. M. Leavitt , D. C. Javitt , J. J. Foxe

DOI: 10.1093/CERCOR/BHL024

关键词: SpeechreadingNoisePerceptionCrossmodalMultisensory integrationSpeech perceptionSpeech enhancementModality (human–computer interaction)Computer scienceCommunicationSpeech recognition

摘要: … gain in multisensory speech enhancement at even the lowest … to the multisensory enhancements seen during audiovisual … extent of multisensory enhancement of speech …

参考文章(34)
Barry E. Stein, M. Alex Meredith, The Merging of the Senses ,(1993)
Norman P. Erber, Interaction of Audition and Vision in the Recognition of Oral Speech Stimuli Journal of Speech and Hearing Research. ,vol. 12, pp. 423- 425 ,(1969) , 10.1044/JSHR.1202.423
Carl A. Binnie, Allen A. Montgomery, Pamela L. Jackson, Auditory and Visual Contributions to the Perception of Consonants Journal of Speech and Hearing Research. ,vol. 17, pp. 619- 630 ,(1974) , 10.1044/JSHR.1704.619
Ken W. Grant, Brian E. Walden, Evaluating the articulation index for auditory–visual consonant recognition Journal of the Acoustical Society of America. ,vol. 100, pp. 2415- 2424 ,(1993) , 10.1121/1.417950
Daniel E. Callan, Jeffery A. Jones, Kevin Munhall, Akiko M. Callan, Christian Kroos, Eric Vatikiotis-Bateson, Neural processes underlying perceptual enhancement by visual speech gestures. Neuroreport. ,vol. 14, pp. 2213- 2218 ,(2003) , 10.1097/00001756-200312020-00016
Daniel E. Callan, Akiko M. Callan, Christian Kroos, Eric Vatikiotis-Bateson, Multimodal contribution to speech perception revealed by independent component analysis: a single-sweep EEG case study. Cognitive Brain Research. ,vol. 10, pp. 349- 353 ,(2001) , 10.1016/S0926-6410(00)00054-9
Norman P. Erber, Auditory-Visual Perception of Speech Journal of Speech and Hearing Disorders. ,vol. 40, pp. 481- 492 ,(1975) , 10.1044/JSHD.4004.481
CharlesE. Schroeder, Sophie Molhom, Peter Lakatos, Walter Ritter, JohnJ. Foxe, Human–simian correspondence in the early cortical processing of multisensory cues Cognitive Processing. ,vol. 5, pp. 140- 151 ,(2004) , 10.1007/S10339-004-0020-4
Alison Macleod, Quentin Summerfield, Quantifying the contribution of vision to speech perception in noise. British Journal of Audiology. ,vol. 21, pp. 131- 141 ,(1987) , 10.3109/03005368709077786