Cross-modal noise compensation in audiovisual words.
作者： Martijn Baart , Blair C. Armstrong , Clara D. Martin , Ram Frost , Manuel Carreiras
DOI: 10.1038/SREP42055
关键词:
摘要: Perceiving linguistic input is vital for human functioning, but the process complicated by fact that incoming signal often degraded. However, humans can compensate unimodal noise relying on simultaneous sensory from another modality. Here, we investigated noise-compensation spoken and printed words in two experiments. In first behavioral experiment, observed accuracy was modulated reaction time, bias sensitivity, compensation could nevertheless be explained via differences when controlling RT, sensitivity. second also measured Event Related Potentials (ERPs) robust electrophysiological correlates of starting at around 350 ms after stimulus onset, indicating most prominent lexical/semantic processing levels.
nature.com
core.ac.uk
harvard.edu
narcis.nl参考文章(34)
Martijn Baart, Arthur G. Samuel, Turning a blind eye to the lexicon: ERPs show no cross-talk between lip-read and lexical context during speech sound processing Journal of Memory and Language. ,vol. 85, pp. 42- 59 ,(2015) , 10.1016/J.JML.2015.06.008
Jonathan W. Peirce, PsychoPy--Psychophysics software in Python. Journal of Neuroscience Methods. ,vol. 162, pp. 8- 13 ,(2007) , 10.1016/J.JNEUMETH.2006.11.017
Dries J. W. Froyen, Milene L. Bonte, Nienke van Atteveldt, Leo Blomert, The long road to automation: Neurocognitive development of letter-speech sound processing Journal of Cognitive Neuroscience. ,vol. 21, pp. 567- 580 ,(2009) , 10.1162/JOCN.2009.21061
Carol A. Fowler, Dawn J. Dekle, Listening with eye and hand: Cross-modal contributions to speech perception. Journal of Experimental Psychology: Human Perception and Performance. ,vol. 17, pp. 816- 828 ,(1991) , 10.1037//0096-1523.17.3.816
Catharine M. Pettigrew, Bruce E. Murdoch, Curtis W. Ponton, Simon Finnigan, Paavo Alku, Joseph Kei, Ravi Sockalingam, Helen J. Chenery, Automatic auditory processing of english words as indexed by the mismatch negativity, using a multiple deviant paradigm. Ear and Hearing. ,vol. 25, pp. 284- 301 ,(2004) , 10.1097/01.AUD.0000130800.88987.03
Ram Frost, Laurie B. Feldman, Leonard Katz, Phonological ambiguity and lexical ambiguity: effects on visual and auditory word recognition. Journal of Experimental Psychology: Learning, Memory and Cognition. ,vol. 16, pp. 569- 580 ,(1990) , 10.1037//0278-7393.16.4.569
Charles Spence, Crossmodal correspondences: A tutorial review Attention Perception & Psychophysics. ,vol. 73, pp. 971- 995 ,(2011) , 10.3758/S13414-010-0073-7
W. H. Sumby, Irwin Pollack, Visual Contribution to Speech Intelligibility in Noise The Journal of the Acoustical Society of America. ,vol. 26, pp. 212- 215 ,(1954) , 10.1121/1.1907309
HARRY MCGURK, JOHN MACDONALD, Hearing lips and seeing voices Nature. ,vol. 264, pp. 746- 748 ,(1976) , 10.1038/264746A0
Dries Froyen, Nienke Van Atteveldt, Milene Bonte, Leo Blomert, Cross-modal enhancement of the MMN to speech-sounds indicates early and automatic integration of letters and speech-sounds Neuroscience Letters. ,vol. 430, pp. 23- 28 ,(2008) , 10.1016/J.NEULET.2007.10.014