Phonetic recalibration in audiovisual speech

作者: Jean Vroomen , Martijn Baart

DOI:

关键词:

摘要: In 2003, we (Bertelson et al. 2003) reported that phonetic recalibration induced by McGurk-like stimuli can indeed be observed. We termed the phenomenon “recalibration” in analogy with much better known “spatial recalibration,” as considered it a readjustment or fine-tuning of an already existing representation. same year, and complete independence, Norris (2003) very similar they named “perceptual learning speech.” The basic procedure both studies was similar: Listeners were presented phonetically ambiguous speech sound another source contextual information disambiguated sound. our study, listeners halfway between /b/ /d/ context video synchronized face articulated (in short, lip-read information), whereas study (2003), /s/-/f/ heard embedded f- s-biasing word (e.g., “witlo-s/f” f-biasing because “witlof” is Dutch meaning “chicory,” but “witlos” not word). Recalibration (or perceptual learning) subsequently measured auditory-only identification test which participants identified members continuum. manifested itself shift categorization toward contextually defined environment. thus increased their report sounds consistent had received before, so more responses after exposure to rather than /d/, /f/ words /s/-biasing words. Presumably, this reflected adjustment phoneme boundary helped understand prevailing input environment.After these seminal reports, there have been number examined detail (Baart Vroomen 2010a, 2010b; Cutler 2008; Eisner McQueen 2005, 2006; Jesse 2007; Kraljic 2008a, 2008b; Samuel 2006, 2006a, 2006b; Sjerps 2010; Stevens van Linden 2007, Baart 2009a, 2009b; 2004, 2007). what follows, will provide overview literature and, given topic book, focus on audiovisual case.

参考文章(78)
Sally Butterfield, Anne Cutler, James M. McQueen, Dennis Norris, Prelexically-driven perceptual retuning of phoneme boundaries conference of the international speech communication association. pp. 2056- 2056 ,(2008)
Lawrence D. Rosenblum, Mark A. Schmuckler, Jennifer A. Johnson, The McGurk effect in infants Perception & Psychophysics. ,vol. 59, pp. 347- 357 ,(1997) , 10.3758/BF03211902
Monique Radeau, Paul Bertelson, Adaptation to auditory-visual discordance and ventriloquism in semirealistic situations Perception & Psychophysics. ,vol. 22, pp. 137- 146 ,(1977) , 10.3758/BF03198746
Arthur G Samuel, Red herring detectors and speech perception: in defense of selective adaptation. Cognitive Psychology. ,vol. 18, pp. 452- 499 ,(1986) , 10.1016/0010-0285(86)90007-1
Randy L. Diehl, Jeffrey L. Elman, Susan B. McCusker, Contrast effects on stop consonant identification. Journal of Experimental Psychology: Human Perception and Performance. ,vol. 4, pp. 599- 609 ,(1978) , 10.1037/0096-1523.4.4.599
Martin Roberts, Quentin Summerfield, Audiovisual presentation demonstrates that selective adaptation in speech perception is purely auditory Perception & Psychophysics. ,vol. 30, pp. 309- 314 ,(1981) , 10.3758/BF03206144
Tanya Kraljic, Arthur G. Samuel, Perceptual learning for speech: Is there a return to normal? Cognitive Psychology. ,vol. 51, pp. 141- 178 ,(2005) , 10.1016/J.COGPSYCH.2005.05.001
E. Formisano, F. De Martino, M. Bonte, R. Goebel, "Who" Is Saying "What"? Brain-Based Decoding of Human Voice and Speech Science. ,vol. 322, pp. 970- 973 ,(2008) , 10.1126/SCIENCE.1164318
Daniel E. Callan, Jeffery A. Jones, Kevin Munhall, Akiko M. Callan, Christian Kroos, Eric Vatikiotis-Bateson, Neural processes underlying perceptual enhancement by visual speech gestures. Neuroreport. ,vol. 14, pp. 2213- 2218 ,(2003) , 10.1097/00001756-200312020-00016
Dominic W. Massaro, Children's Perception of Visual and Auditory Speech. Child Development. ,vol. 55, pp. 1777- 1788 ,(1984) , 10.1111/J.1467-8624.1984.TB00420.X