When two become one: Temporally dynamic integration of the face and voice
作者： Jonathan B. Freeman , Nalini Ambady
DOI: 10.1016/J.JESP.2010.08.018
关键词:
摘要: Abstract In everyday interactions with others, people have to deal the sight of a face and sound voice at same time. How perceptual system brings this information together over hundreds milliseconds perceive others remains unclear. 2 studies, we investigated how facial vocal cues are integrated during real-time social categorization by recording participants' hand movements (via streaming x, y coordinates computer mouse) en route “male” “female” responses on screen. Participants were presented male female faces that accompanied same-sex morphed be either sex-typical (e.g., masculinized voice) or sex-atypical (i.e., feminized voice). Before settling into ultimate sex categorizations face, simultaneous processing led continuously attracted opposite sex-category response across construal. This is evidence ongoing results from perception influence processing. Thus, involves dynamic updates gradual integration voice.
core.ac.uk
elsevier.com
jbfreeman.net 
rpi.edu 参考文章(17)
Jonathan B. Freeman, Kristin Pauker, Evan P. Apfelbaum, Nalini Ambady, Continuous dynamics in the real-time perception of race Journal of Experimental Social Psychology. ,vol. 46, pp. 179- 185 ,(2010) , 10.1016/J.JESP.2009.10.002
Beatrice de Gelder, Jean Vroomen, Sjakko J. de Jong, Erik D. Masthoff, Fons J. Trompenaars, Paul Hodiamont, Multisensory integration of emotional faces and voices in schizophrenics Schizophrenia Research. ,vol. 72, pp. 195- 203 ,(2005) , 10.1016/J.SCHRES.2004.02.013
Sayako Masuda, Takeo Tsujii, Shigeru Watanabe, An interference effect of voice presentation on face gender discrimination task: evidence from event-related potentials International Congress Series. ,vol. 1278, pp. 156- 159 ,(2005) , 10.1016/J.ICS.2004.11.193
Salvatore Campanella, Pascal Belin, Integrating Face and Voice in Person Perception ,(2014)
Jari Hietanen, Jukka Leppänen, Marko Illi, Veikko Surakka, Evidence for the integration of audiovisual emotional information at the perceptual level of processing European Journal of Cognitive Psychology. ,vol. 16, pp. 769- 790 ,(2004) , 10.1080/09541440340000330
Eric L. Smith, Marcia Grabowecky, Satoru Suzuki, Auditory-Visual Crossmodal Integration in Perception of Face Gender Current Biology. ,vol. 17, pp. 1680- 1685 ,(2007) , 10.1016/J.CUB.2007.08.043
Irene V. Blair, Charles M. Judd, Melody S. Sadler, Christopher Jenkins, The Role of Afrocentric Features in Person Perception: Judging by Features and Categories Journal of Personality and Social Psychology. ,vol. 83, pp. 5- 25 ,(2002) , 10.1037/0022-3514.83.1.5
A. A. Ghazanfar, C. Chandrasekaran, N. K. Logothetis, Interactions between the Superior Temporal Sulcus and Auditory Cortex Mediate Dynamic Face/Voice Integration in Rhesus Monkeys The Journal of Neuroscience. ,vol. 28, pp. 4457- 4469 ,(2008) , 10.1523/JNEUROSCI.0541-08.2008
Benjamin Kreifelts, Thomas Ethofer, Wolfgang Grodd, Michael Erb, Dirk Wildgruber, Audiovisual integration of emotional signals in voice and face: an event-related fMRI study. NeuroImage. ,vol. 37, pp. 1445- 1456 ,(2007) , 10.1016/J.NEUROIMAGE.2007.06.020
Beatrice de Gelder, Jean Vroomen, The perception of emotions by ear and by eye Cognition & Emotion. ,vol. 14, pp. 289- 311 ,(2000) , 10.1080/026999300378824