Content congruency and its interplay with temporal synchrony modulate integration between rhythmic audiovisual streams

作者: Yi-Huang Su

DOI: 10.3389/FNINT.2014.00092

关键词:

摘要: Both lower-level stimulus factors (e.g., temporal proximity) and higher-level cognitive content congruency) are known to influence multisensory integration. The former can direct attention in a converging manner, the latter indicate whether information from two modalities belongs together. present research investigated how these interacted perception of rhythmic, audiovisual (AV) streams derived human movement scenario. Congruency here was based on sensorimotor correspondence pertaining rhythm perception. Participants attended bimodal stimuli consisting humanlike figure moving regularly sequence auditory beat, detected possible deviant. moved either downwards (congruently) or upwards (incongruently) downbeat, while both situations synchronous with lagging behind it. Greater cross-modal binding expected hinder deviant detection. Results revealed poorer detection for congruent than incongruent streams, suggesting stronger integration former. False alarms increased asynchronous only indicating greater tendency report due visual capture events. In addition, increase perceived synchrony associated reduction false pattern reversed ones. These results demonstrate that congruency as top-down factor not promotes integration, but also modulates bottom-up effects synchrony. discussed regarding theories attentional entrainment may be combined context rhythmic stimuli.

参考文章(100)
Nina Bien, Sanne ten Oever, Rainer Goebel, Alexander T. Sack, The sound of size: Crossmodal binding in pitch-size synesthesia: A combined TMS, EEG and psychophysics study NeuroImage. ,vol. 59, pp. 663- 672 ,(2012) , 10.1016/J.NEUROIMAGE.2011.06.095
Gisa Aschersleben, Paul Bertelson, Temporal ventriloquism: Crossmodal interaction on the time dimension: 2. Evidence from sensorimotor synchronization International Journal of Psychophysiology. ,vol. 50, pp. 157- 163 ,(2003) , 10.1016/S0167-8760(03)00131-4
Paul Bertelson, Gisa Aschersleben, Temporal ventriloquism: crossmodal interaction on the time dimension: 1. Evidence from auditory–visual temporal order judgment International Journal of Psychophysiology. ,vol. 50, pp. 147- 155 ,(2003) , 10.1016/S0167-8760(03)00130-2
Vassilis Sevdalis, Peter E. Keller, Cues for self-recognition in point-light displays of actions performed in synchrony with music Consciousness and Cognition. ,vol. 19, pp. 617- 626 ,(2010) , 10.1016/J.CONCOG.2010.03.017
Edward W. Large, Mari Riess Jones, The dynamics of attending: How people track time-varying events. Psychological Review. ,vol. 106, pp. 119- 159 ,(1999) , 10.1037/0033-295X.106.1.119
Hweeling Lee, Uta Noppeney, Temporal prediction errors in visual and auditory cortices Current Biology. ,vol. 24, ,(2014) , 10.1016/J.CUB.2014.02.007
A. Brooks, R. van der Zwan, A. Billard, B. Petreska, S. Clarke, O. Blanke, Auditory motion affects visual biological motion processing Neuropsychologia. ,vol. 45, pp. 523- 530 ,(2007) , 10.1016/J.NEUROPSYCHOLOGIA.2005.12.012
J. P. Thomas, M. Shiffrar, Meaningful sounds enhance visual sensitivity to human gait regardless of synchrony. Journal of Vision. ,vol. 13, pp. 8- 8 ,(2013) , 10.1167/13.14.8
Kathrin Rothermich, Maren Schmidt-Kassow, Sonja A. Kotz, Rhythm's gonna get you: Regular meter facilitates semantic sentence processing Neuropsychologia. ,vol. 50, pp. 232- 244 ,(2012) , 10.1016/J.NEUROPSYCHOLOGIA.2011.10.025
Alexander Crocker-Buque, Georg F. Meyer, Sophie M. Wuerger, Evidence for auditory-visual processing specific to biological motion. Seeing and Perceiving. ,vol. 25, pp. 15- 28 ,(2012) , 10.1163/187847611X620892