Spatiotemporal aspects in audiovisual interaction

作者: Stefano Targher

DOI:

关键词:

摘要: How humans perceive everyday reality is one of the most fascinating and enduring interest different scientific disciplines. The aim present dissertation to investigate - from both a theoretical an empirical perspective some aspects concerning crossmodal interactions between hearing vision. In first part introduction special attention given cortical subcortical neural substrate involved in integrating sensory modalities, more specifically, audiovisual stimuli. Experimental studies literature designed empirically interaction potential existence dominance vision will be presented. last part, focalized discuss principal models aimed predict outcome integration its relation with dominance. The following chapters experimental role eye movements auditory cognition. In study, effects on spatial representation explored. disentangle controversial results emerged two that used type sounds (i.e., free field provided through loudspeakers vs. intracranially headphones) tasks. In second disputed perception action investigated presence illusion. verify whether participants’ visuo-motor behaviour might biased by visual illusion as for perception, eventually, perceptive motor biases are correlated. The study presented this explore stimulation low patients pathology. More precisely, possible detection enhancement sound coupled stimulus investigated. To purpose, experiment, effect disparity stimuli deepened while experiments temporal disparities stimuli. The described provide evidence cognition systems induced sound. Moreover findings report time significant audition patients.

参考文章(187)
G. S. Russo, C. J. Bruce, Frontal eye field activity preceding aurally guided saccades. Journal of Neurophysiology. ,vol. 71, pp. 1250- 1253 ,(1994) , 10.1152/JN.1994.71.3.1250
Paul Bertelson, Gisa Aschersleben, Temporal ventriloquism: crossmodal interaction on the time dimension: 1. Evidence from auditory–visual temporal order judgment International Journal of Psychophysiology. ,vol. 50, pp. 147- 155 ,(2003) , 10.1016/S0167-8760(03)00130-2
Barry E. Stein, M. Alex Meredith, The Merging of the Senses ,(1993)
Giacomo Rizzolatti, Leonardo Fogassi, Vittorio Gallese, Neurophysiological mechanisms underlying the understanding and imitation of action. Nature Reviews Neuroscience. ,vol. 2, pp. 661- 670 ,(2001) , 10.1038/35090060
JC Middlebrooks, EI Knudsen, A neural code for auditory space in the cat's superior colliculus. The Journal of Neuroscience. ,vol. 4, pp. 2621- 2634 ,(1984) , 10.1523/JNEUROSCI.04-10-02621.1984
Michael I. Posner, Chronometric explorations of mind ,(1978)
M. T. Wallace, M. A. Meredith, B. E. Stein, Converging influences from visual, auditory, and somatosensory cortices onto output neurons of the superior colliculus. Journal of Neurophysiology. ,vol. 69, pp. 1797- 1809 ,(1993) , 10.1152/JN.1993.69.6.1797
Yale E. Cohen, Richard A. Andersen, Reaches to Sounds Encoded in an Eye-Centered Reference Frame Neuron. ,vol. 27, pp. 647- 652 ,(2000) , 10.1016/S0896-6273(00)00073-8