"Who" Is Saying "What"? Brain-Based Decoding of Human Voice and Speech

作者: E. Formisano , F. De Martino , M. Bonte , R. Goebel

DOI: 10.1126/SCIENCE.1164318

关键词:

摘要: Can we decipher speech content ("what" is being said) and speaker identity ("who" saying it) from observations of brain activity a listener? Here, combine functional magnetic resonance imaging with data-mining algorithm retrieve what whom person listening to the neural fingerprints that voice signals elicit in listener's auditory cortex. These cortical are spatially distributed insensitive acoustic variations input so as permit brain-based recognition learned unknown speakers voices previously unheard utterances. Our findings unravel detailed layout computational properties populations at basis human identification.

参考文章(28)
Pascal Belin, Robert J. Zatorre, Philippe Lafaille, Pierre Ahad, Bruce Pike, Voice-selective areas in human auditory cortex Nature. ,vol. 403, pp. 309- 312 ,(2000) , 10.1038/35002078
Gregory Hickok, David Poeppel, The cortical organization of speech processing Nature Reviews Neuroscience. ,vol. 8, pp. 393- 402 ,(2007) , 10.1038/NRN2113
Dennis Norris, James M. McQueen, Shortlist B: A Bayesian model of continuous speech recognition Psychological Review. ,vol. 115, pp. 357- 395 ,(2008) , 10.1037/0033-295X.115.2.357
Rutvik Desai, Einat Liebenthal, Eric Waldron, Jeffrey R. Binder, Left posterior temporal regions are sensitive to auditory categorization Journal of Cognitive Neuroscience. ,vol. 20, pp. 1174- 1188 ,(2008) , 10.1162/JOCN.2008.20081
F. W. Ohl, H. Scheich, Orderly cortical representation of vowels based on formant interaction. Proceedings of the National Academy of Sciences of the United States of America. ,vol. 94, pp. 9440- 9444 ,(1997) , 10.1073/PNAS.94.17.9440
Kendrick N. Kay, Thomas Naselaris, Ryan J. Prenger, Jack L. Gallant, Identifying natural images from human brain activity. Nature. ,vol. 452, pp. 352- 355 ,(2008) , 10.1038/NATURE06713
I NELKEN, Processing of complex stimuli and natural scenes in the auditory cortex Current Opinion in Neurobiology. ,vol. 14, pp. 474- 480 ,(2004) , 10.1016/J.CONB.2004.06.005
Nima Mesgarani, Stephen V. David, Jonathan B. Fritz, Shihab A. Shamma, Phoneme representation and classification in primary auditory cortex. Journal of the Acoustical Society of America. ,vol. 123, pp. 899- 909 ,(2008) , 10.1121/1.2816572
Crystal T Engineer, Claudia A Perez, YeTing H Chen, Ryan S Carraway, Amanda C Reed, Jai A Shetake, Vikram Jakkamsetti, Kevin Q Chang, Michael P Kilgard, Cortical activity patterns predict speech discrimination ability Nature Neuroscience. ,vol. 11, pp. 603- 608 ,(2008) , 10.1038/NN.2109
Yukiyasu Kamitani, Frank Tong, Decoding the visual and subjective contents of the human brain Nature Neuroscience. ,vol. 8, pp. 679- 685 ,(2005) , 10.1038/NN1444