Unification of Sentence Processing via Ear and Eye: An fMRI Study

作者: David Braze , W. Einar Mencl , Whitney Tabor , Kenneth R. Pugh , R. Todd Constable

DOI: 10.1016/J.CORTEX.2009.11.005

关键词: Functional magnetic resonance imagingSpeech recognitionSentence processingObject (grammar)ComprehensionCosine similaritySentenceCategorizationCognitive psychologyModality (human–computer interaction)Psychology

摘要: We present new evidence based on fMRI for the existence and neural architecture of an abstract supramodal language system that can integrate linguistic inputs arising from different modalities such speech print each activate a common code. Working with sentence material, our aim was to find out where putative is located how it responds comprehension challenges. To probe these questions we examined BOLD activity in experienced readers while they performed semantic categorization task matched written or spoken sentences were either well-formed contained anomalies syntactic form pragmatic content. On whole-brain scans, both increased net over non-anomalous baseline sentences, chiefly at left frontal temporal regions heteromodal cortex. The anomaly-sensitive sites correspond approximately those previous studies (Michael et al., 2001; Constable 2004) have found be sensitive other differences complexity (object relative minus subject relative). Regions interest (ROIs) defined by peak response anomaly averaging modality conditions. Each ROI showed same pattern across types modality. Voxel-by-voxel exploration whole brain cosine similarity measure function confirmed specificity zones.

参考文章(69)
Ron Dumont, John O. Willis, Kathleen Veizel, Jamie Zibulsky, Wechsler Abbreviated Scale of Intelligence Encyclopedia of Special Education. ,(2014) , 10.1002/9781118660584.ESE2519
Susan Y. Bookheimer, Thomas A. Zeffiro, Teresa Blaxton, William Gaillard, William Theodore, Regional cerebral blood flow during object naming and word reading. Human Brain Mapping. ,vol. 3, pp. 93- 106 ,(1995) , 10.1002/HBM.460030206
Bennett A Shaywitz, Sally E Shaywitz, Kenneth R Pugh, Robert K Fulbright, R Todd Constable, W Einar Mencl, Pawel Skudlarski, Jack M Fletcher, Alvin M Liberman, Donald P Shankweiler, Leonard Katz, Karen E Marchione, Cheryl Lacadie, Christopher Gatenby, Rafael Klorman, John C Gore, None, The Functional Neural Architecture of Components of Attention in Language-Processing Tasks NeuroImage. ,vol. 13, pp. 601- 612 ,(1998) , 10.1006/NIMG.2000.0726
Benjamin Seltzer, Deepak N. Pandya, Parietal, temporal, and occipital projections to cortex of the superior temporal sulcus in the rhesus monkey: a retrograde tracer study The Journal of Comparative Neurology. ,vol. 343, pp. 445- 463 ,(1994) , 10.1002/CNE.903430308
Martin Meyer, Angela D. Friederici, D. Yves von Cramon, Neurocognition of auditory sentence comprehension: event related fMRI reveals sensitivity to syntactic violations and task demands Cognitive Brain Research. ,vol. 9, pp. 19- 33 ,(2000) , 10.1016/S0926-6410(99)00039-7
Anders Ledberg, Brendan T. O'Sullivan, Shigeo Kinomura, Per E. Roland, Somatosensory Activations of the Parietal Operculum of Man. A PET Study European Journal of Neuroscience. ,vol. 7, pp. 1934- 1941 ,(1995) , 10.1111/J.1460-9568.1995.TB00716.X
R.Todd Constable, Kenneth R Pugh, Ella Berroya, W.Einar Mencl, Michael Westerveld, Weijia Ni, Donald Shankweiler, Sentence complexity and input modality effects in sentence comprehension: an fMRI study NeuroImage. ,vol. 22, pp. 11- 21 ,(2004) , 10.1016/J.NEUROIMAGE.2004.01.001
Mirella Dapretto, Susan Y Bookheimer, Form and Content: Dissociating Syntax and Semantics in Sentence Comprehension Neuron. ,vol. 24, pp. 427- 432 ,(1999) , 10.1016/S0896-6273(00)80855-7
Jane Ashby, Prosody in Skilled Silent Reading: Evidence from Eye Movements. Journal of Research in Reading. ,vol. 29, pp. 318- 333 ,(2006) , 10.1111/J.1467-9817.2006.00311.X