Visual Gender Cues Elicit Agent Expectations: Different Mismatches in Situated Language Comprehension.

作者: Pia Knoeferle , Michele Burigo , Alba Rodriguez

DOI:

关键词:

摘要: Previous research has shown that visual cues (depicted events) can have a strong effect on language comprehension and guide attention more than stereotypical thematic role knowledge (‘depicted / recent event preference’). We examined to which extent this finding generalizes another cue (gender from the hands of an agent) it is modulated by picture-sentence incongruence. Participants inspected videos performing action, then listened non-canonical German OVS sentences while we monitored their eye gaze faces two potential subjects agents (one male one female). In Experiment 1, sentential verb phrase matched (vs. mismatched) video action in 2, subject gender agent’s video. Additionally, both experiments manipulated stereotypicality congruence (i.e. whether described actions or mismatched video). overall preferred inspect target agent face whose seen previous video), suggesting depicted preference observed studies cues. Stereotypicality match did not seem modulate behavior. However, when there was mismatch between sentence video, participants tended look away (post-verbally for action-verb mismatches at final region hand – mismatches), outright incongruence

参考文章(17)
Pia Knoeferle, Maria Nella Carminati, Katja Munster, How Do Static and Dynamic Emotional Faces Prime Incremental Semantic Interpretation?: Comparing Older and Younger Adults Cognitive Science. ,vol. 36, ,(2014)
Dato Abashidze, Pia Knoeferle, Maria Nella Carminati, How robust is the recent event preference Cognitive Science. ,vol. 36, pp. 97- ,(2014)
Yuki Kamide, Christoph Scheepers, Gerry T. M. Altmann, Integration of syntactic and semantic information in predictive processing: cross-linguistic evidence from German and English Journal of Psycholinguistic Research. ,vol. 32, pp. 37- 55 ,(2003) , 10.1023/A:1021933015362
Pia Knoeferle, Matthew W. Crocker, The influence of recent scene events on spoken comprehension: Evidence from eye movements Journal of Memory and Language. ,vol. 57, pp. 519- 543 ,(2007) , 10.1016/J.JML.2007.01.003
Charles Stangor, Laure Lynch, Changming Duan, Beth Glas, Categorization of individuals on the basis of multiple social features. Journal of Personality and Social Psychology. ,vol. 62, pp. 207- 218 ,(1992) , 10.1037/0022-3514.62.2.207
Manabu Arai, Roger P.G. van Gompel, Christoph Scheepers, Priming ditransitive structures in comprehension. Cognitive Psychology. ,vol. 54, pp. 218- 250 ,(2007) , 10.1016/J.COGPSYCH.2006.07.001
Pia Knoeferle, Maria Nella Carminati, Dato Abashidze, Kai Essig, Preferential Inspection of Recent Real-World Events Over Future Events: Evidence from Eye Tracking during Spoken Sentence Comprehension. Frontiers in Psychology. ,vol. 2, pp. 376- 376 ,(2011) , 10.3389/FPSYG.2011.00376
Michael K Tanenhaus, Michael J Spivey-Knowlton, Kathleen M Eberhard, Julie C Sedivy, Integration of visual and linguistic information in spoken language comprehension Science. ,vol. 268, pp. 1632- 1634 ,(1995) , 10.1126/SCIENCE.7777863
Philip B. Gough, Grammatical transformations and speed of understanding Journal of Verbal Learning and Verbal Behavior. ,vol. 4, pp. 107- 111 ,(1965) , 10.1016/S0022-5371(65)80093-7
Yuki Kamide, Gerry T.M Altmann, Sarah L Haywood, The time-course of prediction in incremental sentence processing: Evidence from anticipatory eye-movements Journal of Memory and Language. ,vol. 49, pp. 133- 156 ,(2003) , 10.1016/S0749-596X(03)00023-8