Conditional Sequence Model for Context-Based Recognition of Gaze Aversion

作者: Louis-Philippe Morency , Trevor Darrell

DOI: 10.1007/978-3-540-78155-4_2

关键词:

摘要: Eye gaze and gesture form key conversational grounding cues that are used extensively in face-to-face interaction among people. To accurately recognize visual feedback during interaction, people often use contextual knowledge from previous current events to anticipate when is most likely occur. In this paper, we investigate how dialog context an embodied agent (ECA) can improve recognition of eye gestures. We propose a new framework for based on Latent-Dynamic Conditional Random Field (LDCRF) models learn the sub-structure external dynamics cues. Our experiments show adding information improves gestures demonstrate LDCRF model context-based aversion outperforms Support Vector Machines, Hidden Markov Models, Fields.

参考文章(21)
Michael Li, Ted Selker, Eye Pattern Analysis in Intelligent Virtual Agents intelligent virtual agents. pp. 23- 35 ,(2001) , 10.1007/3-540-44812-8_3
Neal Lesh, Candace L. Sidner, Charles Rich, Collagen: applying collaborative discourse theory to human-computer interaction Ai Magazine. ,vol. 22, pp. 15- 25 ,(2001) , 10.1609/AIMAG.V22I4.1589
Adam Kendon, Some functions of gaze-direction in social interaction Acta Psychologica. ,vol. 26, pp. 22- 63 ,(1967) , 10.1016/0001-6918(67)90005-4
David Traum, Jeff Rickel, Embodied agents for multi-party dialogue in immersive virtual worlds Proceedings of the first international joint conference on Autonomous agents and multiagent systems part 2 - AAMAS '02. pp. 766- 773 ,(2002) , 10.1145/544862.544922
Pernilla Qvarfordt, Shumin Zhai, Conversing with the user based on eye-gaze patterns Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '05. pp. 221- 230 ,(2005) , 10.1145/1054972.1055004
Atsushi Fukayama, Takehiko Ohno, Naoki Mukawa, Minako Sawaki, Norihiro Hagita, Messages embedded in gaze of interface agents --- impression management with agent's gaze Proceedings of the SIGCHI conference on Human factors in computing systems Changing our world, changing ourselves - CHI '02. pp. 41- 48 ,(2002) , 10.1145/503376.503385
Boris M. Velichkovsky, John Paulin Hansen, New technological windows into mind Proceedings of the SIGCHI conference on Human factors in computing systems common ground - CHI '96. pp. 496- 503 ,(1996) , 10.1145/238386.238619
S. Fujie, Y. Ejiri, K. Nakajima, Y. Matsusaka, T. Kobayashi, A conversation robot using head gesture recognition as para-linguistic information robot and human interactive communication. pp. 159- 164 ,(2004) , 10.1109/ROMAN.2004.1374748
Louis-Philippe Morency, Candace Sidner, Christopher Lee, Trevor Darrell, Contextual recognition of head gestures Proceedings of the 7th international conference on Multimodal interfaces - ICMI '05. pp. 18- 24 ,(2005) , 10.1145/1088463.1088470
Louis-Philippe Morency, C. Mario Christoudias, Trevor Darrell, Recognizing gaze aversion gestures in embodied conversational discourse Proceedings of the 8th international conference on Multimodal interfaces - ICMI '06. pp. 287- 294 ,(2006) , 10.1145/1180995.1181051