Temporal Symbolic Integration Applied to a Multimodal System Using Gestures and Speech
作者： Timo Sowa , Martin Fröhlich , Marc Erich Latoschik
关键词:
摘要: This paper presents a technical approach for temporal symbol integration aimed to be generally applicable in unimodal and multimodal user interfaces. It draws its strength from symbolic data representation an underlying rule-based system, is embedded multiagent system. The core method motivated by findings cognitive science research. We discuss application gesture recognition task speech-gesture Virtual Construction scenario. Finally outlook of empirical evaluation given.
springer.com
core.ac.uk
sci-hub.st 参考文章(15)
Dana Harry Ballard, An Introduction to Natural Computation ,(1997)
Alan Wexelblat, Research Challenges in Gesture: Open Issues and Unsolved Problems Proceedings of the International Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction. pp. 1- 11 ,(1997) , 10.1007/BFB0052984
Martin Fröhlich, Ipke Wachsmuth, Gesture Recognition of the Upper Limbs - From Signal to Symbol Proceedings of the International Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction. pp. 173- 184 ,(1997) , 10.1007/BFB0052998
Britta Lenzmann, Benutzeradaptive und multimodale Interface-Agenten Dissertationen zur künstlichen Intelligenz ; Bd. 184. ,(1998)
P. A. Harling, A. D. N. Edwards, Hand Tension as a Gesture Segmentation Cue Proceedings of Gesture Workshop on Progress in Gestural Interaction. pp. 75- 88 ,(1996) , 10.1007/978-1-4471-0943-3_7
Ipke Wachsmuth, Communicative Rhythm in Gesture and Speech GW '99 Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction. pp. 277- 289 ,(1999) , 10.1007/3-540-46616-9_25
Michael Johnston, Philip R. Cohen, David McGee, Sharon L. Oviatt, James A. Pittman, Ira Smith, Unification-based multimodal integration Proceedings of the 35th annual meeting on Association for Computational Linguistics -. pp. 281- 288 ,(1997) , 10.3115/976909.979653
Ernst Pöppel, A hierarchical model of temporal perception Trends in Cognitive Sciences. ,vol. 1, pp. 56- 61 ,(1997) , 10.1016/S1364-6613(97)01008-5
Marc Erich Latoschik, Ipke Wachsmuth, Exploiting Distant Pointing Gestures for Object Selection in a Virtual Environment Proceedings of the International Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction. pp. 185- 196 ,(1997) , 10.1007/BFB0052999
David McNeill, Hand and Mind: What Gestures Reveal about Thought ,(1992)