Editorial: “Signals to Signs” – Feature Extraction, Recognition, and Multimodal Fusion

作者: Kostas Karpouzis

DOI: 10.1007/978-3-642-15184-2_5

关键词:

摘要: Processing of recorded or real-time signals, feature extraction, and recognition are concepts utmost important to an affect–aware capable system, since they offer the opportunity machines benefit from modeling human behavior based on theory interpret it observation. This chapter discusses extraction unimodal features in case speech, facial expressions gestures, physiological signals elaborates attention, fusion, dynamics, adaptation different multimodal cases.

参考文章(17)
Ginevra Castellano, Loic Kessous, George Caridakis, Emotion Recognition through Multiple Modalities: Face, Body Gesture, Speech Affect and Emotion in Human-Computer Interaction. pp. 92- 103 ,(2008) , 10.1007/978-3-540-85099-1_8
Algirdas Pakstas, Robert Forchheimer, Igor S. Pandzic, MPEG-4 Facial Animation: The Standard,Implementation and Applications John Wiley & Sons, Inc.. ,(2002)
David F. McAllister, Robert D. Rodman, Donald L. Bitzer, Andrew S. Freeman, Lip synchronization for animation ACM SIGGRAPH 97 Visual Proceedings: The art and interdisciplinary programs of SIGGRAPH '97 on - SIGGRAPH '97. pp. 225- ,(1997) , 10.1145/259081.259312
Tsuhan Chen, R.R. Rao, Audio-visual integration in multimodal communication Proceedings of the IEEE. ,vol. 86, pp. 837- 852 ,(1998) , 10.1109/5.664274
Sharon Oviatt, Ten myths of multimodal interaction Communications of The ACM. ,vol. 42, pp. 74- 81 ,(1999) , 10.1145/319382.319398
Selim Onat, Klaus Libertus, Peter König, Integrating audiovisual information for the control of overt attention. Journal of Vision. ,vol. 7, pp. 11- 11 ,(2007) , 10.1167/7.10.11
ALEXANDRINA ROGOZAN, DISCRIMINATIVE LEARNING OF VISUAL DATA FOR AUDIOVISUAL SPEECH RECOGNITION International Journal on Artificial Intelligence Tools. ,vol. 8, pp. 43- 52 ,(1999) , 10.1142/S021821309900004X
Louis-Philippe Morency, Candace Sidner, Christopher Lee, Trevor Darrell, Head gestures for perceptual interfaces: The role of context in improving recognition Artificial Intelligence. ,vol. 171, pp. 568- 585 ,(2007) , 10.1016/J.ARTINT.2007.04.003
Alessandro Vinciarelli, Hervé Bourlard, Maja Pantic, Social Signal Processing ,(2017)
Roel Vertegaal, Robert Slagter, Gerrit van der Veer, Anton Nijholt, Eye gaze patterns in conversations Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '01. pp. 301- 308 ,(2001) , 10.1145/365024.365119