Multimodal Interaction with Emotional Feedback.

作者: Antonio Origlia , Francesco Cutugno , Roberto Rinaldi

DOI:

关键词:

摘要: In this paper we extend a multimodal framework based on speech and gestures to include emotional information by means of anger detection. recent years interaction has become great interest thanks the increasing availability mobile devices allowing number different modalities. Taking intelligent decisions is complex task for automated systems as multimodality requires procedures integrate events be interpreted single intention user it must take into account that kinds could come from channel in case speech, which conveys user’s intentions using syntax prosody both.

参考文章(14)
D. Zaykovskiy, A. Schmitt, M. Lutz, New use of mobile phones: towards multimodal information access systems Intelligent Environments, 2007. IE 07. 3rd IET International Conference on. pp. 255- 259 ,(2007) , 10.1049/CP:20070378
Andreas Stolcke, Rajdip Dhillon, Elizabeth Shriberg, Jeremy Ang, Ashley Krupski, Prosody-based automatic detection of annoyance and frustration in human-computer dialog. conference of the international speech communication association. ,(2002)
Steven J. Simske, Xiaofan Lin, John Burns, Sherif M. Yacoub, Recognition of emotions in interactive voice response systems. conference of the international speech communication association. ,(2003)
Patrick Ehlen, Michael Johnston, Multimodal local search in Speak4it Proceedings of the 15th international conference on Intelligent user interfaces - IUI '11. pp. 435- 436 ,(2011) , 10.1145/1943403.1943486
Bruno Dumas, Denis Lalanne, Rolf Ingold, Description languages for multimodal interaction: a set of guidelines and its illustration with SMUIML Journal on Multimodal User Interfaces. ,vol. 3, pp. 237- 247 ,(2010) , 10.1007/S12193-010-0043-3
Richard A. Bolt, “Put-that-there” Proceedings of the 7th annual conference on Computer graphics and interactive techniques - SIGGRAPH '80. ,vol. 14, pp. 262- 270 ,(1980) , 10.1145/800250.807503
Joëlle Coutaz, Laurence Nigay, Daniel Salber, Ann Blandford, Jon May, Richard M. Young, Four Easy Pieces for Assessing the Usability of Multimodal Interaction: The Care Properties international conference on human-computer interaction. pp. 115- 120 ,(1995) , 10.1007/978-1-5041-2896-4_19
Felix Burkhardt, Tim Polzehl, Joachim Stegmann, Florian Metze, Richard Huber, Detecting real life anger international conference on acoustics, speech, and signal processing. pp. 4761- 4764 ,(2009) , 10.1109/ICASSP.2009.4960695