Prosody based audio/visual co-analysis for co-verbal gesture recognition
作者： Mohammed Yeasin , Sanshzar Kettebekov , Rajeev Sharma
DOI:
关键词:
摘要: The present method incorporates audio and visual cues from human gesticulation for automatic recognition. methodology articulates a framework co-analyzing gestures prosodic elements of person's speech. can be applied to wide range algorithms involving analysis gesticulating individuals. examples interactive technology applications information kiosks personal computers. video activity provides basis the development automated surveillance technologies in public places such as airports, shopping malls, sporting events.
lens.org 参考文章(37)
Lars Bretzner, Sören Lenman, Björn Thuresson, Computer Vision Based Hand Gesture Interfaces for Human-Computer Interaction ,(2002)
Alex Pentland, Brian Clarkson, Sumit Basu, Tanzeem Choudhury, Towards Measuring Human Interactions in Conversational Settings ,(2001)
Lambert Schomaker, Catherine Pelachaud, Jean Claude Martin, Bernhard Suhm, Christian Benoit, Audio visual and Multimodal Speech Systems ,(2003)
In-Cheol Kim, Sung-Il Chien, Analysis of 3D Hand Trajectory Gestures Using Stroke-Based Composite Hidden Markov Models Applied Intelligence. ,vol. 15, pp. 131- 143 ,(2001) , 10.1023/A:1011231305559
Juergen Luettin, Stéphane Dupont, Continuous Audio-Visual Speech Recognition european conference on computer vision. pp. 657- 673 ,(1998) , 10.1007/BFB0054771
Hideshi Tamaru, Junichi Yamashita, Hiroaki Ogawa, Helmut Lucke, Hitoshi Honda, Yaeko Fujita, Information processing device, information processing method and storage medium ,(2000)
Ervin Dobler, Jozsef Kiraly, Method and system for gesture category recognition and training using a feature vector ,(1998)
Gerhard Rigoll, Andreas Kosmala, Stefan Eickeler, High Performance Real-Time Gesture Recognition Using Hidden Markov Models Proceedings of the International Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction. pp. 69- 80 ,(1997) , 10.1007/BFB0052990
Timo Sowa, Martin Fröhlich, Marc Erich Latoschik, Temporal Symbolic Integration Applied to a Multimodal System Using Gestures and Speech GW '99 Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction. pp. 291- 302 ,(1999) , 10.1007/3-540-46616-9_26
Frédéric Wolff, Antonella De Angeli, Laurent Romary, Acting on a visual world : the role of perception in multimodal HCI national conference on artificial intelligence. ,(1998)