Real-time classification of dance gestures from skeleton animation

作者: Michalis Raptis , Darko Kirovski , Hugues Hoppe

DOI: 10.1145/2019406.2019426

关键词: OracleGestureAnimationRobustness (computer science)Classifier (UML)Gesture classificationComputer visionDanceReal time classificationArtificial intelligenceComputer science

摘要: We present a real-time gesture classification system for skeletal wireframe motion. Its key components include an angular representation of the skeleton designed recognition robustness under noisy input, cascaded correlation-based classifier multivariate time-series data, and distance metric based on dynamic time-warping to evaluate difference in motion between acquired oracle matching gesture. While first last tools are generic nature could be applied any gesture-matching scenario, is conceived assumption that input adheres known, canonical time-base: musical beat. On benchmark comprising 28 classes, hundreds instances recorded using XBOX Kinect platform performed by dozens subjects each class, our has average accuracy 96:9%, approximately 4-second recordings. This remarkable given noise from depth sensor.

参考文章(29)
Eamonn Keogh, Themistoklis Palpanas, Victor B. Zordan, Dimitrios Gunopulos, Marc Cardle, Indexing large human-motion databases very large data bases. pp. 780- 791 ,(2004) , 10.1016/B978-012088469-8.50069-3
Christopher M. Bishop, Pattern Recognition and Machine Learning (Information Science and Statistics) Springer-Verlag New York, Inc.. ,(2006)
Christopher M. Bishop, Pattern Recognition and Machine Learning ,(2006)
Nancy S. Pollard, Jessica K. Hodgins, Jernej Barbič, Jia-Yu Pan, Christos Faloutsos, Alla Safonova, Segmenting motion capture data into distinct behaviors graphics interface. pp. 185- 194 ,(2004)
Jessica K. Hodgins, Ronit Slyper, Action capture with accelerometers symposium on computer animation. pp. 193- 199 ,(2008) , 10.5555/1632592.1632620
Meinard Müller, Tido Röder, Michael Clausen, Efficient content-based retrieval of motion capture data international conference on computer graphics and interactive techniques. ,vol. 24, pp. 677- 685 ,(2005) , 10.1145/1073204.1073247
C. Schuldt, I. Laptev, B. Caputo, Recognizing human actions: a local SVM approach international conference on pattern recognition. ,vol. 3, pp. 32- 36 ,(2004) , 10.1109/ICPR.2004.747
Tae-hoon Kim, Sang Il Park, Sung Yong Shin, Rhythmic-motion synthesis based on motion-beat analysis international conference on computer graphics and interactive techniques. ,vol. 22, pp. 392- 401 ,(2003) , 10.1145/1201775.882283
Eamonn Keogh, Chotirat Ann Ratanamahatana, Exact indexing of dynamic time warping Knowledge and Information Systems. ,vol. 7, pp. 358- 386 ,(2005) , 10.1007/S10115-004-0154-9
A.G. Kirk, J.F. O'Brien, D.A. Forsyth, Skeletal parameter estimation from optical motion capture data computer vision and pattern recognition. ,vol. 2, pp. 1185- 1185 ,(2005) , 10.1109/CVPR.2005.327