Extraction of key postures from 3D human motion data for choreography summarization

作者: Ioannis Rallis , Ioannis Georgoulas , Nikolaos Doulamis , Athanasios Voulodimos , Panagiotis Terzopoulos

DOI: 10.1109/VS-GAMES.2017.8056576

关键词: Algorithm designChoreographyFeature extractionKey (cryptography)Process (engineering)Artificial intelligenceDocumentationEngineeringComputer visionMotion (physics)Data miningAutomatic summarization

摘要: Modelling and digitizing performing arts through motion capturing interfaces is an important aspect for the analysis, processing documentation of intangible cultural heritage assets. However, existing modelling approaches may involve huge amounts information which are difficult to process, store analyze. To address these limitations, usually a skeleton describing dancer extracted. often complexity still remains due high spatio-temporal dependencies detected joints. In this paper, alternative approach presented: choreography summarization. This means that very small number image frames extracted represent choreography, thus significantly reducing storage complexity. our problem summarization treated as unsupervised clustering approach. Evaluation indices introduced monitoring performance. Experimental results on real-life dancing performances verifies capability proposed method capture main patterns with trajectory points.

参考文章(21)
Alexandros Kitsikidis, Stella Douka, Nikos Grammalidis, Kosmas Dimitropoulos, Dance analysis using multiple Kinect sensors international conference on computer vision theory and applications. pp. 789- 795 ,(2014)
Jeff K. T. Tang, Jacky C. P. Chan, Howard Leung, Interactive dancing game with real-time recognition of continuous dance moves from 3D human motion capture Proceedings of the 5th International Confernece on Ubiquitous Information Management and Communication - ICUIMC '11. pp. 50- ,(2011) , 10.1145/1968613.1968674
Konstantinos Makantasis, Anastasios Doulamis, Nikolaos Doulamis, Marinos Ioannides, In the wild image retrieval and clustering for 3D cultural heritage landmarks reconstruction Multimedia Tools and Applications. ,vol. 75, pp. 3593- 3629 ,(2016) , 10.1007/S11042-014-2191-Z
Ioannis Kapsouras, Nikos Nikolaidis, Action recognition on motion capture data using a dynemes and forward differences representation Journal of Visual Communication and Image Representation. ,vol. 25, pp. 1432- 1445 ,(2014) , 10.1016/J.JVCIR.2014.04.007
Nikolaos Doulamis, Anastasios Doulamis, Non-sequential multiscale content-based video decomposition Signal Processing. ,vol. 85, pp. 325- 356 ,(2005) , 10.1016/J.SIGPRO.2004.10.004
Dimitrios S. Alexiadis, Philip Kelly, Petros Daras, Noel E. O'Connor, Tamy Boubekeur, Maher Ben Moussa, Evaluating a dancer's performance using kinect-based skeleton tracking acm multimedia. pp. 659- 662 ,(2011) , 10.1145/2072298.2072412
David Arthur, Sergei Vassilvitskii, k-means++: the advantages of careful seeding symposium on discrete algorithms. pp. 1027- 1035 ,(2007) , 10.5555/1283383.1283494
Matija Marolt, Janez Franc Vratanar, Gregor Strle, Ethnomuse: Archiving folk music and dance culture ieee eurocon. pp. 322- 326 ,(2009) , 10.1109/EURCON.2009.5167650
N.D. Doulamis, A.D. Doulamis, Y.S. Avrithis, K.S. Ntalianis, S.D. Kollias, Efficient summarization of stereoscopic video sequences IEEE Transactions on Circuits and Systems for Video Technology. ,vol. 10, pp. 501- 517 ,(2000) , 10.1109/76.844996
Renata M. Sheppard, Mahsa Kamali, Raoul Rivas, Morihiko Tamai, Zhenyu Yang, Wanmin Wu, Klara Nahrstedt, Advancing interactive collaborative mediums through tele-immersive dance (TED) Proceeding of the 16th ACM international conference on Multimedia - MM '08. pp. 579- 588 ,(2008) , 10.1145/1459359.1459437