Synchronization between motion and music using motion graph

作者: Auttawut Laichuthai , Pizzanu Kanongchaiyo

DOI: 10.1109/ECTICON.2011.5947883

关键词: AnimationComputer visionArtificial intelligenceComputer scienceComputer facial animationSynchronizationStructure from motionComputer animationMatch movingComputer graphics (images)Dynamic time warpingGraph (abstract data type)

摘要: Synchronization between motion and music is an interesting area in computer graphics however this part of work difficult for generating automatically therefore it usually done by animators. Some research are synthesis or edit to synchronize with data some instead. In paper, we present a scheme synchronizing synthesized using dynamic time warping change the timing both. Feature points file extracted. Then, pair synchronize. We also use graph, which well known method novice user, generate long motions fully automatic process synthesis.

参考文章(10)
Jun Xiao, Yueting Zhuang, Fei Wu, Tongqiang Guo, Zhang Liang, A group of novel approaches and a toolkit for motion capture data reusing Multimedia Tools and Applications. ,vol. 47, pp. 379- 408 ,(2010) , 10.1007/S11042-009-0329-1
Tae-hoon Kim, Sang Il Park, Sung Yong Shin, Rhythmic-motion synthesis based on motion-beat analysis international conference on computer graphics and interactive techniques. ,vol. 22, pp. 392- 401 ,(2003) , 10.1145/1201775.882283
Cheng Ren, Liming Zhao, Alla Safonova, Human Motion Synthesis with Optimization‐based Graphs Computer Graphics Forum. ,vol. 29, pp. 545- 554 ,(2010) , 10.1111/J.1467-8659.2009.01624.X
Masataka Goto, An Audio-based Real-time Beat Tracking System for Music With or Without Drum-sounds Journal of New Music Research. ,vol. 30, pp. 159- 171 ,(2001) , 10.1076/JNMR.30.2.159.7114
Hyun-Chul Lee, In-Kwon Lee, Automatic Synchronization of Background Music and Motion in Computer Animation Computer Graphics Forum. ,vol. 24, pp. 353- 361 ,(2005) , 10.1111/J.1467-8659.2005.00860.X
T. Shiratori, A. Nakazawa, K. Ikeuchi, Detecting dance motion structure through music analysis ieee international conference on automatic face gesture recognition. pp. 857- 862 ,(2004) , 10.1109/AFGR.2004.1301641
Lucas Kovar, Michael Gleicher, Frédéric Pighin, Motion graphs ACM SIGGRAPH 2008 classes on - SIGGRAPH '08. pp. 473- 482 ,(2008) , 10.1145/1401132.1401202
Okan Arikan, David A. Forsyth, James F. O'Brien, Motion synthesis from annotations international conference on computer graphics and interactive techniques. ,vol. 22, pp. 402- 408 ,(2003) , 10.1145/1201775.882284
Liming Zhao, Aline Normoyle, Sanjeev Khanna, Alla Safonova, Automatic construction of a minimum size motion graph symposium on computer animation. pp. 27- 35 ,(2009) , 10.1145/1599470.1599474