Sound-by-numbers: motion-driven sound synthesis

作者: Z. Bar-Joseph , M. Cardle , S. Brooks , P. Robinson

DOI: 10.5555/846276.846325

关键词:

摘要: We present the first algorithm for automatically generating soundtracks input animation based on other animations' soundtrack. This technique can greatly simplify production of in computer and video by re-targeting existing soundtracks. A segment source audio is used to train a statistical model which then generate variants original fit particular constraints. These constraints either be specified explicitly user form large-scale properties sound texture, or determined semi-automatically matching similar motion events those target animation.

参考文章(26)
Reynald Hoskinson, Dinesh K. Pai, Manipulation and Resynthesis with Natural Grains international computer music conference. ,vol. 2001, ,(2001)
Michael J. Pazzani, Eamonn J. Keogh, Selina Chu, David M. Hart, Iterative Deepening Dynamic Time Warping for Time Series. siam international conference on data mining. pp. 195- 212 ,(2002)
Kees van de Doel, Dinesh K Pai, Synthesis of shape dependent sounds with physical modeling Georgia Institute of Technology. ,(1996)
Larry Gritz, Jong Won Lee, James K. Hahn, Hesham Fouad, Integrating Sounds in Virtual Environments. Teleoperators and Virtual Environments. ,vol. 7, pp. 67- 77 ,(1998)
Dimitrios Gunopulos, Marc Cardle, Michail Vlachos, Eamonn Keogh, Stephen Brooks, Fast Motion Capture Matching with Replicated Motion Editing ,(2003)
Jonathan Foote, ARTHUR: Retrieving Orchestral Music by Long-Term Structure. international symposium/conference on music information retrieval. ,(2000)
Ziv Bar-Joseph, Dani Lischinski, Ran El-Yaniv, Michael Werman, Shlomo Dubnov, Granular Synthesis of Sound Textures Using Statistical Learning international computer music conference. ,vol. 1999, ,(1999)
Perfecto Herrera, Jordi Bonada, Xavier Serra, Ramon Loureiro, Integrating Complementary Spectral Models in the Design of a Musical Synthesizer international computer music conference. ,vol. 1997, pp. 152- 159 ,(1997)
Richard Polfreman, Christian Spevak, Sound spotting: a frame-based approach Indiana University Press. ,(2001)
Jun-Ichi Nakamura, Tetsuya Kaku, Kyungsil Hyun, Tsukasa Noma, Sho Yoshida, Automatic background music generation based on actors' mood and motions The Journal of Visualization and Computer Animation. ,vol. 5, pp. 247- 264 ,(1994) , 10.1002/VIS.4340050405