INTERFACE: a New Tool for Building Emotive/Expressive Talking Heads

作者: Graziano Tisato , Fabio Tesser , Carlo Drioli , Piero Cosi

DOI:

关键词:

摘要: In order to speed-up the procedure for building an emotive/expressive talking head such as LUCIA, integrated software called INTERFACE was designed and implemented in Matlab©. simplifies automates many of operations needed that purpose. A set processing tools, focusing mainly on dynamic articulatory data physically extracted by automatic optotracking 3D movement analyzer, build up animation engine, is based Cohen-Massaro coarticulation model, also create correct WAV FAP files animation. our animated MPEG-4 face, fact, can copy a real human reproducing movements some markers positioned his face recorded optoelectronic device, or be directly driven emotional XML tagged input text, thus realizing true audio visual synthesis. LUCIA’s voice Italian version FESTIVAL MBROLA packages, modified expressive/emotive synthesis means appropriate APML/VSML language.

参考文章(6)
Graziano Tisato, Andrea Fusaro, Piero Cosi, LUCIA a new italian talking-head based on a modified cohen-massaro's labial coarticulation model. conference of the international speech communication association. ,(2003)
Berardina De Carolis, Catherine Pelachaud, Isabella Poggi, Mark Steedman, APML, a Markup Language for Believable Behavior Generation Springer Berlin Heidelberg. pp. 65- 85 ,(2004) , 10.1007/978-3-662-08373-4_4
Giancarlo Ferrigno, Antonio Pedotti, Elite: A Digital Dedicated Hardware System for Movement Analysis Via Real-Time TV Signal Processing IEEE Transactions on Biomedical Engineering. ,vol. BME-32, pp. 943- 950 ,(1985) , 10.1109/TBME.1985.325627
Zsofia Ruttkay, Han Noot, Paul ten Hagen, Emotion Disc and Emotion Squares: Tools to Explore the Facial Expression Space Computer Graphics Forum. ,vol. 22, pp. 49- 53 ,(2003) , 10.1111/1467-8659.T01-1-00645
P. Cosi, E.M. Caldognetto, G. Perin, C. Zmarich, Labial coarticulation modeling for realistic facial animation international conference on multimodal interfaces. pp. 505- 510 ,(2002) , 10.1109/ICMI.2002.1167047
Claudio Zmarich, Catherine Pelachaud, Piero Cosi, Emanuela Magno Caldognetto, Modelling an Italian talking head. AVSP. pp. 72- 77 ,(2001)