Mirror-Based Multi-View Analysis of Facial Motions

作者: Jurgen Rurainsky , Peter Eisert

DOI: 10.1109/ICIP.2007.4379249

关键词:

摘要: We present our system for the capturing and analysis of 3D facial motion. A high speed camera is used as capture unit in combination with two surface mirrors. The mirrors provide additional virtual views face without need multiple cameras to avoid synchronization problems. use this motion a person's while speaking. Investigations these motions are presented rigid non-rigid analyzed. In order extract only deformation independent from head pose, we new simple approach separating named weight-compensated estimation (WCME). This weights data points according their influence desired model. also first results model-based analysis. Such can be animations achieve higher degree quality.

参考文章(14)
Sumit Basu, A three-dimensional model of human lip motion Massachusetts Institute of Technology. ,(1997)
Alessio Del Bue, Xavier Lladó, Lourdes Agapito, Non-rigid Face Modelling Using Shape Priors Lecture Notes in Computer Science. pp. 97- 108 ,(2005) , 10.1007/11564386_9
David Alleysson, Sabine Süsstrunk, Spatio-chromatic ICA of a Mosaiced Color Image international conference on independent component analysis and signal separation. ,vol. 3195, pp. 946- 953 ,(2004) , 10.1007/978-3-540-30110-3_119
Matthias Odisio, Gérard Bailly, Frédéric Elisei, Tracking talking faces with shape and appearance models Speech Communication. ,vol. 44, pp. 63- 82 ,(2004) , 10.1016/J.SPECOM.2004.10.008
I.A. Essa, A.P. Pentland, Facial expression recognition using a dynamic model and motion energy international conference on computer vision. pp. 360- 367 ,(1995) , 10.1109/ICCV.1995.466916
Julian J. Faraway, Modeling continuous shape change for facial animation Statistics and Computing. ,vol. 14, pp. 357- 363 ,(2004) , 10.1023/B:STCO.0000039485.52129.ED
H. Li, P. Roivainen, R. Forchheimer, 3-D motion estimation in model-based facial image coding IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 15, pp. 545- 555 ,(1993) , 10.1109/34.216724
P. Eisert, B. Girod, Analyzing facial expressions for virtual conferencing IEEE Computer Graphics and Applications. ,vol. 18, pp. 70- 78 ,(1998) , 10.1109/38.708562
N. Ploskas, D. Simitopoulos, D. Tzovaras, G.A. Triantafyllidis, M.G. Strintzis, Rigid and Non-Rigid 3D Motion Estimation from Multiview Image Sequences Signal Processing-image Communication. ,vol. 18, pp. 185- 202 ,(2003) , 10.1016/S0923-5965(02)00131-5
Wen-Qing Huang, Yun-Hua Zhang, Ya-Ming Wang, Hong-Wei Cheng, 3D non-rigid motion estimation using the improved simulated annealing algorithm international conference on machine learning and cybernetics. ,vol. 9, pp. 5330- 5335 ,(2005) , 10.1109/ICMLC.2005.1527885