Real-time estimation of long-term 3-D motion parameters for SNHC face animation and model-based coding applications

作者: A. Smolic , B. Makai , T. Sikora

DOI: 10.1109/76.752093

关键词:

摘要: We present two recursive methods for the real-time estimation of long-term three-dimensional (3-D) motion parameters from monocular image sequences suitable synthetic/natural hybrid coding face animation and model-based applications. Based on feature point extractions in energy frame, 3-D a human are estimated with predictive approach. The first method uses linear least squares approach second employs nonlinear extended Kalman filter, which does not rely linearized model motion. Both perform prediction correction loop at every time step. Compared to other described literature, structure proposed process solves problem error accumulation estimation. This makes stable consistent over long periods. Experimental results presented synthetic data real sequences, demonstrate performance compare approaches.

参考文章(18)
Arthur Gelb, Applied Optimal Estimation ,(1974)
B. Moghaddam, A. Pentland, An automatic system for model-based coding of faces data compression conference. pp. 362- 370 ,(1995) , 10.1109/DCC.1995.515526
Paul Ekman, Wallace V. Friesen, Facial Action Coding System PsycTESTS Dataset. ,(2019) , 10.1037/T27734-000
Kay Talmi, Jin Liu, Eye and gaze tracking for visually controlled interactive stereoscopic displays Signal Processing-image Communication. ,vol. 14, pp. 799- 810 ,(1999) , 10.1016/S0923-5965(98)00044-7
K. Aizawa, H. Harashima, T. Saito, Model-based analysis synthesis image coding (MBASIC) system for a person's face Signal Processing-image Communication. ,vol. 1, pp. 139- 152 ,(1989) , 10.1016/0923-5965(89)90006-4
A. Azarbayejani, T. Starner, B. Horowitz, A. Pentland, Visually controlled graphics IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 15, pp. 602- 605 ,(1993) , 10.1109/34.216730
D. Terzopoulos, K. Waters, Analysis and synthesis of facial image sequences using physical and anatomical models IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 15, pp. 569- 579 ,(1993) , 10.1109/34.216726
Kristian Kroschel, Kalman-Bucy-Filter Springer Berlin Heidelberg. pp. 114- 154 ,(1974) , 10.1007/978-3-662-10046-2_5
T.S. Huang, A.N. Netravali, Motion and structure from feature correspondences: a review Proceedings of the IEEE. ,vol. 82, pp. 252- 268 ,(1994) , 10.1109/5.265351
Haibo Li, R. Forchheimer, Two-view facial movement estimation IEEE Transactions on Circuits and Systems for Video Technology. ,vol. 4, pp. 276- 287 ,(1994) , 10.1109/76.305872