Analysis and synthesis of facial image sequences in model-based image coding

作者: Chang Seek Choi , K. Aizawa , H. Harashima , T. Takebe

DOI: 10.1109/76.305871

关键词: Computer visionImage processingFacial recognition systemArtificial intelligenceDigital imageComputer scienceImage codingFacial expressionFace hallucination

摘要: This paper proposes new methods for analyzing image sequences and updating textures of the three-dimensional (3-D) facial model. It also describes a method synthesizing various expressions. These three are key technologies model-based coding system. The input analysis technique directly robustly estimates 3-D head motions expressions without any two-dimensional (2-D) entity correspondences. resolves 2-D correspondence mismatch errors provides quality reproduction original images by fully incorporating synthesis rules. To verify algorithm, performs quantitative subjective evaluations. presents two texture model to improve synthesized images. first focuses on parts with large change brightness according reducing transmission bit rates. second all changes caused as well rates estimated update methods. For output images, it rules that simulate muscular actions because muscles cause more easily synthesize high-quality represent >

参考文章(17)
Paul Ekman, Wallace V. Friesen, Facial Action Coding System PsycTESTS Dataset. ,(2019) , 10.1037/T27734-000
Hans Georg Musmann, Michael Hötter, Jörn Ostermann, Object-oriented analysis-synthesis coding of moving images Signal Processing-image Communication. ,vol. 1, pp. 117- 138 ,(1989) , 10.1016/0923-5965(89)90005-2
A. N. Netravali, J. Salz, Algorithms for Estimation of Three-Dimensional Motion AT&T Technical Journal. ,vol. 64, pp. 335- 346 ,(1985) , 10.1002/J.1538-7305.1985.TB00436.X
Norbert Diehl, Object-oriented motion estimation and segmentation in image sequences Signal Processing-image Communication. ,vol. 3, pp. 23- 56 ,(1991) , 10.1016/0923-5965(91)90028-Z
C.S. Choi, H. Harashima, T. Takebe, Analysis and synthesis of facial expressions in knowledge-based coding of facial image sequences international conference on acoustics, speech, and signal processing. pp. 2737- 2740 ,(1991) , 10.1109/ICASSP.1991.150968
K. Aizawa, H. Harashima, T. Saito, Model-based analysis synthesis image coding (MBASIC) system for a person's face Signal Processing-image Communication. ,vol. 1, pp. 139- 152 ,(1989) , 10.1016/0923-5965(89)90006-4
Masahide Kaneko, Atsushi Koike, Yoshinori Hatori, Coding of facial image sequence based on a 3-D model of the head and motion detection Journal of Visual Communication and Image Representation. ,vol. 2, pp. 39- 54 ,(1991) , 10.1016/1047-3203(91)90034-D
M. Yamamoto, P. Boulanger, J.-A. Beraldin, M. Rioux, Direct estimation of range flow on deformable shape from a video rate range camera IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 15, pp. 82- 89 ,(1993) , 10.1109/34.184776
D. Terzopoulos, K. Waters, Analysis and synthesis of facial image sequences using physical and anatomical models IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 15, pp. 569- 579 ,(1993) , 10.1109/34.216726
D. Pearson, Model-based image coding global communications conference. pp. 554- 558 ,(1989) , 10.1109/GLOCOM.1989.64032