Facial expression synthesis based on natural voice for virtual face-to-face communication with machine

作者: S. Morishima , H. Harashima

DOI: 10.1109/VRAIS.1993.380740

关键词:

摘要: Basic research to a virtual face-to-face communication environment between an operator and machine is presented. In this system, human natural face appears on the display of can talk with voice expressions. A expression synthesis scheme driven by Voice includes not only linguistic information but also emotional features. An control both features proposed. head 3-D wire frame model expressed. The surface generated texture mapping 2-D real image. All motions expressions are synthesized controlled automatically movement some feature points model. >

参考文章(11)
Shigeo Morishima, Hiroshi Harashima, Facial Animation Synthesis for Human-Machine Communication System. international conference on human-computer interaction. pp. 1085- 1090 ,(1993)
S. Morishima, H. Harashima, Human machine interface using media conversion and model-based coding schemes international symposium on visual computing. pp. 95- 105 ,(1992) , 10.1007/978-4-431-68204-2_7
Paul Ekman, Wallace V. Friesen, Facial Action Coding System PsycTESTS Dataset. ,(2019) , 10.1037/T27734-000
S. Morishima, H. Harashima, H. Miyakawa, A proposal of a knowledge based isolated word recognition international conference on acoustics, speech, and signal processing. ,vol. 11, pp. 713- 716 ,(1986) , 10.1109/ICASSP.1986.1169202
S. Morishima, T. Sakaguchi, H. Harashima, A facial image synthesis system for human-machine interface robot and human interactive communication. pp. 363- 368 ,(1992) , 10.1109/ROMAN.1992.253860
Yumiko Fukuda, Shizuo Hiki, Characteristics of the mouth shape in the production of Japanese The Journal of The Acoustical Society of Japan (e). ,vol. 3, pp. 75- 91 ,(1982) , 10.1250/AST.3.75
C.S. Choi, H. Harashima, T. Takebe, Analysis and synthesis of facial expressions in knowledge-based coding of facial image sequences international conference on acoustics, speech, and signal processing. pp. 2737- 2740 ,(1991) , 10.1109/ICASSP.1991.150968
Michael Potmesil, Eric M. Hoffert, The pixel machine: a parallel image computer international conference on computer graphics and interactive techniques. ,vol. 23, pp. 69- 78 ,(1989) , 10.1145/74333.74340
Carl E. Williams, Kenneth N. Stevens, Emotions and Speech: Some Acoustical Correlates The Journal of the Acoustical Society of America. ,vol. 52, pp. 1238- 1250 ,(1972) , 10.1121/1.1913238
S. Morishima, H. Harashima, A media conversion from speech to facial image for intelligent man-machine interface IEEE Journal on Selected Areas in Communications. ,vol. 9, pp. 594- 600 ,(1991) , 10.1109/49.81953