Recognizing multiple persons' facial expressions using HMM based on automatic extraction of significant frames from image sequences

作者: T. Otsuka , J. Ohya

DOI: 10.1109/ICIP.1997.638829

关键词: Facial musclesExpression (mathematics)Motion estimationFacial expressionFeature vectorImage processingPattern recognitionFeature extractionComputer visionMathematicsFacial recognition systemArtificial intelligence

摘要: A method that can be used for recognizing facial expressions of multiple persons is proposed. In this method, the condition muscles assigned to a hidden state HMM each expression. Then, probability updated according feature vector obtained from image processing. Image processing performed in two steps. First, velocity estimated every successive frames by using an optical flow algorithm. two-dimensional Fourier transform applied field at regions around eye and mouth. The coefficients lower frequencies are selected form vector. mixture density approximating output so as represent variation among persons. To cope with case when displayed continuously, computation modified such peak motion detected, new sequence assumed start previous frame minimal motion. Experiments show effective because recognition accuracy improves number mixtures increases. addition, correctly recognizes expression continuously follows another one.

参考文章(6)
Hiroshi Harashima, Fumio Kishino, Intelligent Image Coding and Communications with Realistic Sensations --Recent Trends-- IEICE Transactions on Communications. pp. 1582- 1592 ,(1991)
Kenji Mase, Recognition of Facial Expression from Optical Flow IEICE Transactions on Information and Systems. ,vol. 74, pp. 3474- 3483 ,(1991)
T. Otsuka, J. Ohya, Recognition of facial expressions using HMM with continuous output probabilities robot and human interactive communication. pp. 323- 328 ,(1996) , 10.1109/ROMAN.1996.568857
Y. Yacoob, L.S. Davis, Recognizing human facial expressions from long image sequences using optical flow IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 18, pp. 636- 642 ,(1996) , 10.1109/34.506414
Berthold K. Horn, Brian G. Schunck, Determining Optical Flow Techniques and Applications of Image Understanding. ,vol. 0281, pp. 319- 331 ,(1981) , 10.1117/12.965761
Fumio Kishino, Jun Ohya, Tatsumi Sakaguchi, Facial Expression Recognition from Image Sequence Using Hidden Markov Model The Journal of The Institute of Image Information and Television Engineers. ,vol. 49, pp. 1060- 1067 ,(1995)