Towards macro- and micro-expression spotting in video using strain patterns

作者: Matthew Shreve , Sridhar Godavarthy , Vasant Manohar , Dmitry Goldgof , Sudeep Sarkar

DOI: 10.1109/WACV.2009.5403044

关键词: SegmentationImage segmentationOptical flowSpottingObject detectionComputer scienceFacial expressionFace (geometry)Computer visionArtificial intelligenceExpression (mathematics)

摘要: This paper presents a novel method for automatic spotting (temporal segmentation) of facial expressions in long videos comprising continuous and changing expressions. The utilizes the strain impacted on skin due to non-rigid motion caused during magnitude is calculated using central difference over robust dense optical flow field each subjects face. Testing has been done 2 datasets (which includes 100 macro-expressions) promising results have obtained. several common drawbacks found expression segmentation including moderate in-plane out-of-plane motion. Additionally, also modified work with containing micro-expressions. Micro-expressions are detected utilizing their smaller spatial temporal extent. A subject's face divided sub-regions (mouth, cheeks, forehead, eyes) these regions. Strain patterns individual regions used identify subtle changes which facilitate detection

参考文章(17)
Paul Ekman, Wallace V. Friesen, Unmasking the face : a guide to recognizing emotions from facial clues Prentice-Hall. ,(1975)
Chan-Su Lee, Ahmed Elgammal, Facial Expression Analysis Using Nonlinear Decomposable Generative Models Lecture Notes in Computer Science. pp. 17- 31 ,(2005) , 10.1007/11564386_3
Janet Rothwell, Zuhair Bandar, James O'Shea, David McLean, Silent talker: a new computer-based system for the analysis of facial cues to deception Applied Cognitive Psychology. ,vol. 20, pp. 757- 777 ,(2006) , 10.1002/ACP.1204
I.A. Essa, A.P. Pentland, Facial expression recognition using a dynamic model and motion energy international conference on computer vision. pp. 360- 367 ,(1995) , 10.1109/ICCV.1995.466916
Michael J. Black, P. Anandan, The Robust Estimation of Multiple Motions Computer Vision and Image Understanding. ,vol. 63, pp. 75- 104 ,(1996) , 10.1006/CVIU.1996.0006
Vasant Manohar, Dmitry Goldgof, Sudeep Sarkar, Yong Zhang, Facial Strain Pattern as a Soft Forensic Evidence workshop on applications of computer vision. pp. 42- 42 ,(2007) , 10.1109/WACV.2007.23
Lijun Yin, Xiaozhou Wei, Yi Sun, Jun Wang, M.J. Rosato, A 3D facial expression database for facial behavior research international conference on automatic face and gesture recognition. pp. 211- 216 ,(2006) , 10.1109/FGR.2006.6
Paul Ekman, Facial expressions of emotion: an old controversy and new findings. Philosophical Transactions of the Royal Society B. ,vol. 335, pp. 63- 69 ,(1992) , 10.1098/RSTB.1992.0008
F. Kallel, M. Bertrand, Tissue elasticity reconstruction using linear perturbation method IEEE Transactions on Medical Imaging. ,vol. 15, pp. 299- 313 ,(1996) , 10.1109/42.500139