Face Alignment Assisted by Head Pose Estimation

作者: Ioannis Patras , Hatice Gunes , Wenxuan Mou , Yichi Zhang , Heng Yang

DOI:

关键词:

摘要: In this paper we propose a supervised initialization scheme for cascaded face alignment based on explicit head pose estimation. We first investigate the failure cases of most state art approaches and observe that these failures often share one common global property, i.e. variation is usually large. Inspired by this, deep convolutional network model reliable accurate Instead using mean shape, or randomly selected shapes initialisation, two schemes generating initialisation: relies projecting 3D shape (represented facial landmarks) onto 2D image under estimated pose; second searches nearest neighbour from training set according to distance. By doing so, initialisation gets closer actual which enhances possibility convergence in turn improves performance. demonstrate proposed method benchmark 300W dataset show very competitive performance both estimation alignment.

参考文章(27)
Ilya Sutskever, Geoffrey Hinton, James Martens, George Dahl, On the importance of initialization and momentum in deep learning international conference on machine learning. pp. 1139- 1147 ,(2013)
Gabriele Fanelli, Juergen Gall, Luc Van Gool, Real time head pose estimation with random regression forests computer vision and pattern recognition. pp. 617- 624 ,(2011) , 10.1109/CVPR.2011.5995458
D. Cristinacce, T. F. Cootes, Feature Detection and Tracking with Constrained Local Models british machine vision conference. ,vol. 3, pp. 929- 938 ,(2006) , 10.5244/C.20.95
Shaoqing Ren, Xudong Cao, Yichen Wei, Jian Sun, Face Alignment at 3000 FPS via Regressing Local Binary Features computer vision and pattern recognition. pp. 1685- 1692 ,(2014) , 10.1109/CVPR.2014.218
Heng Yang, Changqing Zou, Ioannis Patras, Face Sketch Landmarks Localization in the Wild IEEE Signal Processing Letters. ,vol. 21, pp. 1321- 1325 ,(2014) , 10.1109/LSP.2014.2333544
Feng Zhou, Jonathan Brandt, Zhe Lin, Exemplar-Based Graph Matching for Robust Facial Landmark Localization international conference on computer vision. pp. 1025- 1032 ,(2013) , 10.1109/ICCV.2013.131
Xiaohui Shen, Zhe Lin, Jonathan Brandt, Ying Wu, Detecting and Aligning Faces by Image Retrieval computer vision and pattern recognition. pp. 3460- 3467 ,(2013) , 10.1109/CVPR.2013.444
M. A. Haj, J. Gonzalez, L. S. Davis, On partial least squares in head pose estimation: How to simultaneously deal with misalignment computer vision and pattern recognition. pp. 2602- 2609 ,(2012) , 10.1109/CVPR.2012.6247979
Brandon M. Smith, Jonathan Brandt, Zhe Lin, Li Zhang, Nonparametric Context Modeling of Local Appearance for Pose- and Expression-Robust Facial Landmark Localization computer vision and pattern recognition. pp. 1741- 1748 ,(2014) , 10.1109/CVPR.2014.225
Peter N. Belhumeur, David W. Jacobs, David J. Kriegman, Neeraj Kumar, Localizing parts of faces using a consensus of exemplars CVPR 2011. pp. 545- 552 ,(2011) , 10.1109/CVPR.2011.5995602