Landmark Detection and 3D Face Reconstruction for Caricature using a Nonlinear Parametric Model

作者: Juyong Zhang , Yudong Guo , Hongrui Cai , Zhuang Peng

DOI:

关键词: Algorithm designArtificial intelligenceAbstraction (linguistics)LandmarkFace (geometry)Computer visionParametric modelComputer scienceOrientation (computer vision)Artificial neural network

摘要: Caricature is an artistic abstraction of the human face by distorting or exaggerating certain facial features, while still retains a likeness with given face. Due to large diversity geometric and texture variations, automatic landmark detection 3D reconstruction for caricature challenging problem has rarely been studied before. In this paper, we propose first method task novel approach. To end, build dataset various styles 2D caricatures their corresponding shapes, then parametric model on vertex based deformation space Based constructed nonlinear model, neural network regress shape orientation from input image. Ablation studies comparison baseline methods demonstrate effectiveness our algorithm design, extensive experimental results that works well caricatures. Our dataset, source code trained are available at https URL.

参考文章(62)
Laszlo A. Jeni, Jeffrey F. Cohn, Takeo Kanade, Dense 3D face alignment from 2D videos in real-time ieee international conference on automatic face gesture recognition. ,vol. 1, pp. 1- 8 ,(2015) , 10.1109/FG.2015.7163142
Bahri Abaci, Tayfun Akgul, Matching caricatures to photographs Signal, Image and Video Processing. ,vol. 9, pp. 295- 303 ,(2015) , 10.1007/S11760-015-0819-8
Xiangyu Zhu, Zhen Lei, Junjie Yan, Dong Yi, Stan Z Li, None, High-fidelity Pose and Expression Normalization for face recognition in the wild computer vision and pattern recognition. pp. 787- 796 ,(2015) , 10.1109/CVPR.2015.7298679
A.J O'Toole, T Price, T Vetter, J.C Bartlett, V Blanz, 3D shape and 2D surface textures of human faces: the role of “averages” in attractiveness and age Image and Vision Computing. ,vol. 18, pp. 9- 19 ,(1999) , 10.1016/S0262-8856(99)00012-8
Roberto C. Cavalcante Vieira, Creto A. Vidal, Joaquim Bento Cavalcante-Neto, Three-Dimensional Face Caricaturing by Anthropometric Distortions brazilian symposium on computer graphics and image processing. pp. 163- 170 ,(2013) , 10.1109/SIBGRAPI.2013.31
Thomas Lewiner, Thales Vieira, Dimas Martínez, Adelailson Peixoto, Vinícius Mello, Luiz Velho, SMI 2011: Full Paper: Interactive 3D caricature from harmonic exaggeration Computers & Graphics. ,vol. 35, pp. 586- 595 ,(2011) , 10.1016/J.CAG.2011.03.005
Justus Thies, Michael Zollhöfer, Matthias Nießner, Levi Valgaerts, Marc Stamminger, Christian Theobalt, Real-time expression transfer for facial reenactment international conference on computer graphics and interactive techniques. ,vol. 34, pp. 183- ,(2015) , 10.1145/2816795.2818056
Brendan F. Klare, Serhat S. Bucak, Anil K. Jain, Tayfun Akgul, Towards automated caricature recognition international conference on biometrics. pp. 139- 146 ,(2012) , 10.1109/ICB.2012.6199771
Chen Cao, Yanlin Weng, Shun Zhou, Yiying Tong, Kun Zhou, FaceWarehouse: A 3D Facial Expression Database for Visual Computing IEEE Transactions on Visualization and Computer Graphics. ,vol. 20, pp. 413- 425 ,(2014) , 10.1109/TVCG.2013.249
Alice J O'Toole, Thomas Vetter, Harald Volz, Elizabeth M Salter, Three-dimensional caricatures of human heads : distinctiveness and the perception of facial age Perception. ,vol. 26, pp. 719- 732 ,(1997) , 10.1068/P260719