Landmark Detection and 3D Face Reconstruction for Caricature using a Nonlinear Parametric Model

作者: Juyong Zhang , Yudong Guo , Hongrui Cai , Zhuang Peng

DOI: 10.1016/J.GMOD.2021.101103

关键词: Orientation (computer vision)Parametric modelSource codeArtificial neural networkLandmarkFace (geometry)Pattern recognitionAlgorithm designAbstraction (linguistics)Artificial intelligenceComputer science

摘要: Abstract Caricature is an artistic abstraction of the human face by distorting or exaggerating certain facial features, while still retains a likeness with given face. Due to large diversity geometric and texture variations, automatic landmark detection 3D reconstruction for caricature challenging problem has rarely been studied before. In this paper, we propose first method task novel approach. To end, build dataset various styles 2D caricatures their corresponding shapes, then parametric model on vertex based deformation space Based constructed nonlinear model, neural network regress shape orientation from input image. Ablation studies comparison state-of-the-art methods demonstrate effectiveness our algorithm design. Extensive experimental results that works well caricatures. Our dataset, source code trained are available at https://github.com/Juyong/CaricatureFace .

参考文章(62)
Laszlo A. Jeni, Jeffrey F. Cohn, Takeo Kanade, Dense 3D face alignment from 2D videos in real-time ieee international conference on automatic face gesture recognition. ,vol. 1, pp. 1- 8 ,(2015) , 10.1109/FG.2015.7163142
Bahri Abaci, Tayfun Akgul, Matching caricatures to photographs Signal, Image and Video Processing. ,vol. 9, pp. 295- 303 ,(2015) , 10.1007/S11760-015-0819-8
Xiangyu Zhu, Zhen Lei, Junjie Yan, Dong Yi, Stan Z Li, None, High-fidelity Pose and Expression Normalization for face recognition in the wild computer vision and pattern recognition. pp. 787- 796 ,(2015) , 10.1109/CVPR.2015.7298679
A.J O'Toole, T Price, T Vetter, J.C Bartlett, V Blanz, 3D shape and 2D surface textures of human faces: the role of “averages” in attractiveness and age Image and Vision Computing. ,vol. 18, pp. 9- 19 ,(1999) , 10.1016/S0262-8856(99)00012-8
Roberto C. Cavalcante Vieira, Creto A. Vidal, Joaquim Bento Cavalcante-Neto, Three-Dimensional Face Caricaturing by Anthropometric Distortions brazilian symposium on computer graphics and image processing. pp. 163- 170 ,(2013) , 10.1109/SIBGRAPI.2013.31
Thomas Lewiner, Thales Vieira, Dimas Martínez, Adelailson Peixoto, Vinícius Mello, Luiz Velho, SMI 2011: Full Paper: Interactive 3D caricature from harmonic exaggeration Computers & Graphics. ,vol. 35, pp. 586- 595 ,(2011) , 10.1016/J.CAG.2011.03.005
Junfa Liu, Yiqiang Chen, Chunyan Miao, Jinjing Xie, Charles X. Ling, Xingyu Gao, Wen Gao, Semi‐Supervised Learning in Reconstructed Manifold Space for 3D Caricature Generation Computer Graphics Forum. ,vol. 28, pp. 2104- 2116 ,(2009) , 10.1111/J.1467-8659.2009.01418.X
Justus Thies, Michael Zollhöfer, Matthias Nießner, Levi Valgaerts, Marc Stamminger, Christian Theobalt, Real-time expression transfer for facial reenactment international conference on computer graphics and interactive techniques. ,vol. 34, pp. 183- ,(2015) , 10.1145/2816795.2818056
Brendan F. Klare, Serhat S. Bucak, Anil K. Jain, Tayfun Akgul, Towards automated caricature recognition international conference on biometrics. pp. 139- 146 ,(2012) , 10.1109/ICB.2012.6199771
Chen Cao, Yanlin Weng, Shun Zhou, Yiying Tong, Kun Zhou, FaceWarehouse: A 3D Facial Expression Database for Visual Computing IEEE Transactions on Visualization and Computer Graphics. ,vol. 20, pp. 413- 425 ,(2014) , 10.1109/TVCG.2013.249