Realistic inverse lighting from a single 2D image of a face, taken under unknown and complex lighting

作者: Davoud Shahlaei , Volker Blanz

DOI: 10.1109/FG.2015.7163128

关键词:

摘要: In this paper, we address a difficult inverse rendering problem with many unknowns: single 2D input image of an unknown face in environment, taken under conditions. First, the geometry and texture are estimated from image, using 3D Morphable Model. second step, considering superposition principle for light, estimate light source intensities as optimized non-negative weights linear combination synthetic illumination cone that face. Each is lighted by one directional non-lambertian reflectance non-convex geometry. Modeling lighting separately model enhances modeling analysis, provides information about environment face, facilitates realistic novel pose lighting.

参考文章(28)
Rosana Montes Soldado, Carlos Ureña Almagro, An Overview of BRDF Models ,(2012)
Peter N. Belhumeur, David J. Kriegman, What Is the Set of Images of an Object Under All Possible Illumination Conditions International Journal of Computer Vision. ,vol. 28, pp. 245- 260 ,(1998) , 10.1023/A:1008005721484
Oswald Aldrian, William A.P. Smith, Inverse Rendering of Faces with a 3D Morphable Model IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 35, pp. 1080- 1093 ,(2013) , 10.1109/TPAMI.2012.206
Sami Romdhani, Jeffrey Ho, Thomas Vetter, David J Kriegman, None, Face Recognition Using 3-D Models: Pose and Illumination Proceedings of the IEEE. ,vol. 94, pp. 1977- 1999 ,(2006) , 10.1109/JPROC.2006.886019
Xi Zhao, Shishir K. Shah, Ioannis A. Kakadiaris, Illumination alignment using lighting ratio: Application to 3D-2D face recognition ieee international conference on automatic face gesture recognition. pp. 1- 6 ,(2013) , 10.1109/FG.2013.6553782
Shree K. Nayar, Ko Nishino, Takanori Igarashi, The Appearance of Human Skin: A Survey ,(2007)
Scott Shaobing Chen, David L. Donoho, Michael A. Saunders, Atomic Decomposition by Basis Pursuit SIAM Review. ,vol. 43, pp. 129- 159 ,(2001) , 10.1137/S003614450037906X
Paul Graham, Borom Tunwattanapong, Jay Busch, Xueming Yu, Andrew Jones, Paul Debevec, Abhijeet Ghosh, Measurement-based Synthesis of Facial Microgeometry eurographics. ,vol. 32, pp. 335- 344 ,(2013) , 10.1111/CGF.12053
Paul Debevec, A median cut algorithm for light probe sampling ACM SIGGRAPH 2006 Courses on - SIGGRAPH '06. pp. 33- ,(2006) , 10.1145/1185657.1185688
L. B. Lucy, An iterative technique for the rectification of observed distributions The Astronomical Journal. ,vol. 79, pp. 745- 754 ,(1974) , 10.1086/111605