Efficient and Robust Inverse Lighting of a Single Face Image Using Compressive Sensing

作者: Miguel Heredia Conde , Davoud Shahlaei , Volker Blanz , Otmar Loffeld

DOI: 10.1109/ICCVW.2015.38

关键词:

摘要: In this paper, we show that the recent theory of Compressive Sensing (CS) can successfully be applied to solve a model-based inverse lighting problem for single face images, even in harsh with multiple light sources, including cast shadows and specularities. It has been shown an illumination cone used perform realistic lighting. work, images are synthetically generated using directional lights reflectance faces. Thereby, model is achieved by fitting 3D Morphable Model input image. We apply CS find sparsest setup from few random measurements RGB images. The proposed method significantly reduces dimensionality through stochastic sampling greedy algorithm sparse support estimation, yielding low runtimes. search designed handle non-negativity sources joint-support selection. reaches quality estimation equal previous while dramatically reducing number active sources. Thorough experimental evaluation shows stable recovery achievable compression rates up 99%. exhibits outstanding robustness additive noise

参考文章(31)
Compressed sensing : theory and applications Published in <b>2012</b> in Cambridge New York by Cambridge University Press. ,(2012) , 10.1017/CBO9780511794308
Peter N. Belhumeur, David J. Kriegman, What Is the Set of Images of an Object Under All Possible Illumination Conditions International Journal of Computer Vision. ,vol. 28, pp. 245- 260 ,(1998) , 10.1023/A:1008005721484
Davoud Shahlaei, Volker Blanz, Realistic inverse lighting from a single 2D image of a face, taken under unknown and complex lighting ieee international conference on automatic face gesture recognition. ,vol. 1, pp. 1- 8 ,(2015) , 10.1109/FG.2015.7163128
Mike E. Davies, Yonina C. Eldar, Rank Awareness in Joint Sparse Recovery IEEE Transactions on Information Theory. ,vol. 58, pp. 1135- 1146 ,(2012) , 10.1109/TIT.2011.2173722
Liansheng Zhuang, Tsung-Han Chan, Allen Y. Yang, S. Shankar Sastry, Yi Ma, Sparse Illumination Learning and Transfer for Single-Sample Face Recognition with Image Corruption and Misalignment International Journal of Computer Vision. ,vol. 114, pp. 272- 287 ,(2015) , 10.1007/S11263-014-0749-X
Scott Shaobing Chen, David L. Donoho, Michael A. Saunders, Atomic Decomposition by Basis Pursuit SIAM Journal on Scientific Computing. ,vol. 20, pp. 33- 61 ,(1998) , 10.1137/S1064827596304010
Oswald Aldrian, William A.P. Smith, Inverse Rendering of Faces with a 3D Morphable Model IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 35, pp. 1080- 1093 ,(2013) , 10.1109/TPAMI.2012.206
B. K. Natarajan, Sparse Approximate Solutions to Linear Systems SIAM Journal on Computing. ,vol. 24, pp. 227- 234 ,(1995) , 10.1137/S0097539792240406
Paul Graham, Borom Tunwattanapong, Jay Busch, Xueming Yu, Andrew Jones, Paul Debevec, Abhijeet Ghosh, Measurement-based Synthesis of Facial Microgeometry eurographics. ,vol. 32, pp. 335- 344 ,(2013) , 10.1111/CGF.12053