Laplacian pyramid adversarial network for face completion

作者: Qiang Wang , Huijie Fan , Gan Sun , Yang Cong , Yandong Tang

DOI: 10.1016/J.PATCOG.2018.11.020

关键词:

摘要: Abstract Recently, generative adversarial networks (GANs) have demonstrated high-quality reconstruction in face completion. There is still much room for improvement over the conventional GAN models that do not explicitly address texture details problem. In this paper, we propose a Laplacian-pyramid-based framework This can produce more realistic results (1) by deriving precise content information of missing regions coarse-to-fine fashion and (2) propagating high-frequency from surrounding area via modified residual learning model. Specifically, regions, design convolutional network predict under different resolutions; takes advantage multiscale features shared low levels extracted middle layers next finer level. For details, construct new to eliminate color discrepancies between progressively. Furthermore, multiloss function proposed supervise process. To optimize model, train entire model with deep supervision using joint loss, which ensures generated image as original. Extensive experiments on benchmark datasets show exhibits superior performance state-of-the-art methods terms predictive accuracy, both quantitatively qualitatively.

参考文章(50)
James Hays, Alexei A. Efros, Scene completion using millions of photographs ACM SIGGRAPH 2007 papers on - SIGGRAPH '07. ,vol. 26, pp. 4- ,(2007) , 10.1145/1275808.1276382
Soumith Chintala, Alec Radford, Luke Metz, Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks arXiv: Learning. ,(2015)
Orazio Gallo, Iuri Frosio, Jan Kautz, Hang Zhao, Is L2 a Good Loss Function for Neural Networks for Image Processing arXiv: Computer Vision and Pattern Recognition. ,(2015)
Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun, Deep Residual Learning for Image Recognition computer vision and pattern recognition. pp. 770- 778 ,(2016) , 10.1109/CVPR.2016.90
Xiaolong Wang, Abhinav Gupta, Generative Image Modeling Using Style and Structure Adversarial Networks Computer Vision – ECCV 2016. pp. 318- 335 ,(2016) , 10.1007/978-3-319-46493-0_20
Chao Yang, Xin Lu, Zhe Lin, Eli Shechtman, Oliver Wang, Hao Li, High-Resolution Image Inpainting Using Multi-scale Neural Patch Synthesis computer vision and pattern recognition. pp. 4076- 4084 ,(2017) , 10.1109/CVPR.2017.434
Wei-Sheng Lai, Jia-Bin Huang, Narendra Ahuja, Ming-Hsuan Yang, Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolution 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). pp. 5835- 5843 ,(2017) , 10.1109/CVPR.2017.618
Yijun Li, Sifei Liu, Jimei Yang, Ming-Hsuan Yang, Generative Face Completion 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). pp. 5892- 5900 ,(2017) , 10.1109/CVPR.2017.624
Dacheng Tao, Chang Xu, Chaoyue Wang, Chaohui Wang, Perceptual Adversarial Networks for Image-to-Image Transformation IEEE Transactions on Image Processing. ,vol. 27, pp. 4066- 4079 ,(2018) , 10.1109/TIP.2018.2836316
Grigory Antipov, Moez Baccouche, Sid-Ahmed Berrani, Jean-Luc Dugelay, Effective training of convolutional neural networks for face-based gender and age prediction Pattern Recognition. ,vol. 72, pp. 15- 26 ,(2017) , 10.1016/J.PATCOG.2017.06.031