Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring

作者: Seungjun Nah , Tae Hyun Kim , Kyoung Mu Lee

DOI: 10.1109/CVPR.2017.35

关键词:

摘要: Non-uniform blind deblurring for general dynamic scenes is a challenging computer vision problem as blurs arise not only from multiple object motions but also camera shake, scene depth variation. To remove these complicated motion blurs, conventional energy optimization based methods rely on simple assumptions such that blur kernel partially uniform or locally linear. Moreover, recent machine learning depend synthetic datasets generated under assumptions. This makes fail to where difficult approximate parameterize (e.g. boundaries). In this work, we propose multi-scale convolutional neural network restores sharp images in an end-to-end manner caused by various sources. Together, present loss function mimics coarse-to-fine approaches. Furthermore, new large-scale dataset provides pairs of realistic blurry image and the corresponding ground truth are obtained high-speed camera. With proposed model trained dataset, demonstrate empirically our method achieves state-of-the-art performance qualitatively, quantitatively.

参考文章(30)
Arthur Szlam, Emily Denton, Rob Fergus, Soumith Chintala, Deep generative image models using a Laplacian pyramid of adversarial networks neural information processing systems. ,vol. 28, pp. 1486- 1494 ,(2015)
Alexey Dosovitskiy, Philipp Fischer, Eddy Ilg, Philip Hausser, Caner Hazirbas, Vladimir Golkov, Patrick Van Der Smagt, Daniel Cremers, Thomas Brox, None, FlowNet: Learning Optical Flow with Convolutional Networks 2015 IEEE International Conference on Computer Vision (ICCV). pp. 2758- 2766 ,(2015) , 10.1109/ICCV.2015.316
Christian J. Schuler, Michael Hirsch, Stefan Harmeling, Bernhard Scholkopf, Learning to Deblur IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 38, pp. 1439- 1451 ,(2016) , 10.1109/TPAMI.2015.2481418
Diederik P. Kingma, Jimmy Ba, Adam: A Method for Stochastic Optimization arXiv: Learning. ,(2014)
Ankit Gupta, Neel Joshi, C. Lawrence Zitnick, Michael Cohen, Brian Curless, Single image deblurring using motion density functions european conference on computer vision. pp. 171- 184 ,(2010) , 10.1007/978-3-642-15549-9_13
Rolf Köhler, Michael Hirsch, Betty Mohler, Bernhard Schölkopf, Stefan Harmeling, Recording and Playback of Camera Shake: Benchmarking Blind Deconvolution with a Real-World Database Computer Vision – ECCV 2012. pp. 27- 40 ,(2012) , 10.1007/978-3-642-33786-4_3
Jonathan Long, Evan Shelhamer, Trevor Darrell, Fully convolutional networks for semantic segmentation computer vision and pattern recognition. pp. 3431- 3440 ,(2015) , 10.1109/CVPR.2015.7298965
David Eigen, Rob Fergus, Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-scale Convolutional Architecture 2015 IEEE International Conference on Computer Vision (ICCV). pp. 2650- 2658 ,(2015) , 10.1109/ICCV.2015.304
Jian Sun, Wenfei Cao, Zongben Xu, Jean Ponce, Learning a convolutional neural network for non-uniform motion blur removal computer vision and pattern recognition. pp. 769- 777 ,(2015) , 10.1109/CVPR.2015.7298677
Tae Hyun Kim, Kyoung Mu Lee, Generalized video deblurring for dynamic scenes computer vision and pattern recognition. pp. 5426- 5434 ,(2015) , 10.1109/CVPR.2015.7299181