Learning to Extract a Video Sequence from a Single Motion-Blurred Image

作者: Paolo Favaro , Meiguang Jin , Givi Meishvili

DOI:

关键词:

摘要: We present a method to extract video sequence from single motion-blurred image. Motion-blurred images are the result of an averaging process, where instant frames accumulated over time during exposure sensor. Unfortunately, reversing this process is nontrivial. Firstly, destroys temporal ordering frames. Secondly, recovery frame blind deconvolution task, which highly ill-posed. deep learning scheme that gradually reconstructs by sequentially extracting pairs Our main contribution introduce loss functions invariant order. This lets neural network choose training what output among possible combinations. also address ill-posedness deblurring designing with large receptive field and implemented via resampling achieve higher computational efficiency. proposed can successfully retrieve sharp image sequences motion blurred generalize well on synthetic real datasets captured different cameras.

参考文章(35)
Tomer Michaeli, Michal Irani, Blind Deblurring Using Internal Patch Recurrence european conference on computer vision. pp. 783- 798 ,(2014) , 10.1007/978-3-319-10578-9_51
Haichao Zhang, Jianchao Yang, Intra-frame deblurring by leveraging inter-frame camera motion computer vision and pattern recognition. pp. 4036- 4044 ,(2015) , 10.1109/CVPR.2015.7299030
Tae Hyun Kim, Kyoung Mu Lee, Segmentation-Free Dynamic Scene Deblurring computer vision and pattern recognition. pp. 2766- 2773 ,(2014) , 10.1109/CVPR.2014.348
Sunghyun Cho, Jue Wang, Seungyong Lee, Video deblurring for hand-held cameras using patch-based synthesis international conference on computer graphics and interactive techniques. ,vol. 31, pp. 64- ,(2012) , 10.1145/2185520.2185560
Rob Fergus, Barun Singh, Aaron Hertzmann, Sam T. Roweis, William T. Freeman, Removing camera shake from a single photograph international conference on computer graphics and interactive techniques. ,vol. 25, pp. 787- 794 ,(2006) , 10.1145/1141911.1141956
, Generative Adversarial Nets neural information processing systems. ,vol. 27, pp. 2672- 2680 ,(2014) , 10.3156/JSOFT.29.5_177_2
Tae Hyun Kim, Byeongjoo Ahn, Kyoung Mu Lee, Dynamic Scene Deblurring international conference on computer vision. pp. 3160- 3167 ,(2013) , 10.1109/ICCV.2013.392
David Wipf, Haichao Zhang, Non-Uniform Camera Shake Removal Using a Spatially-Adaptive Sparse Penalty neural information processing systems. ,vol. 26, pp. 1556- 1564 ,(2013)
Michael Hirsch, Christian J. Schuler, Stefan Harmeling, Bernhard Scholkopf, Fast removal of non-uniform camera shake international conference on computer vision. pp. 463- 470 ,(2011) , 10.1109/ICCV.2011.6126276
Kyoung Mu Lee, Seungjun Nah, Tae Hyun Kim, Dynamic Scene Deblurring using a Locally Adaptive Linear Blur Model arXiv: Computer Vision and Pattern Recognition. ,(2016)