3D Reconstruction of Dynamic Scenes with Multiple Handheld Cameras

作者: Hanqing Jiang , Haomin Liu , Ping Tan , Guofeng Zhang , Hujun Bao

DOI: 10.1007/978-3-642-33709-3_43

关键词:

摘要: Accurate dense 3D reconstruction of dynamic scenes from natural images is still very challenging. Most previous methods rely on a large number fixed cameras to obtain good results. Some these further require separation static and points, which are usually restricted with known background. We propose novel depth estimation method can automatically recover accurate consistent maps the synchronized video sequences taken by few handheld cameras. Unlike camera arrays, our data capturing setup much more flexible easier use. Our algorithm simultaneously solves bilayer segmentation in unified energy minimization framework, combines different spatio-temporal constraints for effective optimization points. A variety examples demonstrate effectiveness proposed framework.

参考文章(27)
Edward H. Adelson, William T. Freeman, Ce Liu, Beyond pixels: exploring new representations and applications for motion analysis Massachusetts Institute of Technology. ,(2009)
Guofeng Zhang, Zilong Dong, Jiaya Jia, Tien-Tsin Wong, Hujun Bao, Efficient non-consecutive feature tracking for structure-from-motion european conference on computer vision. pp. 422- 435 ,(2010) , 10.1007/978-3-642-15555-0_31
Wenzhuo Yang, Guofeng Zhang, Hujun Bao, Jiwon Kim, Ho Young Lee, Consistent depth maps recovery from a trinocular video sequence computer vision and pattern recognition. pp. 1466- 1473 ,(2012) , 10.1109/CVPR.2012.6247835
D. Comaniciu, P. Meer, Mean shift: a robust approach toward feature space analysis IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 24, pp. 603- 619 ,(2002) , 10.1109/34.1000236
Mingjin Yang, Xun Cao, Qionghai Dai, Multiview video depth estimation with spatial-temporal consistency. british machine vision conference. pp. 1- 11 ,(2010) , 10.5244/C.24.67
Nicolas Ray, Bruno Vallet, Laurent Alonso, Bruno Levy, Geometry-aware direction field processing ACM Transactions on Graphics. ,vol. 29, pp. 1- 11 ,(2009) , 10.1145/1640443.1640444
Jing Wang, Bobby Bodenheimer, Synthesis and evaluation of linear motion transitions ACM Transactions on Graphics. ,vol. 27, pp. 1- 15 ,(2008) , 10.1145/1330511.1330512
Jean-Yves Guillemaut, Joe Kilner, Adrian Hilton, Robust graph-cut scene segmentation and reconstruction for free-viewpoint video of complex dynamic scenes international conference on computer vision. pp. 809- 816 ,(2009) , 10.1109/ICCV.2009.5459299
E. Scott Larsen, Philippos Mordohai, Marc Pollefeys, Henry Fuchs, Temporally Consistent Reconstruction from Multiple Video Streams Using Enhanced Belief Propagation international conference on computer vision. pp. 1- 8 ,(2007) , 10.1109/ICCV.2007.4409013
E. Tola, V. Lepetit, P. Fua, DAISY: An Efficient Dense Descriptor Applied to Wide-Baseline Stereo IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 32, pp. 815- 830 ,(2010) , 10.1109/TPAMI.2009.77