Dense Depth Map Reconstruction from Sparse Measurements Using a Multilayer Conditional Random Field Model

作者: Francis Li , Edward Li , Mohammad Javad Shafiee , Alexander Wong , John Zelek

DOI: 10.1109/CRV.2015.20

关键词:

摘要: Acquiring accurate dense depth maps is crucial for 3D reconstruction. Current high quality sensors capable of generating are expensive and bulky, while compact low-cost can only reliably generate sparse measurements. We propose a novel multilayer conditional random field (MCRF) approach to reconstruct map target scene given the measurements corresponding photographic obtained from stereo photogrammetric systems. Estimating formulated as maximum posterior (MAP) inference problem where smoothness prior assumed. Our MCRF model uses measurement an additional observation layer describes relations between nodes with multivariate feature functions based on The method first qualitatively analyzed when performed data collected camera, then quantitative performance measured using Middlebury vision ground truth. Experimental results show our performs well reconstructing simple scenes has lower mean squared error compared other reconstruction methods.

参考文章(28)
S. Thomas Alexander, The Method of Steepest Descent Adaptive Signal Processing. pp. 46- 67 ,(1986) , 10.1007/978-1-4612-4978-8_4
Christoph Rhemann, Asmaa Hosni, Michael Bleyer, Carsten Rother, Margrit Gelautz, Fast cost-volume filtering for visual correspondence and beyond computer vision and pattern recognition. pp. 3017- 3024 ,(2011) , 10.1109/CVPR.2011.5995372
Xing Mei, Xun Sun, Weiming Dong, Haitao Wang, Xiaopeng Zhang, Segment-Tree Based Cost Aggregation for Stereo Matching computer vision and pattern recognition. pp. 313- 320 ,(2013) , 10.1109/CVPR.2013.47
Sang-Beom Lee, Yo-Sung Ho, Discontinuity-adaptive depth map filtering for 3D view generation IMMERSCOM '09 Proceedings of the 2nd International Conference on Immersive Telecommunications. pp. 8- ,(2009) , 10.4108/ICST.IMMERSCOM2009.6284
Kang Zhang, Yuqiang Fang, Dongbo Min, Lifeng Sun, Shiqiang Yang, Shuicheng Yan, Qi Tian, Cross-Scale Cost Aggregation for Stereo Matching computer vision and pattern recognition. pp. 1590- 1597 ,(2014) , 10.1109/CVPR.2014.206
Qingxiong Yang, A non-local cost aggregation method for stereo matching computer vision and pattern recognition. pp. 1402- 1409 ,(2012) , 10.1109/CVPR.2012.6247827
Krishna Rao Vijayanagar, Maziar Loghman, Joohee Kim, Refinement of depth maps generated by low-cost depth sensors international soc design conference. pp. 355- 358 ,(2012) , 10.1109/ISOCC.2012.6407114
Marcus Mueller, Frederik Zilly, Peter Kauff, Adaptive cross-trilateral depth map filtering 3dtv-conference: the true vision - capture, transmission and display of 3d video. pp. 1- 4 ,(2010) , 10.1109/3DTV.2010.5506336
C. Tomasi, R. Manduchi, Bilateral filtering for gray and color images international conference on computer vision. pp. 839- 846 ,(1998) , 10.1109/ICCV.1998.710815
V. Kolmogorov, R. Zabih, What energy functions can be minimized via graph cuts IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 26, pp. 147- 159 ,(2004) , 10.1109/TPAMI.2004.1262177