Probability-Based Rendering for View Synthesis

作者: Bumsub Ham , Dongbo Min , Changjae Oh , Minh N. Do , Kwanghoon Sohn

DOI: 10.1109/TIP.2013.2295716

关键词: PixelComputer scienceRendering (computer graphics)Image fusionFlickerDepth mapView synthesisAlgorithm

摘要: In this paper, a probability-based rendering (PBR) method is described for reconstructing an intermediate view with steady-state matching probability (SSMP) density function. Conventionally, given multiple reference images, the synthesized via depth image-based technique in which geometric information (e.g., depth) explicitly leveraged, thus leading to serious artifacts on even small errors. We address problem by formulating process as image fusion textures of all probable points are adaptively blended SSMP representing likelihood that among input images matched. The PBR hence becomes more robust against estimation errors than existing synthesis approaches. MP steady-state, SSMP, inferred each pixel random walk restart (RWR). RWR always guarantees visually consistent MP, opposed conventional optimization schemes diffusion or filtering-based approaches), accuracy heavily depends parameters used. Experimental results demonstrate superiority over approaches both qualitatively and quantitatively. Especially, effective suppressing flicker virtual video although no temporal aspect considered. Moreover, it shown map itself calculated from our RWR-based (by simply choosing most point) also comparable state-of-the-art local stereo methods.

参考文章(35)
Dhruv Mahajan, Fu-Chung Huang, Wojciech Matusik, Ravi Ramamoorthi, Peter Belhumeur, Moving gradients: a path-based method for plausible image interpolation international conference on computer graphics and interactive techniques. ,vol. 28, pp. 42- ,(2009) , 10.1145/1531326.1531348
Christoph Rhemann, Asmaa Hosni, Michael Bleyer, Carsten Rother, Margrit Gelautz, Fast cost-volume filtering for visual correspondence and beyond computer vision and pattern recognition. pp. 3017- 3024 ,(2011) , 10.1109/CVPR.2011.5995372
Peyman Milanfar, A Tour of Modern Image Filtering: New Insights and Methods, Both Practical and Theoretical IEEE Signal Processing Magazine. ,vol. 30, pp. 106- 128 ,(2013) , 10.1109/MSP.2011.2179329
L. De-Maeztu, A. Villanueva, R. Cabeza, Near Real-Time Stereo Matching Using Geodesic Diffusion IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 34, pp. 410- 416 ,(2012) , 10.1109/TPAMI.2011.192
Lu Yang, Tomohiro Yendo, Mehrdad Panahpour Tehrani, Toshiaki Fujii, Masayuki Tanimoto, Artifact reduction using reliability reasoning for image generation of FTV Journal of Visual Communication and Image Representation. ,vol. 21, pp. 542- 560 ,(2010) , 10.1016/J.JVCIR.2009.09.009
Bumsub Ham, Dongbo Min, Kwanghoon Sohn, A Generalized Random Walk With Restart and its Application in Depth Up-Sampling and Interactive Segmentation IEEE Transactions on Image Processing. ,vol. 22, pp. 2574- 2588 ,(2013) , 10.1109/TIP.2013.2253479
K. Takahashi, Theoretical Analysis of View Interpolation With Inaccurate Depth Information IEEE Transactions on Image Processing. ,vol. 21, pp. 718- 732 ,(2012) , 10.1109/TIP.2011.2172802
Ying Song, Xin Tong, Fabio Pellacini, Pieter Peers, SubEdit: a representation for editing measured heterogeneous subsurface scattering international conference on computer graphics and interactive techniques. ,vol. 28, pp. 31- ,(2009) , 10.1145/1531326.1531337
Jia-Yu Pan, Hyung-Jeong Yang, Christos Faloutsos, Pinar Duygulu, Automatic multimedia cross-modal correlation discovery knowledge discovery and data mining. pp. 653- 658 ,(2004) , 10.1145/1014052.1014135
Keiji Tanaka, Yutaka Kunita, Masahiro Ueno, Layered probability maps Proceedings of the ACM symposium on Virtual reality software and technology - VRST '06. pp. 181- 188 ,(2006) , 10.1145/1180495.1180532