Real-time depth image-based rendering with layered dis-occlusion compensation and aliasing-free composition

作者: Sergey Smirnov , Atanas Gotchev

DOI: 10.1117/12.2086895

关键词:

摘要: Depth Image-based Rendering (DIBR) is a popular view synthesis technique which utilizes the RGB+D image format, also referred to as view-plus-depth scene representation. Classical DIBR prone dis-occlusion artefacts, caused by lack of information in areas behind foreground objects, appear visible synthesized images. A number recently proposed compensation techniques have addressed problem hole filling. However, their computational complexity does not allow for real-time and may require additional user input. In this work, we propose hole-compensation technique, works fully automatically perceptually-correct manner. The applies two-layer model given imagery, specifically tailored rendering with free viewpoint selection. main two components are an adaptive layering depth into relative 'foreground' 'background' layers be rendered separately blending filtering aimed at creating function aliasing cancellation during process composition. implementation turns ordinary images true 3D representations, visualization y-around

参考文章(12)
David Wolinski, Olivier Le Meur, Josselin Gautier, 3D view synthesis with inter-view consistency Proceedings of the 21st ACM international conference on Multimedia - MM '13. pp. 669- 672 ,(2013) , 10.1145/2502081.2502175
K Müller, P Merkle, T Wiegand, 3-D Video Representation Using Depth Maps Proceedings of the IEEE. ,vol. 99, pp. 643- 656 ,(2011) , 10.1109/JPROC.2010.2091090
Mashhour Solh, Ghassan AlRegib, Hierarchical Hole-Filling For Depth-Based View Synthesis in FTV and 3D Video IEEE Journal of Selected Topics in Signal Processing. ,vol. 6, pp. 495- 504 ,(2012) , 10.1109/JSTSP.2012.2204723
Derek Bradley, Gerhard Roth, Adaptive Thresholding using the Integral Image Journal of Graphics Tools. ,vol. 12, pp. 13- 21 ,(2007) , 10.1080/2151237X.2007.10129236
Mashhour Solh, Ghassan AlRegib, Hierarchical Hole-Filling(HHF): Depth image based rendering without depth map filtering for 3D-TV multimedia signal processing. pp. 87- 92 ,(2010) , 10.1109/MMSP.2010.5661999
Lech Świrski, Christian Richardt, Neil A. Dodgson, Layered photo pop-up international conference on computer graphics and interactive techniques. pp. 36- ,(2011) , 10.1145/2037715.2037757
Hyun-Woong Cho, Soon-Wook Chung, Moon-Kyu Song, Woo-Jin Song, Depth-image-based 3D rendering with edge dependent preprocessing international midwest symposium on circuits and systems. pp. 1- 4 ,(2011) , 10.1109/MWSCAS.2011.6026369
Daniel Scharstein, Richard Szeliski, A taxonomy and evaluation of dense two-frame stereo correspondence algorithms International Journal of Computer Vision. ,vol. 47, pp. 7- 42 ,(2001) , 10.1023/A:1014573219977
L. Zhang, W.J. Tam, Stereoscopic image generation based on depth images for 3D TV IEEE Transactions on Broadcasting. ,vol. 51, pp. 191- 199 ,(2005) , 10.1109/TBC.2005.846190