Prediction of the Influence of Navigation Scan-path on Perceived Quality of Free-Viewpoint Videos

作者: Patrick Le Callet , Jesús Gutiérrez , Suiyi Ling , Gu Ke

DOI:

关键词:

摘要: Free-Viewpoint Video (FVV) systems allow the viewers to freely change viewpoints of scene. In such systems, view synthesis and compression are two main sources artifacts influencing perceived quality. To assess this influence, quality evaluation studies often carried out using conventional displays generating predefined navigation trajectories mimicking possible movement when exploring content. Nevertheless, as different may lead conclusions in terms visual benchmarking performance methods identify critical needed. This paper aims at impact exploration (defined Hypothetical Rendering Trajectories: HRT) on FVV subjectively objectively, providing contributions. Firstly, a subjective assessment test including HRTs was analyzed. The results demonstrate quantify influence HRT Secondly, we propose new objective video measure objectively predict HRT. measure, based Sketch-Token representation, models how categories contours spatially temporally from higher semantic level. Performance comparison with existing metrics for FVV, highlight promising automatic detection most benchmark immersive systems.

参考文章(33)
Pablo Carballeira, Jesus Gutierrez, Francisco Moran, Julian Cabrera, Narciso Garcia, Subjective evaluation of super multiview video in consumer 3D displays quality of multimedia experience. pp. 1- 6 ,(2015) , 10.1109/QOMEX.2015.7148099
Z. Wang, E.P. Simoncelli, A.C. Bovik, Multiscale structural similarity for image quality assessment asilomar conference on signals, systems and computers. ,vol. 2, pp. 1398- 1402 ,(2003) , 10.1109/ACSSC.2003.1292216
Xiangkai Liu, Yun Zhang, Sudeng Hu, Sam Kwong, C.-C. Jay Kuo, Qiang Peng, Subjective and Objective Video Quality Assessment of 3D Synthesized Views With Texture/Depth Compression Distortion IEEE Transactions on Image Processing. ,vol. 24, pp. 4847- 4861 ,(2015) , 10.1109/TIP.2015.2469140
P. Merkle, Y. Morvan, A. Smolic, D. Farin, K. Müller, P.H.N. de With, T. Wiegand, The effects of multiview depth video compression on multiview rendering Signal Processing-image Communication. ,vol. 24, pp. 73- 88 ,(2009) , 10.1016/J.IMAGE.2008.10.010
Anmin Liu, Weisi Lin, M. Narwaria, Image Quality Assessment Based on Gradient Similarity IEEE Transactions on Image Processing. ,vol. 21, pp. 1500- 1512 ,(2012) , 10.1109/TIP.2011.2175935
K Müller, P Merkle, T Wiegand, 3-D Video Representation Using Depth Maps Proceedings of the IEEE. ,vol. 99, pp. 643- 656 ,(2011) , 10.1109/JPROC.2010.2091090
Chang-Ting Tsai, Hsueh-Ming Hang, Quality assessment of 3D synthesized views with depth map distortion visual communications and image processing. pp. 1- 6 ,(2013) , 10.1109/VCIP.2013.6706348
Kwan-Jung Oh, Sehoon Yea, Anthony Vetro, Yo-Sung Ho, Virtual view synthesis method and self‐evaluation metrics for free viewpoint television and 3D video International Journal of Imaging Systems and Technology. ,vol. 20, pp. 378- 390 ,(2010) , 10.1002/IMA.20253
Yun Zhang, Sam Kwong, Sudeng Hu, Chung-Chieh Jay Kuo, Efficient Multiview Depth Coding Optimization Based on Allowable Depth Distortion in View Synthesis IEEE Transactions on Image Processing. ,vol. 23, pp. 4879- 4892 ,(2014) , 10.1109/TIP.2014.2355715
J. Kilner, J. Starck, J.Y. Guillemaut, A. Hilton, Objective quality assessment in free-viewpoint video production Signal Processing-image Communication. ,vol. 24, pp. 3- 16 ,(2009) , 10.1016/J.IMAGE.2008.10.004