Deep Tone Mapping Operator for High Dynamic Range Images

作者: Aakanksha Rana , Praveer Singh , Giuseppe Valenzise , Frederic Dufaux , Nikos Komodakis

DOI: 10.1109/TIP.2019.2936649

关键词:

摘要: A computationally fast tone mapping operator (TMO) that can quickly adapt to a wide spectrum of high dynamic range (HDR) content is quintessential for visualization on varied low (LDR) output devices such as movie screens or standard displays. Existing TMOs successfully tone-map only limited number HDR and require an extensive parameter tuning yield the best subjective-quality tone-mapped output. In this paper, we address problem by proposing fast, parameter-free scene-adaptable deep (DeepTMO) yields high-resolution high-subjective quality mapped Based conditional generative adversarial network (cGAN), DeepTMO not learns vast scenic-content (e.g., outdoor, indoor, human, structures, etc.) but also tackles related scene-specific challenges contrast brightness, while preserving fine-grained details. We explore 4 possible combinations Generator-Discriminator architectural designs specifically some prominent issues in deep-learning frameworks like blurring, tiling patterns saturation artifacts. By exploring different influences scales, loss-functions normalization layers under cGAN setting, conclude with adopting multi-scale model our task. To further leverage large-scale availability unlabeled data, train generating targets using objective metric, namely Tone Mapping Image Quality Index (TMQI). demonstrate results both quantitatively qualitatively, showcase generates high-resolution, high-quality images over large real-world scenes. Finally, evaluate perceived conducting pair-wise subjective study which confirms versatility method.

参考文章(68)
John J. McCann, Alessandro Rizzi, The Art and Science of HDR Imaging ,(2011)
Christophe Schlick, An Adaptive Sampling Technique for Multidimensional Integration by Ray-Tracing Springer, Berlin, Heidelberg. pp. 21- 29 ,(1994) , 10.1007/978-3-642-57963-9_3
Aakanksha Rana, Joaquin Zepeda, Patrick Perez, Feature Learning for the Image Retrieval Task Computer Vision - ACCV 2014 Workshops. pp. 152- 165 ,(2015) , 10.1007/978-3-319-16634-6_12
Francesco Banterle, Kurt Debattista, Alan Chalmers, Alessandro Artusi, Advanced High Dynamic Range Imaging: Theory and Practice ,(2011)
Diederik P. Kingma, Jimmy Ba, Adam: A Method for Stochastic Optimization arXiv: Learning. ,(2014)
Philippe Hanhart, Martin Řeřábek, Touradj Ebrahimi, Towards high dynamic range extensions of HEVC: subjective evaluation of potential coding technologies Applications of Digital Image Processing XXXVIII. ,vol. 9599, ,(2015) , 10.1117/12.2193832
Karen Simonyan, Andrew Zisserman, Very Deep Convolutional Networks for Large-Scale Image Recognition computer vision and pattern recognition. ,(2014)
A. Pardo, G. Sapiro, Visualization of high dynamic range images IEEE Transactions on Image Processing. ,vol. 12, pp. 639- 647 ,(2003) , 10.1109/TIP.2003.812373
Patrick Ledda, Alan Chalmers, Tom Troscianko, Helge Seetzen, Evaluation of tone mapping operators using a High Dynamic Range display international conference on computer graphics and interactive techniques. ,vol. 24, pp. 640- 648 ,(2005) , 10.1145/1073204.1073242
Hojatollah Yeganeh, Zhou Wang, Objective Quality Assessment of Tone-Mapped Images IEEE Transactions on Image Processing. ,vol. 22, pp. 657- 667 ,(2013) , 10.1109/TIP.2012.2221725