research-article

Evaluating the Color Fidelity of ITMOs and HDR Color Appearance Models

Authors:

Mekides Assefa Abebe,

Jonathan KervecAuthors Info & Claims

ACM Transactions on Applied Perception (TAP), Volume 12, Issue 4

Article No.: 14, Pages 1 - 16

https://doi.org/10.1145/2808232

Published: 08 September 2015 Publication History

Abstract

With the increasing availability of high-dynamic-range (HDR) displays comes the need to remaster existing content in a way that takes advantage of the extended range of luminance and contrast that such displays offer. At the same time, it is crucial that the creative intent of the director is preserved through such changes as much as possible. In this article, we compare several approaches for dynamic range extension to assess their ability to correctly reproduce the color appearance of standard dynamic range (SDR) images on HDR displays. A number of state-of-the-art inverse tone mapping operators (ITMOs) combined with a standard chromatic adaptation transform (CAT) as well as some HDR color appearance models have been evaluated through a psychophysical study, making use of an HDR display as well as HDR ground-truth data. We found that global ITMOs lead to the most reliable performance when combined with a standard CAT, while more complex methods were found to be more scene dependent, and often less preferred than the unprocessed SDR image. HDR color appearance models, albeit being the most complete solutions for accurate color reproduction, were found to not be well suited to the problem of dynamic range expansion, suggesting that further research may be necessary to provide accurate color management in the context of inverse tone mapping.

References

[1]

Ahmet Oğuz Akyüz, Roland Fleming, Bernhard E. Riecke, Erik Reinhard, and Heinrich H. Bülthoff. 2007. Do HDR displays support LDR content?: A psychophysical evaluation. ACM Transactions on Graphics 26, 3, Article 38 (July 2007).

Digital Library

[2]

Ahmet Oğuz Akyüz and Erik Reinhard. 2006. Color appearance in high-dynamic-range imaging. SPIE Journal of Electronic Imaging 15, 3 (2006), 033001--1--033001--12.

[3]

Ahmet Oguz Akyuz, Erik Reinhard, and Sumanta Pattanaik. 2004. Color appearance models and dynamic range reduction. In 1st ACM Symposium on Applied Perception in Graphics and Visualization (APGV'04). 166.

Digital Library

[4]

Francesco Banterle, Alessandro Artusi, Kurt Debattista, and Alan Chalmers. 2011. Advanced High Dynamic Range Imaging: Theory and Practice. AK Peters (CRC Press), Natick, MA.

Digital Library

[5]

Francesco Banterle, Patrick Ledda, Kurt Debattista, Alessandro Artusi, Marina Bloj, and Alan Chalmers. 2009. A psychophysical evaluation of inverse tone mapping techniques. Computer Graphics Forum 28, 1 (2009), 13--25.

[6]

Francesco Banterle, Patrick Ledda, Kurt Debattista, and Alan Chalmers. 2006. Inverse tone mapping. In Proceedings of the 4^th International Conference on Computer Graphics and Interactive Techniques in Australasia and Southeast Asia (GRAPHITE'06). 349--356.

Digital Library

[7]

Francesco Banterle, Patrick Ledda, Kurt Debattista, Alan Chalmers, and Marina Bloj. 2007. A framework for inverse tone mapping. Visual Computer 23, 7 (2007), 467--478.

Digital Library

[8]

Martin Čadík, Michael Wimmer, Laszlo Neumann, and Alessandro Artusi. 2008. Evaluation of HDR tone mapping methods using essential perceptual attributes. Computers & Graphics 32, 3 (2008), 330--349.

Digital Library

[9]

CIETC:801. 2000. Specification of Colour Appearance for Reflective Media and Self-Luminous Display Comparisons. Retrieved from http://www.cie.co.at/index.php?i_ca_id=806.

[10]

Scott J. Daly and Xiaofan Feng. 2003. Bit-depth extension using spatiotemporal microdither based on models of the equivalent input noise of the visual system. In Electronic Imaging 2003. International Society for Optics and Photonics. 455--466.

[11]

Scott J. Daly and Xiaofan Feng. 2004. Decontouring: Prevention and removal of false contour artifacts. In Proceedings of SPIE, Vol. 5292. 130--149.

[12]

Piotr Didyk, Rafał Mantiuk, Matthias Hein, and Hans-Peter Seidel. 2008. Enhancement of bright video features for HDR displays. Computer Graphics Forum (Proceedings of Eurographics Symposium on Rendering 2008, Sarajevo, Bosnia, and Herzegovina) 27, 4 (2008), 1265--1274.

Digital Library

[13]

Frédéric Drago, William L. Martens, Karol Myszkowski, and Hans-Peter Seidel. 2002. Perceptual Evaluation of Tone Mapping Operators with Regard to Similarity and Preference. Technical Report MPI-I-2002-4-002. Max Plank Institut für Informatik.

[14]

Fritz Ebner and Mark D. Fairchild. 1998. Development and testing of a color space (IPT) with improved hue uniformity. In Proceedings of the 6th Color Imaging Conference: Color Science, Systems and Applications. 8--13.

[15]

M. D. Fairchild. 2007. The HDR photographic survey. In Proceedings of the 15th Color Imaging Conference: Color Science and Engineering Systems, Technologies, and Applications, Vol. 15. Society for Imaging Science and Technology, 233--238.

[16]

Mark D. Fairchild. 2013. Color Appearance Models. John Wiley & Sons.

[17]

Mark D. Fairchild and G. M. Johnson. 2002. Meet iCAM: An image color appearance model. In Proceedings of the 10th IS&T/SID Color Imaging Conference. 33--38.

[18]

M. D. Fairchild and G. M. Johnson. 2004. The iCAM framework for image appearance, image differences, and image quality. Journal of Electronic Imaging 13 (January 2004), 126--138.

[19]

Yulia Gryaditskaya, Tania Pouli, Erik Reinhard, and Hans-Peter Seidel. 2014. Sky based light metering for high dynamic range images. Computer Graphics Forum (Proceedings of Pacific Graphics) 33, 7 (2014), 61--69.

Digital Library

[20]

Yongqing Huo, Fan Yang, and Vincent Brost. 2014. Inverse tone mapping based upon retina response. Scientific World Journal 2014, 168564 (2014), 5.

[21]

IEC. 1999. IEC 61966-2-1:1999: Multimedia systems and equipment - Colour measurement and management - Part 2-1: Colour management - Default RGB colour space - sRGB. Retrieved from https://webstore.iec.ch/publication/6169.

[22]

ITU-R. 2012. Recommendation ITU-R BT.500-13: Methodology for the subjective assessment of the quality of television pictures. Retrieved from http://www.itu.int/rec/R-REC-BT.500-13-201201-I.

[23]

Mark D. Fairchild and Jiangtao Kuang. 2007. iCAM06, HDR, and Image Appearance. Retrieve from http://www.rit-mcsl.org/StudentResearch/CIC15_iCAM06.pdf.

[24]

Min H. Kim, Tim Weyrich, and Jan Kautz. 2009. Modeling human color perception under extended luminance levels. ACM Transactions on Graphics (Proceedings SIGGRAPH'09) 28, 3 (2009), 27:1--9.

Digital Library

[25]

Rafael Pacheco Kovaleski and Manuel M. Oliveira. 2009. High-quality brightness enhancement functions for real-time reverse tone mapping. Visual Computer 25, 5--7 (2009), 539--547.

Digital Library

[26]

Jiangtao Kuang, Garrett M. Johnson, and Mark D. Fairchild. 2007a. iCAM06: A refined image appearance model for HDR image rendering. Journal of Visual Communication and Image Representation 18, 5 (2007), 406--414. Special issue on High Dynamic Range Imaging.

Digital Library

[27]

Jiangtao Kuang, Hiroshi Yamaguchi, Changmeng Liu, Garrett M. Johnson, and Mark D. Fairchild. 2007b. Evaluating HDR rendering algorithms. ACM Transactions on Applied Perception 4, 2 (2007).

Digital Library

[28]

Hayden Landis. 2002. Production-ready global illumination. In Siggraph Course Notes 16.

[29]

Patrick Ledda, Alan Chalmers, and Helge Seetzen. 2004. A psychological validation of tonemapping operators using a high dynamic range display. In Proceedings of the 1st ACM Symposium on Applied Perception in Graphics and Visualization (APGV'04). 159.

Digital Library

[30]

Radosław Mantiuk, Rafał Mantiuk, Anna Tomaszewska, and Wolfgang Heidrich. 2009. Color correction for tone mapping. Computer Graphics Forum (Proceedings of EUROGRAPHICS'09) 28, 2 (2009), 193--202.

[31]

Belen Masia, Sandra Agustin, Roland W. Fleming, Olga Sorkine, and Diego Gutierrez. 2009. Evaluation of reverse tone mapping through varying exposure conditions. ACM Transactions on Graphics 28, 5 (2009), 1--8.

Digital Library

[32]

Belen Masia and Diego Gutierrez. 2011. Multilinear Regression for Gamma Expansion of Overexposed Content. Technical Report. Universidad de Zaragoza (Technical Report RR-03-11).

[33]

Laurence Meylan, Scott Daly, and Sabine Süsstrunk. 2007. Tone mapping for high dynamic range displays. In Proceedings of IS&T/SPIE Electronic Imaging: Human Vision and Electronic Imaging XII, Vol. 6492.

[34]

L. Meylan and S. Susstrunk. 2006. High dynamic range image rendering with a retinex-based adaptive filter. IEEE Transactions on Image Processing 15, 9 (2006), 2820--2830.

Digital Library

[35]

Chantal Neuhaus. 2010. Colorimetric Characterization of a High-Dynamic Range Display. Ph.D. Dissertation.

[36]

Tania Pouli, Alessandro Artusi, Francesco Banterle, Ahmet Oğuz Akyüz, Hans-Peter Seidel, and Erik Reinhard. 2013. Color correction for tone reproduction. In Proceedings of the Color and Imaging Conference, Vol. 2013. Society for Imaging Science and Technology, 215--220.

[37]

G. Ramanarayanan, J. A. Ferwerda, B. Walter, and K. Bala. 2007. Visual equivalence: Towards a new standard for image fidelity. ACM Transactions on Graphics 26, 3 (2007), 76.

Digital Library

[38]

Erik Reinhard, Erum Arif Khan, Ahmet Oğuz Akyüz, and Garrett M. Johnson. 2008. Color Imaging: Fundamentals and Applications. AK Peters, Wellesley.

Digital Library

[39]

E. Reinhard, T. Pouli, T. Kunkel, B. Long, A. Ballestad, and G. Damberg. 2012. Calibrated image appearance reproduction. ACM Transactions on Graphics 31, 6 (2012), 201.

Digital Library

[40]

Allan G. Rempel, Matthew Trentacoste, Helge Seetzen, H. David Young, Wolfgang Heidrich, Lorne Whitehead, and Greg Ward. 2007. Ldr2Hdr: On-the-fly reverse tone mapping of legacy video and photographs. ACM Transactions on Graphics 26, 3 (2007), 39.

Digital Library

[41]

Helge Seetzen, Wolfgang Heidrich, Wolfgang Stuerzlinger, Greg Ward, Lorne Whitehead, Matthew Trentacoste, Abhijeet Ghosh, and Andrejs Vorozcovs. 2004. High dynamic range display systems. ACM Transactions on Graphics 23, 3 (August 2004), 760--768.

Digital Library

[42]

Gaurav Sharma. 2002. Digital Color Imaging Handbook. CRC Press, Boca Raton, FL, 171 pages.

Digital Library

[43]

SMPTE. 2002. RP 177-1993: Derivation of Basic Television Color Equations. (2002).

[44]

Robert Wanat, Josselin Petit, and Rafal Mantiuk. 2012. Physical and perceptual limitations of a projector-based high dynamic range display. In TPCG. 9--16.

[45]

Lvdi Wang, Li-Yi Wei, Kun Zhou, Baining Guo, and Heung-Yeung Shum. 2007. High dynamic range image hallucination. In EGSR. Eurographics Association, 321--326.

Digital Library

[46]

Akiko Yoshida, Volker Blanz, Karol Myszkowski, and Hans Peter Seidel. 2005. Perceptual evaluation of tone mapping operators with real-world scenes. In Human Vision & Electronic Imaging X. SPIE, 192--203.

[47]

Xuemei Zhang, B. A. Wandell, D. A. Silverstein, and J. E. Farrell. 1997. Color image quality metric S-CIELAB and its application on halftone texture visibility. In IEEE COMPCON Symposium Digest. 44--48.

Digital Library

Cited By

Zhou FYuan SLiang ZDuan JQiu G(2024)A Dataset and Model for the Visual Quality Assessment of Inversely Tone-Mapped HDR VideosIEEE Transactions on Image Processing10.1109/TIP.2023.334309933(366-381)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TIP.2023.3343099
Shang ZEbenezer JVenkataramanan AWu YWei HSethuraman SBovik A(2024)A Study of Subjective and Objective Quality Assessment of HDR VideosIEEE Transactions on Image Processing10.1109/TIP.2023.333321733(42-57)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TIP.2023.3333217
Saha APentapati SShang ZPahwa RChen BGedik HMishra SBovik A(2023)Perceptual video quality assessment: the journey continues!Frontiers in Signal Processing10.3389/frsip.2023.11935233Online publication date: 27-Jun-2023
https://doi.org/10.3389/frsip.2023.1193523
Show More Cited By

Index Terms

Evaluating the Color Fidelity of ITMOs and HDR Color Appearance Models
1. Computing methodologies
  1. Modeling and simulation
    1. Model development and analysis
      1. Model verification and validation
2. Hardware
  1. Emerging technologies
    1. Analysis and design of emerging devices and systems
      1. Emerging tools and methodologies

Recommendations

Perceptual Lightness Modeling for High-Dynamic-Range Imaging

The human visual system (HVS) non-linearly processes light from the real world, allowing us to perceive detail over a wide range of illumination. Although models that describe this non-linearity are constructed based on psycho-visual experiments, they ...
Color science and color appearance models for CG, HDTV, and D-CINEMA
SIGGRAPH '04: ACM SIGGRAPH 2004 Course Notes

This course introduces the science behind image digitization, tone reproduction, and color reproduction in computer generated imagery (CGI), HDTV, and digital cinema (D-cinema). We detail how color is represented and processed as images are transferred ...
Skin color enhancement based on favorite skin color in HSV color space

Skin color enhancement based on favorite skin color is proposed to make skin color displayed on large screen flat panel TVs agree with human favorite skin color. A robust skin detection method in different intensity is obtained after analyzing the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Applied Perception

ACM Transactions on Applied Perception Volume 12, Issue 4

Special Issue SAP 2015

September 2015

77 pages

ISSN:1544-3558

EISSN:1544-3965

DOI:10.1145/2821016

Editors:
Victoria Interrante
University of Minnesota, USA
,
Diego Gutierrez
Universidad de Zaragoza, Spain

Issue’s Table of Contents

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 September 2015

Accepted: 01 July 2015

Revised: 01 July 2015

Received: 01 July 2015

Published in TAP Volume 12, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
329
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)2

Reflects downloads up to 27 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhou FYuan SLiang ZDuan JQiu G(2024)A Dataset and Model for the Visual Quality Assessment of Inversely Tone-Mapped HDR VideosIEEE Transactions on Image Processing10.1109/TIP.2023.334309933(366-381)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TIP.2023.3343099
Shang ZEbenezer JVenkataramanan AWu YWei HSethuraman SBovik A(2024)A Study of Subjective and Objective Quality Assessment of HDR VideosIEEE Transactions on Image Processing10.1109/TIP.2023.333321733(42-57)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TIP.2023.3333217
Saha APentapati SShang ZPahwa RChen BGedik HMishra SBovik A(2023)Perceptual video quality assessment: the journey continues!Frontiers in Signal Processing10.3389/frsip.2023.11935233Online publication date: 27-Jun-2023
https://doi.org/10.3389/frsip.2023.1193523
Kwon HLee S(2019)CAM-based HDR image reproduction using CA–TC decoupled JCh decompositionSignal Processing: Image Communication10.1016/j.image.2018.08.01070(1-13)Online publication date: Mar-2019
https://doi.org/10.1016/j.image.2018.08.010
Abebe MBooth AKervec JPouli TLarabi M(2018)Towards an automatic correction of over-exposure in photographsComputer Vision and Image Understanding10.1016/j.cviu.2017.05.011168:C(3-20)Online publication date: 1-Mar-2018
https://dl.acm.org/doi/10.1016/j.cviu.2017.05.011
Abebe MPouli TLarabi MReinhard E(2017)Perceptual Lightness Modeling for High-Dynamic-Range ImagingACM Transactions on Applied Perception10.1145/308657715:1(1-19)Online publication date: 27-Jul-2017
https://dl.acm.org/doi/10.1145/3086577
Hao HZhang YAgrafiotis DNaccari MMrak M(2017)Performance evaluation of reverse tone mapping operators for dynamic range expansion of SDR video content2017 IEEE 19th International Workshop on Multimedia Signal Processing (MMSP)10.1109/MMSP.2017.8122213(1-6)Online publication date: Oct-2017
https://doi.org/10.1109/MMSP.2017.8122213
Bist CCozot RMadec GDucloux X(2017)Tone expansion using lighting style aestheticsComputers & Graphics10.1016/j.cag.2016.12.00662(77-86)Online publication date: Mar-2017
https://doi.org/10.1016/j.cag.2016.12.006
Bist CCozot RMadec GDucloux XPopa TMoffatt K(2016)Style Aware Tone Expansion for HDR DisplaysProceedings of the 42nd Graphics Interface Conference10.5555/3076132.3076146(57-63)Online publication date: 1-Jun-2016
https://dl.acm.org/doi/10.5555/3076132.3076146

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents