This Article 
 Bibliographic References 
 Add to: 
An Analysis of Visual Adaptation and Contrast Perception for Tone Mapping
October 2011 (vol. 33 no. 10)
pp. 2002-2012
V. Caselles, Dept. de Tecnol. de la Inf. y las Comun., Univ. Pompeu Fabra, Barcelona, Spain
M. Bertalmio, Dept. de Tecnol. de la Inf. y las Comun., Univ. Pompeu Fabra, Barcelona, Spain
E. Provenzi, Dept. de Tecnol. de la Inf. y las Comun., Univ. Pompeu Fabra, Barcelona, Spain
S. Ferradans, Dept. de Tecnol. de la Inf. y las Comun., Univ. Pompeu Fabra, Barcelona, Spain
Tone Mapping is the problem of compressing the range of a High-Dynamic Range image so that it can be displayed in a Low-Dynamic Range screen, without losing or introducing novel details: The final image should produce in the observer a sensation as close as possible to the perception produced by the real-world scene. We propose a tone mapping operator with two stages. The first stage is a global method that implements visual adaptation, based on experiments on human perception, in particular we point out the importance of cone saturation. The second stage performs local contrast enhancement, based on a variational model inspired by color vision phenomenology. We evaluate this method with a metric validated by psychophysical experiments and, in terms of this metric, our method compares very well with the state of the art.

[1] T. Kunkel and E. Reinhard, "A Reassessment of the Simultaneous Dynamic Range of the Human Visual System," Proc. APGV '10: Seven Symp. Applied Perception in Graphics and Visualization, pp. 17-24, 2010.
[2] E. Reinhard, G. Ward, S. Pattanaik, and P. Debevec, High Dynamic Range Imaging, Acquisition, Display, and Image-Based Lighting. Morgan Kaufmann, 2005.
[3] S. Stevens, "On the Psychophysical Law," Psychological Rev., vol. 64, pp. 153-181, 1957.
[4] J. Tumblin and H. Rushmeier, "Tone Reproduction for Realistic Images," IEEE Computer Graphics and Applications, vol. 13, no. 6, pp. 42-48, Nov. 1993.
[5] K. Chiu, M. Herf, P. Shirley, S. Swamy, C. Wang, and K. Zimmerman, "Spatially Nonuniform Scaling Functions for High Contrast Images," Proc. Conf. Graphics Interface '93, pp. 245-253, 1993.
[6] G. Ward, "A Contrast-Based Scalefactor for Luminance Display," Graphics Gems IV, pp. 415-421, Academic Press, 1994.
[7] C. Schlick, "Quantization Techniques for Visualization of High Dynamic Range Pictures," Proc. Fiifth Eurographics Rendering Workshop, pp. 7-20, 1994.
[8] S. Pattanaik, J. Tumblin, H. Yee, and D. Greenberg, "Time-Dependent Visual Adaptation for Fast Realistic Image Display," Proc. ACM SIGGRAPH, pp. 47-54, 2000.
[9] E. Reinhard and K. Devlin, "Dynamic Range Reduction Inspired by Photoreceptor Physiology," IEEE Trans. Visualization and Computer Graphics, vol. 11, no. 1, pp. 13-24, Jan./Feb. 2005.
[10] J. Kuang, G. Johnson, and M. Fairchild, "iCAM06: A Refined Image Appearance Model for HDR Image Rendering," J. Visual Comm. and Image Representation , vol. 18, pp. 406-414, 2007.
[11] J. Ferwerda, S. Pattanaik, P. Shirley, and D. Greenberg, "A Model of Visual Adaptation for Realistic Image Synthesis," Proc. ACM SIGGRAPH '96, pp. 249-258, 1996.
[12] G. Ward, H. Rushmeier, and C. Piatko, "A Visibility Matching Tone Reproduction Operator for High Dynamic Range Scenes," IEEE Trans. Visualization and Computer Graphics, vol. 3, no. 4, pp. 291-306, Oct.-Dec. 1997.
[13] M. Ashikhmin, "A Tone Mapping Algorithm for High Contrast Images," Proc. Eurographics Workshop Rendering, pp. 1-11, 2002.
[14] E. Reinhard, M. Stark, P. Shirley, and J. Ferwerda, "Photographic Tone Reproduction for Digital Images," ACM Trans. Graphics, vol. 21, pp. 267-276, 2002.
[15] D. Tamburrino, D. Alleysson, L. Meylan, and S. Susstrunk, "Digital Camera Workflow for High Dynamic Range Images Using a Model of Retinal Processing," Proc. SPIE, vol. 6817, 2008.
[16] D. Jobson, Z. Rahman, and G. Woodell, "A Multiscale Retinex for Bridging the Gap between Color Images and the Human Observation of Scenes," IEEE Trans. Image Processing, vol. 6, no. 7, pp. 965-976, July 1997.
[17] G. Krawczyk, K. Myszkowski, and H. Seidel, "Lightness Perception in Tone Reproduction for High Dynamic Range Images," vol. 24, pp. 635-645, 2005.
[18] J. Tumblin and G. Turk, "Lcis: A Boundary Hierarchy for Detail-Preserving Contrast Reduction," Proc. ACM SIGGRAPH, pp. 83-90, 1999.
[19] F. Durand and J. Dorsey, "Fast Bilateral Filtering for the Display of High-Dynamic-Range Images," Proc. ACM SIGGRAPH, pp. 257-266, 2002.
[20] R. Fattal, D. Lischinski, and M. Werman, "Gradient Domain High Dynamic Range Compression," Proc. ACM Trans. Graphics, vol. 21, no. 3, pp. 249-256, 2002.
[21] R. Mantiuk, K. Myszkowski, and H. Seidel, "A Perceptual Framework for Contrast Processing of High Dynamic Range Images," ACM Trans. Applied Perception, vol. 3, no. 3, pp. 286-308, 2006.
[22] A. Pardo and G. Sapiro, "Visualization of High Dynamic Range Images," IEEE Trans. Image Processing, vol. 12, no. 6, pp. 639-647, June 2003.
[23] D. Lischinski, Z. Farbman, M. Uyttendaele, and R. Szeliski, "Interactive Local Adjustment of Tonal Values," Proc. ACM SIGGRAPH '06 Papers, pp. 646-653, 2006.
[24] F. Dunn, M. Lankheet, and F. Rieke, "Light Adaptation in Cone Vision Involves Switching between Receptor and Post-Receptor Sites," Nature, vol. 449, no. 7162, pp. 603-606, 2007.
[25] D. Hubel, Eye, Brain, and Vision. Scientific Am. Library, 1995.
[26] R. Shapley and C. Enroth-Cugell, Visual Adaptation and Retinal Gain Controls, vol. 3, pp. 263-346. Pergamon, 1984.
[27] J. Keener and J. Sneyd, Mathematical Physiology. Springer, 2008.
[28] J. Valeton and D. van Norren, "Light Adaptation of Primate Cones: An Analysis Based on Extracellular Data," Vision Research, vol. 23, no. 12, pp. 1539-1547, 1983.
[29] G. Boynton, "Color Vision: How the Cortex Represents Color," Current Biology, vol. 12, no. 24, pp. R838-R840, 2002.
[30] A. Wade and B. Wandell, "Chromatic Light Adaptation Measured Using Functional Magnetic Resonance Imaging," J. Neuroscience, vol. 22, pp. 8148-8157, 2002.
[31] S. Palmer, Vision Science: Photons to Phenomenology. The MIT Press, 1999.
[32] G. Wyszecki and W.S. Stiles, Color Science: Concepts and Methods, Quantitative Data and Formulas. John Wiley and Sons, 1982.
[33] P. Irawan, J.A. Ferwerda, and S.R. Marschner, "Perceptually Based Tone Mapping of High Dynamic Range Image Streams," Proc. Rendering Techniques, pp. 231-242, 2005.
[34] S. Shevell, "Saturation in Human Cones," Vision Research, vol. 17, no. 3, pp. 427-434, 1977.
[35] S. Stevens, "To Honor Fechner and Repeal His Law," Science, vol. 133, pp. 80-133, 1961.
[36] N. Macmillan and C. Creelman, Detection Theory: A User's Guide. Lawrence Erlbaum, 2005.
[37] E. Land and J. McCann, "Lightness and Retinex Theory," J. Optical Soc. Am., vol. 61, no. 1, pp. 1-11, Jan. 1971.
[38] M. Bertalmío, V. Caselles, E. Provenzi, and A. Rizzi, "Perceptual Color Correction through Variational Techniques," IEEE Trans. Image Processing, vol. 16, no. 4, pp. 1058-1072, Apr. 2007.
[39] R. Palma-Amestoy, E. Provenzi, M. Bertalmío, and V. Caselles, "A Perceptually Inspired Variational Framework for Color Enhancement," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 3, pp. 458-474, Mar. 2009.
[40] M. Bertalmío, V. Caselles, and E. Provenzi, "Issues about the Retinex Theory and Contrast Enhancement," Int'l J. Computer Vision, 2009.
[41] E. Provenzi, L. De Carli, A. Rizzi, and D. Marini, "Mathematical Definition and Analysis of the Retinex Algorithm," J. Optical Soc. Am. A, vol. 22, no. 12, pp. 2613-2621, Dec. 2005.
[42] T. Aydin, R. Mantiuk, K. Myszkowski, and H. Seidel, "Dynamic Range Independent Image Quality Assessment," Proc. ACM SIGGRAPH '08 Papers, pp. 1-10, 2008.
[43] G. Haro, M. Bertalmío, and V. Caselles, "Visual Acuity in Day for Night," Int'l J. Computer Vision, vol. 69, no. 1, pp. 109-117, 2006.
[44] R. Mantiuk, R. Mantiuk, A. Tomaszewska, and W. Heidrich, "Color Correction for Tone Mapping," Computer Graphics Forum, vol. 28, no. 3, pp. 193-202, 2009.
[45] M. Kim, T. Weyrich, and J. Kautz, "Modeling Human Color Perception under Extended Luminance Levels," ACM Trans. Graphics, vol. 28, no. 3, p. 27, 2009.
[46] F. Drago, K. Myszkowski, T. Annen, and N. Chiba, "Adaptive Logarithmic Mapping for Displaying High Contrast Scenes," Computer Graphics Forum, vol. 22, pp. 419-426, 2003.
[47] A. Yoshida, V. Blanz, K. Myszkowski, and H. Seidel, "Perceptual Evaluation of Tone Mapping Operators with Real-World Scenes," Proc. Human Vision and Electronic Imaging 10, SPIE, pp. 192-203, 2005.
[48] J. Kuang, H. Yamaguchi, C. Liu, G.M. Johnson, and M. Fairchild, "Evaluating HDR Rendering Algorithms," ACM Trans. Applied Perception, vol. 4, no. 2, p. 9, 2007.
[49] P. Ledda, A. Chalmers, T. Troscianko, and H. Seetzen, "Evaluation of Tone Mapping Operators Using a High Dynamic Range Display," Proc. ACM Trans. Graphics, vol. 24, pp. 640-648, 2005.
[50] M. Cadík, M. Wimmer, L. Neumann, and A. Artusi, "Evaluation of HDR Tone Mapping Methods Using Essential Perceptual Attributes," Computers and Graphics, vol. 32, no. 3, pp. 330-349, 2008.

Index Terms:
visual perception,data compression,image coding,screens (display),color vision phenomenology,visual adaptation,contrast perception,tone mapping,high-dynamic range image compression,low-dynamic range screen,observer,cone saturation,Image color analysis,Mathematical model,Visualization,Equations,Retina,Photoreceptors,Adaptation model,Weber-Fechner contrast.,High-dynamic range images,tone mapping,Naka-Rushton equation
V. Caselles, M. Bertalmio, E. Provenzi, S. Ferradans, "An Analysis of Visual Adaptation and Contrast Perception for Tone Mapping," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 10, pp. 2002-2012, Oct. 2011, doi:10.1109/TPAMI.2011.46
Usage of this product signifies your acceptance of the Terms of Use.