This Article 
 Bibliographic References 
 Add to: 
Color by Correlation: A Simple, Unifying Framework for Color Constancy
November 2001 (vol. 23 no. 11)
pp. 1209-1221

Abstract—This paper considers the problem of illuminant estimation: how, given an image of a scene, recorded under an unknown light, we can recover an estimate of that light. Obtaining such an estimate is a central part of solving the color constancy problem—that is of recovering an illuminant independent representation of the reflectances in a scene. Thus, the work presented here will have applications in fields such as color-based object recognition and digital photography, where solving the color constancy problem is important. The work in this paper differs from much previous work in that, rather than attempting to recover a single estimate of the illuminant as many previous authors have done, we instead set out to recover a measure of the likelihood that each of a set of possible illuminants was the scene illuminant. We begin by determining which image colors can occur (and how these colors are distributed) under each of a set of possible lights. We discuss in the paper how, for a given camera, we can obtain this knowledge. We then correlate this information with the colors in a particular image to obtain a measure of the likelihood that each of the possible lights was the scene illuminant. Finally, we use this likelihood information to choose a single light as an estimate of the scene illuminant. Computation is expressed and performed in a generic correlation framework which we develop in this paper. We propose a new probabilistic instantiation of this correlation framework and we show that it delivers very good color constancy on both synthetic and real images. We further show that the proposed framework is rich enough to allow many existing algorithms to be expressed within it: the gray-world and gamut-mapping algorithms are presented in this framework and we also explore the relationship of these algorithms to other probabilistic and neural network approaches to color constancy.

[1] L. Arend and A. Reeves, “Simultaneous Color Constancy,” J. Optical Soc. Am., A, vol. 3, no. 10, pp. 1743-1751, 1986.
[2] K. Barnard, “Computational Color Constancy: Taking Theory into Practice,” master's thesis, Simon Fraser Univ., School of Computing Science, 1995.
[3] D.H. Brainard, W.A. Brunt, and J.M. Speigle, “Color Constancy in the Nearly Natural Image. I. Asymmetric Matches,” J. Optical Soc. Am., A, vol. 14, no. 9, pp. 2091-2110, 1997.
[4] D.H. Brainard and W.T. Freeman, “Bayesian Color Constancy,” J. Optical Soc. Am., A, vol. 14, no. 7, pp. 1393-1411, 1997.
[5] G. Buchsbaum, “A Spatial Processor Model for Object Colour Perception,” J. Franklin Inst., vol. 310, pp. 1-26, 1980.
[6] J. Cohen, “Dependency of the Spectral Reflectance Curves of the Munsell Color Chips,” Psychonomic Science, vol. 1, pp. 369-370, 1964.
[7] R.O. Duda and P.E. Hart, Pattern Classification and Scene Analysis. John Wiley and Sons, 1973.
[8] M.M. D'Zmura and G. Iverson, “Color Constancy. I. Basic Theory of Two-Stage Linear Recovery of Spectral Descriptions for Lights and Surfaces,” J. Optical Soc. Am., A, vol. 10, no. 10, pp. 2148-2165, 1987.
[9] M.M. D'Zmura and G. Iverson, “Probabilistic Color Constancy,” Geometric Representations of Perceptual Phenomena: Papers in Honor of Tarow Indow's 70th Birthday, M.M. D'Zmura, D. Hoffman, G. Iverson, and K. Romney, eds., Laurence Erlbaum Assoc., 1994.
[10] G.D. Finlayson, “Color in Perspective,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 10, pp. 1,034-1,038, Oct. 1996.
[11] G.D. Finlayson and B.V. Funt, “Color Constancy with Shadows,” Perception, vol. 23, pp. 89-90, 1994.
[12] G. Finlayson and S. Hordley, “A Theory of Selection for Gamut Mapping Colour Constancy,” Proc. Computer Vision and Pattern Recognition '98, pp. 60-65, June 1998.
[13] G.D. Finlayson, P.M. Hubel, and S. Hordley, “Color by Correlation,” Proc. Fifth Colour Imaging Conf., pp. 6-11, Nov. 1997.
[14] D.A. Forsyth, “A Novel Algorithm for Color Constancy,” Int'l J. Computer Vision, vol. 5, no. 1, pp. 5-36, 1990.
[15] B.V. Funt, M.S. Drew, and J. Ho, “Color Constancy from Mutual Reflection,” Int'l J. Computer Vision, vol. 6, pp. 5-24, 1991.
[16] B. Funt, K. Barnard, and L. Martin, “Is Machine Colour Constancy Good Enough?” Proc. Fifth European Conf. Computer Vision, pp. 455-459, June 1998.
[17] B.V. Funt, V. Cardei, and K. Barnard, “Learning Color Constancy,” Proc. Fourth Color Imaging Conf., pp. 58-60, Nov. 1996.
[18] R. Gershon, A.D. Jepson, and J.K. Tsotsos, “From [R,G,B] to Surface Reflectance: Computing Color Constant Descriptors in Images,” Perception, pp. 755-758, 1988.
[19] P.M. Hubel, J. Holm, G.D. Finlayson, and M.S. Drew, “Matrix Calculations for Digital Photography,” Proc. Fifth Color Imaging Conf., pp. 105-111, Nov. 1997.
[20] P.M. Hubel and G.D. Finlayson, “Whitepoint Determination Using Correlation Matrix Memory,” US Patent Application, Submitted.
[21] E.H. Land, “The Retinex Theory of Color Constancy,” Scientific Am., pp. 108-129, 1977.
[22] H.C. Lee, E.J. Breneman, and C.P. Schulte, Modeling Light Reflection for Computer Color Vision IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, pp. 402-409, 1990.
[23] L.T. Maloney and B.A. Wandell, “Color Constancy: A Method for Recovering Surface Spectral Reflectance,” J. Optical Soc. Am., A, vol. 3, no. 1, pp. 29-33, 1986.
[24] J. Parkkinen, T. Jaaskelainen, and M. Kuittinen, “Spectral Representation of Color Images,” Proc. IEEE Ninth Int'l Conf. Pattern Recognition, vol. 2, pp. 933-935, Nov. 1998.
[25] G. Sapiro, “Color and Illuminant Voting,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 10, pp. 210-218, 1985.
[26] G. Sapiro, “Bilinear Voting,” Proc. Int'l Conf. Computer Vision, Bombay, India, Jan. 1998.
[27] S.A. Shafer, “Using Color to Separate Reflection Components,” Color Research and Application, vol. 21, no. 11, pp. 1210-1215, 1999.
[28] M.J. Swain and B.H. Ballard, “Color Indexing,” Int'l J. Computer Vision, vol. 7, no. 1, pp. 11-32, 1991.
[29] S. Tominaga, “Surface Reflectance Estimation by the Dichromatic Model,” Color Research and Application, vol. 21, no. 2, pp. 104-114, 1996.
[30] M.J. Vrhel, R. Gershon, and L.S. Iwan, “Measurement and Analysis of Object Reflectance Spectra,” Color Research and Application, vol. 19, no. 1, pp. 4-9, 1994.
[31] G. Wyszecki and W.S. Stiles, Color Science: Concepts and Methods, Quantitative Data and Formulas, second ed. New York: Wiley, 1982.

Index Terms:
Color constancy, illuminant estimation, correlation matrix.
Graham D. Finlayson, Steven D. Hordley, Paul M. Hubel, "Color by Correlation: A Simple, Unifying Framework for Color Constancy," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 23, no. 11, pp. 1209-1221, Nov. 2001, doi:10.1109/34.969113
Usage of this product signifies your acceptance of the Terms of Use.