This Article 
 Bibliographic References 
 Add to: 
Color Space Analysis of Mutual Illumination
December 1993 (vol. 15 no. 12)
pp. 1319-1326

Mutual illumination occurs when light reflected from one surface impinges on a second one. The resulting additional illumination incident on the second surface affects both the color and intensity of the light reflected from it. As a consequence, the image of a surface in the presence of mutual illumination differs from what it otherwise would have been in the absence of mutual illumination. Unaccounted for mutual illumination can easily confuse methods that rely on intensity or color such as shape-from-shading or color-based object recognition. In this correspondence, we introduce an algorithm that removes mutual illumination effects from images. The domain is that of previously-segmented images of convex surfaces of uniform color and diffuse reflectance where for each surface the interreflection occurs mainly from one other surface and can be accurately accounted for within a one-bounce model. The algorithm is based on a singular value decomposition of the colors coming from each surface. Geometrical information about where on the surface the colors emanate from is not required. The RGB triples from a single convex surface experiencing interreflection fall in a plane; intersecting the planes generated from two interreflecting surfaces results in a unique interreflection color. Each pixel can then be factored into its interreflection and no-interreflection components so that a complete no-interreflection image is produced.

[1] R. Bajcsy, S. W. Lee, and A. Leonardis, "Color image segmentation and with detection of highlights and local illumination induced by interreflections,"IEEE Int. Conf. Pattern Recognit., Atlantic City, NJ, vol. 1, 1990, pp. 785-790.
[2] M. H. Brill, "Image segmentation by object color: A unifying framework and connection to color constancy,"J. Opt. Soc. Am. A, vol. 7, pp. 2041-2047, 1990.
[3] M. S. Drew and B. V. Funt, "Calculating surface reflectance using a single-bounce model of mutual reflection," inProc. IEEE Int. Conf. Computer Vision, Osaka, Japan, Dec. 4-7, 1990, pp. 393-399.
[4] M. S. Drew and B. V. Funt, "Variational approach to mutual illumination in color images,"J. Opt. Soc. Am. A, vol. 32, pp. 1255-1265, 1992.
[5] D. Forsyth, "A novel algorithm for color constancy,"Int. J. Comput. Vision, vol. 5, pp. 5-36, 1990.
[6] D.A. Forsyth and A. Zisserman, "Mutual illumination," inProc. CVPR, 1989.
[7] D.A. Forsyth and A. Zisserman, "Shape from shading in the light of mutual illumination,"Image Vision Comput., vol. 8, pp. 42-49, 1990.
[8] B. V. Funt and M. S. Drew, "Color space analysis of mutual illumination," Tech. Rep. CSS/LCCR TR 91-03, Simon Fraser Univ., School of Computing Sci., 1991.
[9] B. V. Funt, M. S. Drew, and J. Ho, "Color constancy from mutual reflection,"Int. J. Comput. Vision, vol. 6, pp. 5-24, 1991.
[10] G. H. Golub and C. F. van Loan,Matrix Computations. Baltimore, MD: John Hopkins Univ. Press, 1983.
[11] C. M. Goral, K. E. Torrance, D. P. Greenberg, and B. Battaile, "Modeling the interaction of light between diffuse surfaces,"Comput. Graphics, vol. 1, pp. 213-222, 1984.
[12] J. Ho, B. V. Funt, and M. S. Drew, "Separating a color signal into illumination and surface reflectance components: Theory and applications,"IEEE Trans. Pattern Anal. Machine Intell., vol. 12, pp. 966-977, Dec. 1990.
[13] B. K. P. Horn, "Understanding image intensities,"Artificial Intell., vol. 8, pp. 201-231, 1977.
[14] J. E. Kaufman,IES Lighting Handbook, 4th ed. New York: Illuminating Eng. Soc., 1966.
[15] S. Kawata, K. Sasaki, and S. Minami, "Component analysis of spatial and spectral patterns in multispectral images. I. Basis,"J. Opt. Soc. Am. A, vol. 4, pp. 2101-2106, 1987.
[16] G. J. Klinker, S. A. Shafer, and T. Kanade. "The measurement of highlights in color images,"Int. J. Comput. Vision, vol. 2, pp. 7-32, 1988.
[17] W. H. Lawton and E. A. Sylvestre, "Self modeling curve resolution,"Technometrics, vol. 13, pp. 617-633, 1971.
[18] H.-C. Lee, "Method for computing the scene-illuminant chromaticity from specular highlights,"J. Opt. Soc. Am. A, vol. 3, pp. 1694-1699, 1986.
[19] S. K. Nayar and Y. Gong, "Colored interreflections and shape recovery," inImage Understanding Workshop, in DARPA, San Diego, CA 1992.
[20] S. K. Nayar, K. Ikeuchi, and T. Kanade, "Shape from interreflections," inProc. IEEE Int. Conf. Comput. Vision, Osaka, Japan, Dec.4-7, 1990, pp. 2-11.
[21] S. A. Shafer, "Using color to separate reflection components,"Color Res. Appl., vol. 10, pp. 210-218, 1985.
[22] S. A. Shafer, T. Kanade, G. J. Klinker, and C. L. Novak, "Physics-based models for early vision by machine," inPerceiving, Measuring, and Using Color. New York: SPIE, 1990, vol. 1250, pp. 222-235.
[23] R. Siegel and J. R. Howell,Thermal Radiation Heat Transfer. New York: Hemisphere, 1981.
[24] S. Tominaga and B. A. Wandell, "Standard surface-reflectance model and illuminanat estimation,"J. Opt. Soc. Am. A, vol. 6, pp. 576-584, 1989.
[25] S. Tominaga and B. A. Wandell, "Component estimation of surface spectral reflectance,"J. Opt. Soc. Am. A, vol. 7, pp. 312-317, 1990.
[26] F. Tong and B. V. Funt, "Specularity removal for shape from shading," inProc. Vision Interface 1988, Edmonton, AB, Canada, 1988, pp. 98-103.
[27] F. Tong and B. V. Funt, "Removing specularities from color images for shape from shading," inComputer Vision and Shape Recognition, A. Krzyzak, Ed. New York: World Scientific, 1989.
[28] G. Wyszecki and W. S. Stiles,Color Science: Concepts and Methods, Quantitative Data and Formulas, 2nd ed. New York: Wiley, 1982.

Index Terms:
color space analysis; mutual illumination; image; light intensity; interreflection; singular value decomposition; geometrical information; RGB triples; image processing
B.V. Funt, M.S. Drew, "Color Space Analysis of Mutual Illumination," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 15, no. 12, pp. 1319-1326, Dec. 1993, doi:10.1109/34.250838
Usage of this product signifies your acceptance of the Terms of Use.