This Article 
 Bibliographic References 
 Add to: 
The Illumination-Invariant Recognition of 3D Objects Using Local Color Invariants
February 1996 (vol. 18 no. 2)
pp. 206-210

Abstract—Traditional approaches to three dimensional object recognition exploit the relationship between three dimensional object geometry and two dimensional image geometry. The capability of object recognition systems can be improved by also incorporating information about the color of object surfaces. Using physical models for image formation, we derive invariants of local color pixel distributions that are independent of viewpoint and the configuration, intensity, and spectral content of the scene illumination. These invariants capture information about the distribution of spectral reflectance which is intrinsic to a surface and thereby provide substantial discriminatory power for identifying a wide range of surfaces including many textured surfaces. These invariants can be computed efficiently from color image regions without requiring any form of segmentation. We have implemented an object recognition system that indexes into a database of models using the invariants and that uses associated geometric information for hypothesis verification and pose estimation. The approach to recognition is based on the computation of local invariants and is therefore relatively insensitive to occlusion. We present several examples demonstrating the system's ability to recognize model objects in cluttered scenes independent of object configuration and scene illumination. The discriminatory power of the invariants has been demonstrated by the system's ability to process a large set of regions over complex scenes without generating false hypotheses.

[1] A.K. Jain and P.J. Flynn, Three Dimensional Object Recognition Systems. Amsterdam: Elsevier, 1993.
[2] P.J. Besl and R. Jain,“Three-dimensional object recognition,” ACM Computing Surveys, vol. 17, pp. 75-145, Mar. 1985.
[3] T.O. Binford, "Survey of model-based image analysis systems," The Int'l J. Robotics Research, vol. 1, no. 1, pp. 18-64, Spring 1982.
[4] R.T. Chin and C.R. Dyer, "Model-Based Recognition in Robotics Vision," ACM Computing Surveys, vol. 18, pp. 67-108, Mar. 1986.
[5] D.P. Huttenlocher and S. Ullman, “Recognizing Solid Objects by Alignment with an Image,” Int'l J. Computer Vision, vol. 5, no. 2, pp. 195-212, 1990.
[6] D.G. Lowe, Perceptual Organization and Visual Recognition. Boston: Kluwer Academic, 1985.
[7] W.E.L. Grimson and D.P. Huttenlocher, "On the Sensitivity of the Hough Transform for Object Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 3, pp. 255-274, Mar. 1990.
[8] S.J. Dickinson, A.P. Pentland, and A. Rosenfeld, "3D Shape Recovery Using Distributed Aspect Matching," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 174-198, Feb. 1992.
[9] H. Murase and S.K. Nayar, “Visual Learning and Recognition of 3-D Objects from Appearance,” Int'l J. Computer Vision, vol. 14, pp. 5-24, 1995.
[10] S.K. Nayar and R.M. Bolle, "Reflectance based object recognition," Int'l J. Computer Vision, in press.
[11] K. Sato, K. Ikeuchi, and T. Kanade, "Model based recognition of specular objects using sensor models," Computer Vision, Graphics, and Image Processing: Image Understanding, vol. 55, no. 2, pp. 155-169, 1992.
[12] M.J. Swain and B.H. Ballard, “Color Indexing,” Int'l J. Computer Vision, vol. 7, no. 1, pp. 11-32, 1991.
[13] B. Funt and G. Finlayson, "Color Constant Color Indexing," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 5, pp. 522-529, May 1995.
[14] G. Healey and D. Slater, "Global color constancy: Recognition of objects by use of illumination invariant properties of color distributions," J. Opt. Soc. Am. A, vol. 11, no. 11, pp. 3,003-3,010, Nov. 1994.
[15] W. Silver, "Determining shape and reflectance using multiple images," Master's thesis, EECS Dept., MIT, June 1980.
[16] D. Slater and G. Healey, "Combining color and geometric information for the illumination invariant recognition of 3-D objects," Electrical and Computer Engineering Technical Report ECE-94-12-01, Univ. of Calif., Irvine, 1994.
[17] G. Taubin and D.B. Cooper, “Object Recognition Based on Moment (or Algebraic) Invariants,” Geometric Invariance in Machine Vision, J. Mundy and A. Zisserman, eds., pp. 375-397. MIT Press, 1992.

Index Terms:
Object recognition, color, color vision,color constancy, illumination invariant, machine vision, illumination correction.
David Slater, Glenn Healey, "The Illumination-Invariant Recognition of 3D Objects Using Local Color Invariants," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 18, no. 2, pp. 206-210, Feb. 1996, doi:10.1109/34.481544
Usage of this product signifies your acceptance of the Terms of Use.