This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Analytic PCA Construction for Theoretical Analysis of Lighting Variability in Images of a Lambertian Object
October 2002 (vol. 24 no. 10)
pp. 1322-1333

Abstract—We analyze theoretically the subspace best approximating images of a convex Lambertian object taken from the same viewpoint, but under different distant illumination conditions. Since the lighting is an arbitrary function, the space of all possible images is formally infinite-dimensional. However, previous empirical work has shown that images of largely diffuse objects actually lie very close to a five-dimensional subspace. In this paper, we analytically construct the principal component analysis for images of a convex Lambertian object, explicitly taking attached shadows into account, and find the principal eigenmodes and eigenvalues with respect to lighting variability. Our analysis makes use of an analytic formula for the irradiance in terms of spherical-harmonic coefficients of the illumination and shows, under appropriate assumptions, that the principal components or eigenvectors are identical to the spherical harmonic basis functions evaluated at the surface normal vectors. Our main contribution is in extending these results to the single-viewpoint case, showing how the principal eigenmodes and eigenvalues are affected when only a limited subset (the upper hemisphere) of normals is available and the spherical harmonics are no longer orthonormal over the restricted domain. Our results are very close, both qualitatively and quantitatively, to previous empirical observations and represent the first essentially complete theoretical explanation of these observations. Our analysis is also likely to be of interest in other areas of computer vision and image-based rendering. In particular, our results indicate that using complex illumination for photometric problems in computer vision is not significantly more difficult than using directional sources.

[1] R. Basri and D. Jacobs, “Lambertian Reflectance and Linear Subspaces,” Proc. Eighth IEEE Int'l Conf. Computer Vision, pp. 383-390, 2001.
[2] R. Basri and D.W. Jacobs, Photometric Stereo with General, Unknown Lighting Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 374-381, 2001.
[3] P.N. Belhumeur and D.J. Kriegman, “What Is the Set of Images of an Object under All Possible Illumination Conditions?” Int'l J. Computer Vision, vol. 28, no. 3, pp. 245-260, 1998.
[4] B. Cabral, N. Max, and R. Springmeyer, “Bi-Directional Reflection from Surface Bump Maps,” Computer Graphics, vol. 21, no. 4, pp. 273-282, 1987.
[5] R. Epstein, P. Hallinan, and A. Yuille, “5 Plus or Minus 2 Eigenimages Suffice: An Empirical Investigation of Low-Dimensional Lighting Models,” Proc. IEEE Workshop Physics-Based Modeling in Computer Vision, pp. 108-116, 1995.
[6] A.S. Georghiades, P.N. Belhumeur, and D.J. Kriegman, From Few to Many: Generative Models for Recognition under Variable Pose and Illumination Proc. Fourth IEEE Int'l Conf. Automatic Face and Gesture Recognition, 2000.
[7] A. Georghiades, D. Kriegman, and P. Belhumeur, “Illumination Cones for Recognition under Variable Lighting: Faces,” Proc. Computer Vision and Pattern Recognition Conf., pp. 52-59, 1998.
[8] P. Hallinan, "A Low-Dimensional Representation of Human Faces for Arbitrary Lighting Conditions," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1994, pp. 995-999.
[9] M. Kirby and L. Sirovich,“Application of Karhunen-Loève procedure for the characterization of human faces,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 1, pp. 103-108, Jan. 1990.
[10] A. Levin and A. Shashua, “Principal Component Analysis over Continuous Subspaces and Intersection of Half-Spaces,” Proc. European Conf. Computer Vision, to appear.
[11] T.M. MacRobert, Spherical Harmonics; An Elementary Treatise on Harmonic Functions, with Applications. Dover Publications, 1948.
[12] T. Malzbender, D. Gelb, and H. Wolters, “Polynomial Texture Maps,” Proc. ACM SIGGRAPH Conf., pp. 519-528, 2001.
[13] Y. Moses, Y. Adini, and S. Ullman, “Face Recognition: The Problem of Compensating for Changes in Illumination Direction,” Proc. Third European Conf. Computer Vision, pp. 286-296, J.-O. Eklundh, ed., May 1994.
[14] H. Murase and S.K. Nayar, “Visual Learning and Recognition of 3-D Objects from Appearance,” Int'l J. Computer Vision, vol. 14, pp. 5-24, 1995.
[15] R. Ramamoorthi, “Analytic PCA Construction for Theoretical Analysis of Lighting Variability, Including Attached Shadows, in a Single Image of a Convex Lambertian Object,” Proc. Computer Vision and Pattern Recognition Conf. Workshop Identifying Objects across Variations in Lighting: Psychophysics and Computation, pp. 48-55, 2001.
[16] R. Ramamoorthi and P. Hanrahan, “On the Relationship between Radiance and Irradiance: Determining the Illumination from Images of a Convex Lambertian Object,” J. Optical Soc. Am. A, vol. 18, no. 10, pp. 2448-2459, Oct. 2001.
[17] R. Ramamoorthi and P. Hanrahan, “A Signal-Procession Framework for Inverse Rendering,” Proc. ACM SIGGRAPH’01, pp. 117-128, Aug. 2001.
[18] A. Shashua, “On Photometric Issues in 3D Visual Recognition from a Single 2D Image,” Int'l J. Computer Vision, vol. 21, nos. 1-2, pp. 99-122, Jan. 1997.
[19] F.X. Sillion et al., "A Global Illumination Solution for General Reflectance Distributions," Computer Graphics Proc.(Siggraph 91), ACM Press, New York, 1991, pp. 187-196.
[20] L. Sirovich and M. Kirby, “Low-Dimensional Procedure for the Characterization of Human Faces,” J. Optical Soc. Am. A (JOSA A), vol. 4, no. 3, pp. 519-524, Mar. 1987.
[21] M. Turk and A. Pentland, “Eigenfaces for Recognition,” J. Congitive Neuroscience, vol. 3, no. 1, pp. 71-96, 1991.
[22] A.L. Yuille, D. Snow, R. Epstein, and P.N. Belhumeur, “Determining Generative Models of Objects under Varying Illumination: Shape and Albedo from Multiple Images Using SVD and Integrability,” Int'l J. Computer Vision, vol. 35, no. 3, pp. 1-20, Dec. 1999.
[23] L. Zhao and Y. Yang, “Theoretical Analysis of Illumination in PCA-Based Vision Systems,” Pattern Recognition, vol. 32, pp. 547-564, 1999.

Index Terms:
Illumination, radiance, irradiance, Lambertian, recognition, principal component analysis, spherical harmonics.
Citation:
Ravi Ramamoorthi, "Analytic PCA Construction for Theoretical Analysis of Lighting Variability in Images of a Lambertian Object," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 10, pp. 1322-1333, Oct. 2002, doi:10.1109/TPAMI.2002.1039204
Usage of this product signifies your acceptance of the Terms of Use.