This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Acquiring Linear Subspaces for Face Recognition under Variable Lighting
May 2005 (vol. 27 no. 5)
pp. 684-698
Previous work has demonstrated that the image variation of many objects (human faces in particular) under variable lighting can be effectively modeled by low-dimensional linear spaces, even when there are multiple light sources and shadowing. Basis images spanning this space are usually obtained in one of three ways: A large set of images of the object under different lighting conditions is acquired, and principal component analysis (PCA) is used to estimate a subspace. Alternatively, synthetic images are rendered from a 3D model (perhaps reconstructed from images) under point sources and, again, PCA is used to estimate a subspace. Finally, images rendered from a 3D model under diffuse lighting based on spherical harmonics are directly used as basis images. In this paper, we show how to arrange physical lighting so that the acquired images of each object can be directly used as the basis vectors of a low-dimensional linear space and that this subspace is close to those acquired by the other methods. More specifically, there exist configurations of k point light source directions, with k typically ranging from 5 to 9, such that, by taking k images of an object under these single sources, the resulting subspace is an effective representation for recognition under a wide range of lighting conditions. Since the subspace is generated directly from real images, potentially complex and/or brittle intermediate steps such as 3D reconstruction can be completely avoided; nor is it necessary to acquire large numbers of training images or to physically construct complex diffuse (harmonic) light fields. We validate the use of subspaces constructed in this fashion within the context of face recognition.

[1] Y. Adini, Y. Moses, and S. Ullman, “Face Recognition: The Problem Of Compensating For Changes In Illumination Direction,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 721-732, July 1997.
[2] R. Basri and D. Jacobs, “Lambertian Reflectance and Linear Subspaces,” Proc. Int'l Conf. Computer Vision, vol. 2, pp. 383-390, 2001.
[3] P. Belhumeur and D. Kriegman, “What Is the Set of Images of an Object under All Possible Lighting Conditions,” Int'l J. Computer Vision, vol. 28, pp. 245-260, 1998.
[4] H. Chen, P. Belhumeur, and D. Jacobs, “In Search of Illumination Invariants,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2000.
[5] R. Epstein, P. Hallinan, and A. Yuille, “5+/-2 Eigenimages Suffice: An Empirical Investigation of Low-Dimensional Lighting Models,” Proc. IEEE Workshop Physics-Based Modeling in Computer Vision, pp. 108-116, 1995.
[6] A. Georghiades, D. Kriegman, and P. Belhumeur, “Illumination Cones for Recognition under Variable Lighting: Faces,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 52-58, 1998.
[7] A. Georghiades, D. Kriegman, and P. Belhumeur, “From Few to Many: Generative Models for Recognition under Variable Pose and Illumination,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 40, pp. 643-660, 2001.
[8] G. Golub and C. vanLoan, Matrix Computation. The John Hopkins Univ. Press, 1989.
[9] P. Hallinan, “A Low-Dimensional Representation of Human Faces for Arbitrary Lighting Conditions,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 995-999, 1994.
[10] J. Ho, K. Lee, and D. Kriegman, “On Reducing the Complexity of Illumination Cones for Face Recognition,” Proc. IEEE CVPR Workshop Identifying Objects Across Variations in Lighting: Psychophysics and Computation, pp. 56-63, 2001.
[11] K. Lee, J. Ho, and D. Kriegman, “Nine Points of Lights: Acquiring Subspaces for Face Recognition under Variable Lighting,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 519-526, 2001.
[12] S. Nayar and H. Murase, “Dimensionality of Illumination in Appearance Matching, ” Proc. IEEE Conf. Robotics and Automation, pp. 1326-1332, 1996.
[13] R. Ramamoorthi, “Analytic PCA Construction for Theoretical Analysis of Lighting Variability in Images of a Lambertian Object,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 10, pp. 1-12, Oct. 2002.
[14] R. Ramamoorthi and P. Hanrahan, “An Efficient Representation for Irradiance Environment,” Proc. SIGGRAPH Conf., pp. 497-500, 2001.
[15] R. Ramamoorthi and P. Hanrahan, “A Signal-Processing Framework for Inverse Rendering,” Proc. SIGGRAPH Conf., pp. 117-228, 2001.
[16] Y.Y. Schechner, S.K. Nayar, and P.N. Belhumeur, “A Theory of Multiplexed Illumination,” Proc. Int'l Conf. Computer Vision, pp. 808-815, 2003.
[17] A. Shashua, “On Photometric Issues in 3D Visual Recognition form a Single Image,” Int'l J. Computer Vision, vol. 21, pp. 99-122, 1997.
[18] T. Sim, S. Baker, and M. Bsat, “The CMU Pose, Illumination, and Expression (Pie) Database,” Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition, pp. 53-58, 2002.
[19] P. Sloan, J. Kautz, and J. Snyder, “Precomputed Radiance Transfer for Real-Time Rendering in Dynamic, Low-Frequency Lighting Environments,” Proc. SIGGRAPH Conf., pp. 527-536, 2002.
[20] W. Strauss, Partial Differential Equations. John Wiley and Sons, 1992.
[21] M. Turk and A. Pentland, “Eigenfaces for Recognition,” J. Cognitive Neuroscience, vol. 3, no. 1, pp. 71-96, 1991.
[22] L. Zhao and Y. Yang, “Theoretical Analysis of Illumination in PCA-Based Vision Systems,” Pattern Recognition, vol. 32, no. 4, pp. 547-564, 1999.
[23] W.Y. Zhao and R. Chellappa, “Symmetric Shape-From-Shading Using Self-Ratio Image,” Int'l J. Computer Vision, vol. 45, no. 1, pp. 55-75, 2001.

Index Terms:
Illumination subspaces, illumination cone, face recognition, harmonic images, harmonic subspaces, ambient lighting.
Citation:
Kuang-Chih Lee, Jeffrey Ho, David J. Kriegman, "Acquiring Linear Subspaces for Face Recognition under Variable Lighting," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 5, pp. 684-698, May 2005, doi:10.1109/TPAMI.2005.92
Usage of this product signifies your acceptance of the Terms of Use.