This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection
July 1997 (vol. 19 no. 7)
pp. 711-720

Abstract—We develop a face recognition algorithm which is insensitive to large variation in lighting direction and facial expression. Taking a pattern classification approach, we consider each pixel in an image as a coordinate in a high-dimensional space. We take advantage of the observation that the images of a particular face, under varying illumination but fixed pose, lie in a 3D linear subspace of the high dimensional image space—if the face is a Lambertian surface without shadowing. However, since faces are not truly Lambertian surfaces and do indeed produce self-shadowing, images will deviate from this linear subspace. Rather than explicitly modeling this deviation, we linearly project the image into a subspace in a manner which discounts those regions of the face with large deviation. Our projection method is based on Fisher's Linear Discriminant and produces well separated classes in a low-dimensional subspace, even under severe variation in lighting and facial expressions. The Eigenface technique, another method based on linearly projecting the image space to a low dimensional subspace, has similar computational requirements. Yet, extensive experimental results demonstrate that the proposed "Fisherface" method has error rates that are lower than those of the Eigenface technique for tests on the Harvard and Yale Face Databases.

[1] R. Chellappa, C. Wilson, and S. Sirohey, "Human and Machine Recognition of Faces: A Survey," Proc. IEEE, vol. 83, no. 5, pp. 705-740, 1995.
[2] A. Samal and P. Iyengar, "Automatic Recognition and Analysis of Human Faces and Facial Expressions: A Survey," Pattern Recognition, vol. 25, pp. 65-77, 1992.
[3] A. Shashua, "Geometry and Photometry in 3D Visual Recognition," PhD thesis, Massachusetts Institute of Tech nology, 1992.
[4] R. Duda and P. Hart, Pattern Classification and Scene Analysis.New York: Wiley, 1973.
[5] R.A. Fisher, "The Use of Multiple Measures in Taxonomic Problems," Ann. Eugenics, vol. 7, pp. 179-188, 1936.
[6] L. Sirovitch and M. Kirby, "Low-Dimensional Procedure for the Characterization of Human Faces," J. Optical Soc. of Am. A, vol. 2, pp. 519-524, 1987.
[7] M. Turk and A. Pentland, "Eigenfaces for Recognition," J. Cognitive Neuroscience, vol. 3, no. 1, 1991.
[8] M. Turk and A. Pentland, "Face Recognition Using Eigenfaces," Proc. IEEE Conf. on Computer Vision and Pattern Recognition, 1991, pp. 586-591.
[9] Y. Moses, Y. Adini, and S. Ullman, "Face Recognition: The Problem of Compensating for Changes in Illumination Direction," European Conf. Computer Vision, 1994, pp. 286-296.
[10] Y. Cheng, K. Liu, J. Yang, Y. Zhuang, and N. Gu, "Human Face Recognition Method Based on the Statistical Model of Small Sample Size," SPIE Proc. Intelligent Robots and Computer Vision X: Algorithms and Technology, 1991, pp. 85-95.
[11] S. Baker and S.K. Nayar, "Pattern Rejection," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1996, pp. 544-549.
[12] P.N. Belhumeur, J.P. Hespanha, and D.J. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection," European Conf. Computer Vision, 1996, pp. 45-58.
[13] Y. Cui, D. Swets, and J. Weng, "Learning-Based Hand Sign Recognition Using SHOSLIF-M," Int'l Conf. on Computer Vision, 1995, pp. 631-636.
[14] P. Hallinan, "A Low-Dimensional Representation of Human Faces for Arbitrary Lighting Conditions," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1994, pp. 995-999.
[15] P. Hallinan, "A Deformable Model for Face Recognition Under Arbitrary Lighting Conditions," PhD thesis, Harvard Univ., 1995.
[16] A. Pentland, B. Moghaddam, and Starner, "View-Based and Modular Eigenspaces for Face Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1994, pp. 84-91.
[17] H. Murase and S. Nayar, "Visual Learning and Recognition of 3-D Objects from Appearance," Int'l J. Computer Vision, vol. 14, pp. 5-24, 1995.
[18] D. Beymer, "Face Recognition Under Varying Pose," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1994, pp. 756-761.
[19] A. Gee and R. Cipolla, "Determining the Gaze of Faces in Images," Image and Vision Computing, vol. 12, pp. 639-648, 1994.
[20] A. Lanitis, C.J. Taylor, and T.F. Cootes, "A Unified Approach to Coding and Interpreting Face Images," Int'l Conf. Computer Vision, 1995, pp. 368-373.
[21] Q. Chen, H. Wu, and M. Yachida, "Face Detection by Fuzzy Pattern Matching," Int'l Conf. Computer Vision, 1995, pp. 591-596.
[22] I. Craw, D. Tock, and A. Bennet, "Finding Face Features," Proc. European Conf. Computer Vision, 1992, pp. 92-96.
[23] T. Leung, M. Burl, and P. Perona, "Finding Faces in Cluttered Scenes Using Labeled Random Graph Matching," Int'l Conf. Computer Vision, 1995, pp. 637-644.
[24] K. Matsuno, C.W. Lee, S. Kimura, and S. Tsuji, "Automatic Recognition of Human Facial Expressions," Int'l Conf. Computer Vision, 1995, pp. 352-359.
[25] B. Moghaddam and A. Pentland, "Probabilistic Visual Learning for Object Detection," Int'l Conf. Computer Vision, 1995, pp. 786-793.
[26] R. Brunelli and T. Poggio, "Face Recognition: Features vs. Templates," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 10, pp. 1,042-1,053, Oct. 1993.
[27] J.M. Gilbert and W. Yang, "A Real-Time Face Recognition System Using Custom VLSI Hardware," Proc. IEEE Workshop on Computer Architectures for Machine Perception, 1993, pp. 58-66.
[28] B.K.P. Horn, Computer Vision.Cambridge, Mass.: MIT Press, 1986.
[29] W.M. Silver, Determining Shape and Reflectance Using Multiple Images, PhD thesis, Massachusetts Institute of Tech nology, 1980.
[30] R.J. Woodham, "Analysing Images of Curved Surfaces," Artificial Intelligence, vol. 17, pp. 117-140, 1981.
[31] S. Nayar and H. Murase, "Dimensionality of Illumination in Appearance Matching," IEEE Conf. Robotics and Automation, 1996.
[32] P.N. Belhumeur and D.J. Kriegman, "What is the Set of Images of an Object under all Possible Lighting Conditions?," IEEE Proc. Conf. Computer Vision and Pattern Recognition, 1996.

Index Terms:
Appearance-based vision, face recognition, illumination invariance, Fisher's linear discriminant.
Citation:
Peter N. Belhumeur, João P. Hespanha, David J. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 711-720, July 1997, doi:10.1109/34.598228
Usage of this product signifies your acceptance of the Terms of Use.