loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Face Recognition Algorithms Surpass Humans Matching Faces Over Changes in Illumination
September 2007 (vol. 29 no. 9)
pp. 1642-1646
There has been significant progress in improving the performance of computer-based face recognition algorithms over the last decade. Although algorithms have been tested and compared extensively with each other, there has been remarkably little work comparing the accuracy of computer-based face recognition systems with humans. We compared seven state-of-the-art face recognition algorithms with humans on a facematching task. Humans and algorithms determined whether pairs of face images, taken under different illumination conditions, were pictures of the same person or of different people. Three algorithms surpassed human performance matching face pairs prescreened to be "difficult" and six algorithms surpassed humans on "easy" face pairs. Although illumination variation continues to challenge face recognition algorithms, current algorithms compete favorably with humans. The superior performance of the best algorithms over humans, in light of the absolute performance levels of the algorithms, underscores the need to compare algorithms with the best current control—humans.

[1] W. Zhao, R. Chellappa, P.J. Phillips, and A. Rosenfeld, “Face Recognition: A Literature Survey,” ACM Computing Surveys, vol. 35, pp. 399-459, 2003.
[2] D. Blackburn, J.M. Bone, and P.J. Phillips, “FRVT 2000 Evaluation Report,” technical report, http:/www.frvt.org, 2001.
[3] P.J. Phillips, P.J. Flynn, T. Scruggs, K.W. Bowyer, and W. Worek, “Preliminary Face Recognition Grand Challenge Results,” Proc. Seventh Int'l Conf. Automatic Face and Gesture Recognition, pp. 15-24, 2006.
[4] P.J. Phillips, H. Moon, P. Rizvi, and P. Rauss, “The FERET Evaluation Method for Face Recognition Algorithms,” IEEE Trans. Pattern Analysis and Machine Learning, vol. 22, pp. 1090-1104, 2000.
[5] P.J. Phillips, P. Grother, R. Micheals, D. Blackburn, E. Tabassi, and J.M. Bone, “FRVT 2002 Evaluation Report,” Technical Report NISTIR 6965, http:/www.frvt.org, 2003.
[6] X. Tang and X. Wang, “Face Sketch Recognition,” IEEE Trans. Circuits, Systems, and Video Technology, vol. 14, no. 1, pp. 50-57, Jan. 2004.
[7] X. Tang and X. Wang, “Face Sketch Synthesis and Recognition,” Proc. Ninth IEEE Int'l Conf. Computer Vision, pp. 687-694, Oct. 2003.
[8] P.J. Phillips and E. Newton, “Meta-Analysis of Face Recognition Algorithms,” Proc. Fifth Int'l Conf. Automatic Face & Gesture Recognition, p. 235, 2002.
[9] W.J. Braje, “Illumination Encoding in Face Recognition: Effect of Position Shift,” J. Vision, vol. 3, pp. 161-170, 2003.
[10] W.J. Braje, D. Kersten, M.J. Tarr, and N.F. Troje, “Illumination Effects in Face Recognition,” Psychobiology, vol. 26, pp. 371-380, 1999.
[11] W.J. Braje, G.E. Legge, and D. Kersten, “Invariant Recognition of Natural Objects in the Presence of Shadows,” Perception, vol. 29, pp. 383-398, 2000.
[12] H. Hill and V. Bruce, “Effects of Lighting on the Perception of Facial Surface,” J. Experimental Psychology: Human Perception & Performance, vol. 22, no. 4, pp. 986-1004, 1996.
[13] N.F. Troje and H.H. Bülthoff, “How Is Bilateral Symmetry of Human Faces Used for Recognition of Novel Views?” Vision Research, vol. 38, pp. 79-89, 1998.
[14] R. Gross, S. Baker, I. Matthews, and T. Kanade, “Face Recognition Across Pose and Illumination,” Handbook of Face Recognition, S.Z. Li and A.K. Jain, eds., pp. 193-216, Springer, 2005.
[15] P.J. Phillips, P.J. Flynn, T. Scruggs, K.W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. Worek, “Overview of the Face Recognition Grand Challenge,” Proc. IEEE Computer Vision & Pattern Recognition, vol. 1, pp.947-954, 2005.
[16] M.J. Tarr and H.H. Bülthoff, “Image-Based Object Recognition in Man, Monkey and Machine,” Cognition, vol. 67, pp. 1-20, 1998.
[17] Y. Adini, Y. Moses, and S. Ullman, “Face Recognition: The Problem of Compensating for Changes in Illumination Direction,” IEEE Trans. Pattern Analysis and Machine Learning, vol. 19, pp. 721-732, 1997.
[18] A.J. O'Toole, F. Jiang, D. Roark, and H. Abdi, “Predicting Human Face Recognition,” Face Processing: Advanced Methods and Models, W.-Y. Zhao and R. Chellappa, eds., Elsevier, 2006.
[19] L. Sirovich and M. Kirby, “Low-Dimensional Procedure for the Characterization of Human Faces,” J. Optical Soc. Am., vol. A, no. 4, pp. 519-524, 1987.
[20] M. Turk and A. Pentland, “Eigenfaces for Recognition,” J. Cognitive Neuroscience, vol. 3, pp. 71-86, 1991.
[21] H.J. Moon and P.J. Phillips, “Computational and Performance Aspects of PCA-Based Face Recognition Algorithms,” Perception, vol. 30, pp. 301-321, 2001.
[22] C. Liu, “Capitalize on Dimensionality Increasing Techniques from Improving Face Recognition Grand Challenge Performance,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, pp. 725-737, 2006.
[23] C.M. Xie, M. Savvides, and V. Kumar, “Kernel Correlation Filter Based Redundant Class-Dependence Feature Analysis (KCFA) on FRGC2.0 Data,” Proc. IEEE Int'l Workshop Analysis & Modeling Faces & Gestures, pp. 32-43, 2005.
[24] M. Husken, B. Brauckmann, S. Gehlen, and C. von der Malsburg, “Strategies and Benefits of Fusion of 2D and 3D Face Recognition,” Proc. IEEE Workshop Face Recognition Grand Challenge Experiments, P.J.Phillips and K.W. Bowyer, eds., 2005.
[25] P.J.B. Hancock, V. Bruce, and A.M. Burton, “Recognition of Unfamiliar Faces,” Trends in Cognitive Sciences, vol. 4, pp. 330-337, 2000.
[26] A.J. O'Toole, D. Roark, and H. Abdi, “Recognition of Moving Faces: A Psychological and Neural Perspective,” Trends in Cognitive Sciences, vol. 6, pp. 261-266, 2002.
[27] A.M. Burton, R. Jenkins, P.J. Hancock, and D. White, “Robust Representations for Face Recognition: The Power of Averages,” Cognitive Psychology, vol. 51, pp. 256-284, 2005.

Index Terms:
face and gesture recognition, performance evaluation of algorithms and systems, human information processing
Citation:
Alice J. O'Toole, P. Jonathon Phillips, Fang Jiang, Janet Ayyad, Nils Penard, Herv? Abdi, "Face Recognition Algorithms Surpass Humans Matching Faces Over Changes in Illumination," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 29, no. 9, pp. 1642-1646, June 2007, doi:10.1109/TPAMI.2007.1107
Usage of this product signifies your acceptance of the Terms of Use.