Issue No. 09 - September (2007 vol. 29)
There has been significant progress in improving the performance of computer-based face recognition algorithms over the last decade. Although algorithms have been tested and compared extensively with each other, there has been remarkably little work comparing the accuracy of computer-based face recognition systems with humans. We compared seven state-of-the-art face recognition algorithms with humans on a facematching task. Humans and algorithms determined whether pairs of face images, taken under different illumination conditions, were pictures of the same person or of different people. Three algorithms surpassed human performance matching face pairs prescreened to be "difficult" and six algorithms surpassed humans on "easy" face pairs. Although illumination variation continues to challenge face recognition algorithms, current algorithms compete favorably with humans. The superior performance of the best algorithms over humans, in light of the absolute performance levels of the algorithms, underscores the need to compare algorithms with the best current control—humans.
face and gesture recognition, performance evaluation of algorithms and systems, human information processing
Alice J. O'Toole, P. Jonathon Phillips, Nils Penard, Fang Jiang, Janet Ayyad, Herv? Abdi, "Face Recognition Algorithms Surpass Humans Matching Faces Over Changes in Illumination", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 29, no. , pp. 1642-1646, September 2007, doi:10.1109/TPAMI.2007.1107