This Article 
 Bibliographic References 
 Add to: 
FRVT 2006 and ICE 2006 Large-Scale Experimental Results
May 2010 (vol. 32 no. 5)
pp. 1-1
This paper describes the large-scale experimental results from the Face Recognition Vendor Test (FRVT) 2006 and the Iris Challenge Evaluation (ICE) 2006. The FRVT 2006 looked at recognition from high-resolution still frontal face images and 3D face images, and measured performance for still frontal face images taken under controlled and uncontrolled illumination. The ICE 2006 evaluation reported verification performance for both left and right irises. The images in the ICE 2006 intentionally represent a broader range of quality than the ICE 2006 sensor would normally acquire. This includes images that did not pass the quality control software embedded in the sensor. The FRVT 2006 results from controlled still and 3D images document at least an order-of-magnitude improvement in recognition performance over the FRVT 2002. The FRVT 2006 and the ICE 2006 compared recognition performance from high-resolution still frontal face images, 3D face images, and the single-iris images. On the FRVT 2006 and the ICE 2006 data sets, recognition performance was comparable for high-resolution frontal face, 3D face, and the iris images. In an experiment comparing human and algorithms on matching face identity across changes in illumination on frontal face images, the best performing algorithms were more accurate than humans on unfamiliar faces.

[1] W. Zhao, R. Chellappa, P.J. Phillips, and A. Rosenfeld, "Face Recognition: A Literature Survey," ACM Computing Surveys, vol. 35, pp. 399-458, 2003.
[2] P.J. Phillips, H. Wechsler, J. Huang, and P. Rauss, "The FERET Database and Evaluation Procedure for Face-Recognition Algorithms," Image and Vision Computing J., vol. 16, no. 5, pp. 295-306, 1998.
[3] P.J. Phillips, H. Moon, S. Rizvi, and P. Rauss, "The FERET Evaluation Methodology for Face-Recognition Algorithms," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 10, pp. 1090-1104, Oct. 2000.
[4] L. Flom and A. Safir, Iris Recognition System, US Patent 4,641,349, 1987.
[5] K.W. Bowyer, K. Hollingsworth, and P.J. Flynn, "Image Understanding for Iris Biometrics: A Survey," Computer Vision and Image Understanding, vol. 110, no. 2, pp. 281-307, 2008.
[6] P.J. Phillips, A. Martin, C.L. Wilson, and M. Przybocki, "An Introduction to Evaluating Biometric Systems," Computer, vol. 33, no. 2, pp. 56-63, Feb. 2000.
[7] International Biometric Group, "Independent Testing of Iris Recognition Technology," technical report, http://www.ibgweb. com/reports/publicITIRT.html , May 2005.
[8] Authenti-Corp "Iris Recognition Study 2006 (IRIS06)," technical report, version 0.40, report /, Mar. 2007.
[9] P.J. Phillips, P.J. Flynn, T. Scruggs, K.W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. Worek, "Overview of the Face Recognition Grand Challenge," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 947-954, 2005.
[10] P.J. Phillips, P.J. Flynn, W.T. Scruggs, K.W. Bowyer, and W. Worek, "Preliminary Face Recognition Grand Challenge Results," Proc. Seventh Int'l Conf. Automatic Face and Gesture Recognition, pp. 15-24, 2006.
[11] P.J. Phillips, P.J. Grother, R.J. Micheals, D.M. Blackburn, E. Tabassi, and J.M. Bone, "Face Recognition Vendor Test 2002: Evaluation Report," Technical Report NISTIR 6965, Nat'l Inst. of Standards and Technology, http:/, 2003.
[12] P. Grother and E. Tabassi, "Performance of Biometric Quality Measures," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 4, pp. 531-543, Apr. 2007.
[13] G. Passalis, I. Kakadiaris, and T. Theoharis, "Intra-Class Retrieval of Non-Rigid 3D Objects: Application to Face Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 2, pp. 1-11, Feb. 2007.
[14] M. Husken, B. Brauckmann, S. Gehlen, and C. von der Malsburg, "Strategies and Benefits of Fusion of 2D and 3D Face Recognition," Proc. IEEE Workshop Face Recognition Grand Challenge Experiments, P.J. Phillips and K.W. Bowyer, eds., 2005.
[15] P.J. Flynn and P.J. Phillips, "ICE Mining: Quality and Demographic Investigation of ICE 2006 Performance Results," technical report, Nat'l Inst. of Standards and Technology, http:/iris.nist. gov, 2008.
[16] K.W. Bowyer, K. Chang, and P.J. Flynn, "A Survey of Approaches and Challenges in 3D and Multi-Modal 3D+2D Face Recognition," Computer Vision and Image Understanding, vol. 101, no. 1, pp. 1-15, 2006.
[17] P. Grother, R.J. Micheals, and P.J. Phillips, "Face Recognition Vendor Test 2002 Performance Metrics," Proc. Third Int'l Conf. Audio- and Video-Based Biometric Person Authentication, J. Kittler and M.S. Nixon, eds., pp. 937-945, 2003.
[18] A.J. Mansfield and J.L. Wayman, "Best Practices in Testing and Reporting Performance of Biometric Devices. Version 2.1," technical report, Nat'l Physical Laboratory, uk/site/ast/biometrics/ mediaBestPractice.pdf, 2002.
[19] A.J. O'Toole, P.J. Phillips, F. Jiang, J. Ayyad, N. Pénard, and H. Abdi, "Face Recognition Algorithms Surpass Humans Matching Faces across Changes in Illumination," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 9, pp. 1642-1646, Sept. 2007.
[20] R.M. McCabe, "Best Practice Recommendation for the Capture of Mugshots Version 2.0," face.html, 1997.
[21] E.M. Newton and P.J. Phillips, "Meta-Analysis of Third-Party Evaluations of Iris Recognition," IEEE Trans. Systems, Man, and Cybernetics, Part A: Systems and Humans, vol. 39, no. 1, pp. 4-11, Jan. 2009.
[22] P.J.B. Hancock, V. Bruce, and A.M. Burton, "Recognition of Unfamiliar Faces," Trends in Cognitive Sciences, vol. 4, pp. 330-337, 2000.
[23] J.R. Beveridge, D. Bolme, B.A. Draper, and M. Teixera, "The CSU Face Identification Evaluation System," Machine Vision and Applications, vol. 16, no. 2, pp. 128-138, 2005.
[24] J.R. Beveridge, G.H. Givens, P.J. Phillips, B.A. Draper, and Y.M. Lui, "Focus on Quality, Predicting FRVT 2006 Performance," Proc. Eighth Int'l Conf. Automatic Face and Gesture Recognition, 2008.
[25] M. Turk and A. Pentland, "Eigenfaces for Recognition," J. Cognitive Neuroscience, vol. 3, no. 1, pp. 71-86, 1991.
[26] H. Moon and P.J. Phillips, "Computational and Performance Aspects of PCA-Based Face-Recognition Algorithms," Perception, vol. 30, pp. 303-321, 2001.
[27] L. Wiskott, J.-M. Fellous, N. Kruger, and C. von der Malsburg, "Face Recognition by Elastic Bunch Graph Matching," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 7, pp. 775-779, July 1997.
[28] K. Okada, J. Steffens, T. Maurer, H. Hong, E. Elagin, H. Neven, and C. von der Malsburg, "The Bochum/USC Face Recognition System," Face Recognition: From Theory to Applications, H. Wechsler, P.J. Phillips, V. Bruce, F.F. Soulie, and T.S. Huang, eds., pp. 186-205, Springer-Verlag, 1998.
[29] M.J. Crawley, Statistical Computing. Wiley, 2002.

Index Terms:
Ice,Large-scale systems,Face recognition,Image recognition,Iris,Lighting,Image sensors,Humans,Testing,Waveguide discontinuities,human performance.,Biometrics,face recognition,iris recognition,evaluations
"FRVT 2006 and ICE 2006 Large-Scale Experimental Results," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 32, no. 5, pp. 1-1, May 2010, doi:10.1109/TPAMI.2009.59
Usage of this product signifies your acceptance of the Terms of Use.