loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Detecting Faces in Images: A Survey
January 2002 (vol. 24 no. 1)
pp. 34-58

Images containing faces are essential to intelligent vision-based human computer interaction, and research efforts in face processing include face recognition, face tracking, pose estimation, and expression recognition. However, many reported methods assume that the faces in an image or an image sequence have been identified and localized. To build fully automated systems that analyze the information contained in face images, robust and efficient face detection algorithms are required. Given a single image, the goal of face detection is to identify all image regions which contain a face regardless of its three-dimensional position, orientation, and lighting conditions. Such a problem is challenging because faces are nonrigid and have a high degree of variability in size, shape, color, and texture. Numerous techniques have been developed to detect faces in a single image, and the purpose of this paper is to categorize and evaluate these algorithms. We also discuss relevant issues such as data collection, evaluation metrics, and benchmarking. After analyzing these algorithms and identifying their limitations, we conclude with several promising directions for future research.

[1] 34 T. Agui, Y. Kokubo, H. Nagashashi, and T. Nagao, “Extraction of FaceRecognition from Monochromatic Photographs Using Neural Networks,” Proc. Second Int'l Conf. Automation, Robotics, and Computer Vision, vol. 1, pp. 18.8.1-18.8.5, 1992.[2] N. Ahuja, “A Transform for Multiscale Image Segmentation by Integrated Edge and Region Detection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 12, pp. 1211-1235, 1996.[3] Y. Amit, D. Geman, and B. Jedynak, “Efficient Focusing and Face Detection,” Face Recognition: From Theory to Applications, H. Wechsler, P.J. Phillips, V. Bruce, F. Fogelman-Soulie, and T.S. Huang, eds., vol. 163, pp. 124-156, 1998.[4] Y. Amit, D. Geman, and K. Wilder, “Joint Induction of Shape Features and Tree Classifiers,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 11, pp. 1300-1305, Nov. 1997.[5] T.W. Anderson, An Introduction to Multivariate Statistical Analysis. New York: John Wiley, 1984.[6] M.F. Augusteijn and T.L. Skujca, “Identification of Human Faces through Texture-Based Feature Recognition and Neural Network Technology,” Proc. IEEE Conf. Neural Networks, pp. 392-398, 1993.[7] P.N. Belhumeur, J. Hespanda, and D. Kriegeman, Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 711-720, July 1997.[8] O. Bernier, M. Collobert, R. Féraud, V. Lemaire, J.E. Viallet, and D. Collobert, “Multrak: A System for Automatic Multiperson Localization and Tracking in Real-Time,” Proc. Int'l Conf. Image Processing, 1998.[9] C.M. Bishop, Neural Networks for Pattern Recognition. Clarendon Press, 1995.[10] C. Breazeal and B. Scassellati, "A Context-Dependent Attention System for a Social Robot," Proc. 16th Int'l Joint Conf. Artificial Intelligence (IJCAI '99), Morgan Kaufmann, San Francisco, 1999, pp. 1146-1153.[11] L. Breiman, J. Friedman, R. Olshen, and C. Stone, Classification and Regression Trees. Wadsworth, 1984.[12] G. Burel and D. Carel, "Detection and Localization of Faces on Digital Images," Pattern Recognition Letters, Vol. 15, 1994, pp. 963-967.[13] M.C. Burl, T.K. Leung, and P. Perona, “Face Localization via Shape Statistics,” Proc. First Int'l Workshop Automatic Face and Gesture Recognition, pp. 154-159, 1995.[14] J. Cai, A. Goshtasby, and C. Yu, “Detecting Human Faces in Color Images,” Proc. 1998 Int'l Workshop Multi-Media Database Management Systems, pp. 124-131, 1998.[15] J. Canny, “A Computational Approach to Edge Detection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 6, pp. 679-698, June 1986.[16] A. Carleson, C. Cumby, J. Rosen, and D. Roth, “The SNoW Learning Architecture,” Technical Report UIUCDCS-R-99-2101, Univ. of Illinois at Urbana-Champaign Computer Science Dept., 1999.[17] D. Chai and K.N. Ngan, “Locating Facial Region of a Head-and-Shoulders Color Image,” Proc. Third Int'l Conf. Automatic Face and Gesture Recognition, pp. 124-129, 1998.[18] R. Chellappa, C. Wilson, and S. Sirohey, "Human and Machine Recognition of Faces: A Survey," Proc. IEEE, vol. 83, no. 5, pp. 705-740, 1995.[19] Q. Chen, H. Wu, and M. Yachida, "Face Detection by Fuzzy Pattern Matching," Int'l Conf. Computer Vision, 1995, pp. 591-596.[20] D. Chetverikov and A. Lerch, “Multiresolution Face Detection,” Theoretical Foundations of Computer Vision, vol. 69, pp. 131-140, 1993.[21] K. Cho, P. Meer, and J. Cabrera,“Performance Assessment through Bootstrap,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 11, pp. 1,185-1,198, Nov. 1997.[22] S.Y. Lee and F. Hsu, “Spatial Reasoning and Similarity Retrieval of Images using 2D C-Strings Knowledge Representation,” Pattern Recognition, vol. 25, no. 3, pp. 305-318, 1992.[23] M. Collobert, R. Féraud, G.L. Tourneur, O. Bernier, J.E. Viallet, Y. Mahieux, and D. Collobert, “LISTEN: A System for Locating and Tracking Individual Speakers,” Proc. Second Int'l Conf. Automatic Face and Gesture Recognition, pp. 283-288, 1996.[24] A.J. Colmenarez and T.S. Huang, Face Detection with Information-Based Maximum Discrimination Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 782-787, 1997.[25] T.F. Cootes and C.J. Taylor, “Locating Faces Using Statistical Feature Detectors,” Proc. Second Int'l Conf. Automatic Face and Gesture Recognition, pp. 204-209, 1996.[26] T.M. Cover and J.A. Thomas, Elements of Information Theory. John Wiley&Sons, 1991.[27] I. Craw,H. Ellis,, and J.R. Lishman,”, Automatic extraction of face-features,” Pattern Recognition Letters, vol. 5, pp. 183-187, Feb. 1987.[28] I. Craw, D. Tock, and A. Bennet, “Finding Face Features,” Proc. Int'l Conf. Computer Vision, pp. 92-96, 1992.[29] J.L. Crowley and J.M. Bedrune, “Integration and Control of Reactive Visual Processes,” Proc. Third European Conf. Computer Vision, vol. 2, pp. 47-58, 1994.[30] J.L. Crowley and F. Beard, “Multimodal Tracking of Faces for Video Communications,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 640-645, 1997.[31] Y. Dai and Y. Nakano, “Extraction for Facial Images from Complex Background Using Color Information and SGLD Matrices,” Proc. First Int'l Workshop Automatic Face and Gesture Recognition, pp. 238-242, 1995.[32] Y. Dai and Y. Nakano, “Face-Texture Model Based on SGLD and Its Application in Face Detection in a Color Scene,” Pattern Recognition, vol. 29, no. 6, pp. 1007-1017, 1996.[33] T. Darrell, G. Gordon, M. Harville, and J. Woodfill, “Integrated Person Tracking Using Stereo, Color, and Pattern Detection,” Int'l J. Computer Vision, vol. 37, no. 2, pp. 175-185, 2000.[34] A. Dempster, “A Generalization of Bayesian Theory,” J. Royal Statistical Soc., vol. 30, pp. 205-247, 1978.[35] G. Donato, M.S. Bartlett, J.C. Hager, P. Ekman, and T.J. Sejnowski, “Classifying Facial Actions,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 10, pp. 974-989, Oct. 1999.[36] R.O. Duda and P.E. Hart, Pattern Classification and Scene Analysis. New York: John Wiley, 1973.[37] R. Duda, P. Hart, and D. Stork, Pattern Classification. New York: John Wiley&Sons, 2001.[38] N. Duta and A.K. Jain, “Learning the Human Face Concept from Black and White Pictures,” Proc. Int'l Conf. Pattern Recognition, pp. 1365-1367, 1998.[39] G.J. Edwards, C.J. Taylor, and T. Cootes, “Learning to Identify and Track Faces in Image Sequences.” Proc. Sixth IEEE Int'l Conf. Computer Vision, pp. 317-322, 1998.[40] I. Essa and A. Pentland, "Facial Expression Recognition Using a Dynamic Model and Motion Energy," Proc. Int'l Conf. Computer Vision, pp. 360-367,Cambridge, Mass., 1995.[41] S.E. Fahlman and C. Lebiere, "The Cascade-Correlation Learning Architecture," in Advances in Neural Information Processing Systems 2, D.S. Touretzky, ed., Morgan Kaufmann, San Mateo, Calif., 1990, pp. 524-532.[42] R. Féraud, “PCA, Neural Networks and Estimation for Face Detection,” Face Recognition: From Theory to Applications, H. Wechsler, P.J. Phillips, V. Bruce, F. Fogelman-Soulie, and T.S. Huang, eds., vol. 163, pp. 424-432, 1998.[43] R. Féraud and O. Bernier, “Ensemble and Modular Approaches for Face Detection: A Comparison,” Neural Information Processing System, vol. 10, Dec. 1997.[44] R. Féraud, O.J. Bernier, J.-E. Viallet, and M. Collobert, “A Fast and Accurate Face Detection Based on Neural Network,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 1, pp. 42-53, Jan. 2001.[45] D.A. Forsyth, “A Novel Algorithm for Color Constancy,” Int'l J. Computer Vision, vol. 5, no. 1, pp. 5-36, 1990.[46] B.J. Frey, A. Colmenarez, and T.S. Huang, “Mixtures of Local Subspaces for Face Recognition,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 32-37, 1998.[47] F. Fukunaga and W. Koontz, “Applications of the Karhunen-Loève Expansion to Feature Selection and Ordering,” IEEE Trans. Computers, vol. 19, no. 5, pp. 311-318, 1970.[48] K. Fukunaga, Introduction to Statistical Pattern Recognition, second edition. Academic Press, 1990.[49] Z. Ghahramani and G.E. Hinton, “The EM Algorithm for Mixtures of Factor Analyzers,” Technical Report CRG-TR-96-1, Dept. Computer Science, Univ. of Toronto, 1996.[50] R.C. Gonzales and P. Wintz, Digital Image Processing, second edition, pp. 146-152. Addison Wesley, 1987.[51] V. Govindaraju, “Locating Human Faces in Photographs,” Int'l J. Computer Vision, vol. 19, no. 2 pp. 129-146, Aug. 1996.[52] V. Govindaraju, D.B. Sher, R. Srihari, and S.N. Srihari, "Locating Human Faces in Newspaper Photographs," Proc. CVPR 89, pp. 549-554, 1989.[53] J.M. Schneider, L.F. Mackert, G. Zorntlein, R.J. Velthuys, and U. Bar, “An Integrated Environment for Developing Communication Protocols,” Computer Networks and ISDN Systems, vol. 25, no. 1, pp. 43–61, Aug. 1992.[54] H.P. Graf, T. Chen, E. Petajan, and E. Cosatto, “Locating Faces and Facial Parts,” Proc. First Int'l Workshop Automatic Face and Gesture Recognition, pp. 41-46, 1995.[55] H.P. Graf, E. Cosatto, D. Gibbon, M. Kocheisen, and E. Petajan, "Multi-Modal System for Locating Heads and Faces," Proc. Int'l Conf. Automatic Face and Gesture Recognition,Killington, Vt., pp. 88-93, Oct. 1996.[56] D.B. Graham and N.M. Allinson, “Characterizing Virtual Eigensignatures for General Purpose Face Recognition,” Face Recognition: From Theory to Applications, H. Wechsler, P.J. Phillips, V. Bruce, F. Fogelman-Soulie, and T.S. Huang, eds., vol. 163, pp. 446-456, 1998.[57] P. Hallinan, “A Deformable Model for Face Recognition Under Arbitrary Lighting Conditions,” PhD thesis, Harvard Univ., 1995.[58] C.-C. Han, H.-Y.M. Liao, K.-C. Yu, and L.-H. Chen, “Fast Face Detection via Morphology-Based Pre-Processing,” Proc. Ninth Int'l Conf. Image Analysis and Processing, pp. 469-476, 1998.[59] R.M. Haralick, K. Shanmugam, and I. Dinstein, “Texture Features for Image Classification,” IEEE Trans. Systems, Man, and Cybernetics, vol. 3, no. 6, pp. 610-621, 1973.[60] M.D. Heath, S. Sarkar, T. Sanocki, and K.W. Bowyer, A Robust Visual Method for Assessing the Relative Performance of Edge-Detection Algorithms IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 12, pp. 1338-1359, Dec. 1997.[61] G.E. Hinton, P. Dayan, and M. Revow, Modeling the Manifolds of Images of Handwritten Digits IEEE Trans. Neural Networks, vol. 8, no. 1, pp. 65-74, Jan. 1997.[62] H. Hotelling, “Analysis of a Complex of Statistical Variables into Principal Components,” J. Educational Psychology, vol. 24, pp. 417-441, pp. 498-520, 1933.[63] K. Hotta, T. Kurita, and T. Mishima, “Scale Invariant Face Detection Method Using Higher-Order Local Autocorrelation Features of Log-Polar Image,” Proc. Third IEEE Int'l Conf. Automatic Face and Gesture Recognition, pp. 70-75, 1998.[64] J. Huang, S. Gutta, and H. Wechsler, “Detection of Human Faces Using Decision Trees,” Proc. Int'l Conf. Automatic Face and Gesture Recognition, pp. 248-252, 1996.[65] D.P. Huttenlocher, G.A. Klanderman, and W.J. Rucklidge, “Comparing Images Using the Hausdorff Distance,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 9, pp. 850-863, Sept. 1993.[66] T. Jebara and A. Pentland, “Parameterized Structure from Motion for 3D Adaptive Feedback Tracking of Faces,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 144-150, June 1997.[67] T. Jebara, K. Russell, and A. Pentland, “Mixtures of Eigenfeatures for Real-Time Structure from Texture,” Proc. IEEE Int'l Conf. Computer Vision, Bombay, India, Jan. 1998.[68] I.T. Jolliffe, Principal Component Analysis. New York: Springer-Verlag, 1986.[69] M.J. Jones and J. M. Rehg, Statistical Color Models with Application to Skin Detection Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1999.[70] P. Juell and R. Marsh, “A Hierarchical Neural Network for Human Face Detection,” Pattern Recognition, vol. 29, no. 5, pp. 781-787, 1996.[71] T. Kanade, “Picture Processing by Computer Complex and Recognition of Human Faces,” PhD thesis, Kyoto Univ., 1973.[72] K. Karhunen, “Uber Lineare Methoden in der Wahrscheinlichkeitsrechnung,” Annales Academiae Sciientiarum Fennicae, Series AI: Mathematica-Physica, vol. 37, pp. 3-79, 1946. (Translated by RAND Corp., Santa Monica, Calif., Report T-131, Aug. 1960).[73] M. Kass, A. Witkin, and D. Terzopoulos, “Snakes: Active Contour Models,” Proc. First IEEE Int'l Conf. Computer Vision, pp. 259-269, 1987.[74] R. Kauth, A. Pentland, and G. Thomas, “Blob: An Unsupervised Clustering Approach to Spatial Preprocessing of MSS Imagery,” Proc. 11th Int'l Symp. Remote Sensing of the Environment, pp. 1309-1317, 1977.[75] D.G. Kendall, “Shape Manifolds, Procrustean Metrics, and Complex Projective Shapes,” Bull. London Math. Soc., vol. 16, pp. 81-121, 1984.[76] C. Kervrann, F. Davoine, P. Perez, H. Li, R. Forchheimer, and C. Labit, “Generalized Likelihood Ratio-Based Face Detection and Extraction of Mouth Features,” Proc. First Int'l Conf. Audio- and Video-Based Biometric Person Authentication, pp. 27-34, 1997.[77] S.-H. Kim, N.-K. Kim, S.C. Ahn, and H.-G. Kim, Object Oriented Face Detection Using Range and Color Information Proc. Int'l Conf. Automatic Face and Gesture Recognition, pp. 76-81, 1998.[78] M. Kirby and L. Sirovich,“Application of Karhunen-Loève procedure for the characterization of human faces,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 1, pp. 103-108, Jan. 1990.[79] R. Kjeldsen and J. Kender, "Finding Skin in Color Images," Proc. Int'l Conf. Automatic Face and Gesture Recognition,Killington, Vt., pp. 312-317, Oct. 1996.[80] T. Kohonen, "Self-Organization and Associated Memory," Berlin Heidelberg. New York: Springer-Verlag, 1988.[81] C. Kotropoulos and I. Pitas, “Rule-Based Face Detection in Frontal Views,” Proc. Int'l Conf. Acoustics, Speech and Signal Processing, vol. 4, pp. 2537-2540, 1997.[82] C. Kotropoulos, A. Tefas, and I. Pitas, “Frontal Face Authentication Uing Variants of Dynamic Link Matching Based on Mathematical Morphology,” Proc. IEEE Int'l Conf. Image Processing, pp. 122-126, 1998.[83] M.A. Kramer, “Nonlinear Principal Component Analysis Using Autoassociative Neural Networks,” Am. Inst. Chemical Eng. J., vol. 37, no. 2, pp. 233-243, 1991.[84] Y.H. Kwon and N. da Vitoria Lobo, "Face Detection Using Templates," ICPR'94, pp. 764-767, 1994.[85] K. Lam and H. Yan, “Fast Algorithm for Locating Head Boundaries,” J. Electronic Imaging, vol. 3, no. 4, pp. 351-359, 1994.[86] A. Lanitis, C.J. Taylor, and T.F. Cootes, “An Automatic Face Identification System Using Flexible Appearance Models,” Image and Vision Computing, vol. 13, no. 5, pp. 393-401, 1995.[87] T. Leung, M. Burl, and P. Perona, "Finding Faces in Cluttered Scenes Using Labeled Random Graph Matching," Int'l Conf. Computer Vision, 1995, pp. 637-644.[88] T.K. Leung, M.C. Burl, and P. Perona, “Probabilistic Affine Invariants for Recognition,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 678-684, 1998.[89] M.S. Lew, “Information Theoretic View-Based and Modular Face Detection,” Proc. Second Int'l Conf. Automatic Face and Gesture Recognition, pp. 198-203, 1996.[90] F. Leymarie and M. Levine, "Tracking deformable objects in the plane using an active contour model, IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 6, pp. 617-634, June 1993.[91] S.H. Lin, S.Y. Kung, and L.J. Lin, "Face Recognition/Detection by Probabilistic Decision-Based Neural Network," IEEE Trans. Neural Networks, Special Issue on Artificial Neural Networks and Pattern Recognition, vol. 8, no. 1, Jan. 1997.[92] N. Littlestone, "Learning Quickly When Irrelevant Attributes Abound: A New Linear-Threshold Algorithm," Machine Learning, Vol. 2, No. 4, 1987, pp. 285-318.[93] M.M. Loève, Probability Theory. Princeton, N.J.: Van Nostrand, 1955.[94] A.C. Loui, C.N. Judice, and S. Liu, “An Image Database for Benchmarking of Automatic Face Detection and Recognition Algorithms,” Proc. IEEE Int'l Conf. Image Processing, pp. 146-150, 1998.[95] K.V. Mardia and I.L. Dryden, “Shape Distributions for Landmark Data,” Advanced Applied Probability, vol. 21, pp. 742-755, 1989.[96] A. Martinez and R. Benavente, “The AR Face Database,” Technical Report CVC 24, Purdue Univ., 1998.[97] A.M. Martinez and A.C. Kak, PCA versus LDA IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 2, pp. 228-233, Feb. 2001.[98] S. McKenna, S. Gong, and Y. Raja, “Modelling Facial Colour and Identity with Gaussian Mixtures,” Pattern Recognition, vol. 31, no. 12, pp. 1883-1892, 1998.[99] S. McKenna, Y. Raja, and S. Gong, “Tracking Colour Objects Using Adaptive Mixture Models,” Image and Vision Computing, vol. 17, nos. 3/4, pp. 223-229, 1998.[100] J. Miao, B. Yin, K. Wang, L. Shen, and X. Chen, “A Hierarchical Multiscale and Multiangle System for Human Face Detection in a Complex Background Using Gravity-Center Template,” Pattern Recognition, vol. 32, no. 7, pp. 1237-1248, 1999.[101] T. Mitchell, Machine Learning, McGraw-Hill, 1997.[102] Y. Miyake, H. Saitoh, H. Yaguchi, and N. Tsukada, “Facial Pattern Detection and Color Correction from Television Picture for Newspaper Printing,” J. Imaging Technology, vol. 16, no. 5, pp. 165-169, 1990.[103] B. Moghaddam and A. Pentland, “Probabilistic Visual Learning for Object Representation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 696-710, July 1997.[104] A.V. Nefian and M. H. HIII, “Face Detection and Recognition Using Hidden Markov Models,” Proc. IEEE Int'l Conf. Image Processing, vol. 1, pp. 141-145, 1998.[105] N. Oliver, F. Bérard, and A. Pentland, “Lafter: Lips and Face Tracking,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition (CVPR `97), June 1997.[106] M. Oren, C. Papageorgiou, P. Sinha, E. Osuna, and T. Poggio, Pedestrian Detection Using Wavelet Templates Proc. Computer Vision and Pattern Recognition, pp. 193-199, June 1997.[107] E. Osuna, R. Freund, and F. Girosi, Training Support Vector Machines: An Application to Face Detection Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 17-19, 1997.[108] C.P. Papageorgiou, M. Oren, and T. Poggio, “A General Framework for Object Detection,” Proc. Int'l Conf. Computer Vision, pp. 555-562, 1998.[109] C. Papageorgiou and T. Poggio, "A Trainable System for Object Detection," Int'l J. Computer Vision, vol. 38, no. 1, June 2000, pp. 15-33.[110] K. Pearson, “On Lines and Planes of Closest Fit to Systems of Points in Space,” Philosophical Magazine, vol. 2, pp. 559-572, 1901.[111] A. Pentland, "Looking at People: Sensing for Ubiquitous and Wearable Computing," IEEE Trans. Pattern Analysis and Machine Intelligence, IEEE CS Press, Los Alamitos, Calif., Jan. 2000, pp. 107-118.[112] A. Pentland, "Perceptual Intelligence," Comm. ACM, vol. 43, no. 3, Mar. 2000, pp. 35-44.[113] A. Pentland and T. Choudhury, “Face Recognition for Smart Environments,” Computer, vol. 33, no. 2, pp. 50-, Feb. 2000.[114] A. Pentland, B. Moghaddam, and Starner, "View-Based and Modular Eigenspaces for Face Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1994, pp. 84-91.[115] P.J. Phillips, H. Moon, and S.A. Rozvi, The FERET Evaluation Methodolody for Face Recognition Algorithms IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 10, pp. 1090-1104, Oct. 2000.[116] S. Pigeon and L. Vandendrope, “The M2VTS Multimodal Face Database,” Proc. First Int'l Conf. Audio- and Video-Based Biometric Person Authentication, 1997.[117] M. Propp and A. Samal, “Artificial Neural Network Architectures for Human Face Detection,” Intelligent Eng. Systems through Artificial Neural Networks, vol. 2, 1992.[118] F. Provost and T. Fawcett, “Robust Classification for Imprecise Environments,” Machine Learning, vol. 42, no. 3, pp. 203-231, 2001.[119] R.J. Qian and T.S. Huang, Object Detection Using Hierarchical MRF and MAP Estimation Proc. Conf. Computer Vision and Pattern Recognition, pp. 186-192, 1997.[120] R.J. Qian, M.I. Sezan, and K.E. Matthews, “A Robust Real-Time Face Tracking Algorithm,” Proc. IEEE Int'l Conf. Image Processing, pp. 131-135, 1998.[121] J.R. Quinlan, C4.5: Programs for Machine Learning,San Mateo, Calif.: Morgan Kaufman, 1992.[122] L.R. Rabiner and B.H. Juang, Fundamentals of Speech Recognition, Prentice Hall, Upper Saddle River, N.J., 1993.[123] A. Rajagopalan, K. Kumar, J. Karlekar, R. Manivasakan, M. Patil, U. Desai, P. Poonacha, and S. Chaudhuri, “Finding Faces in Photographs,” Proc. Sixth IEEE Int'l Conf. Computer Vision, pp. 640-645, 1998.[124] T. Rikert, M. Jones, and P. Viola, “A Cluster-Based Statistical Model for Object Detection,” Proc. Seventh IEEE Int'l Conf. Computer Vision, vol. 2, pp. 1046-1053, 1999.[125] D. Roth, “Learning to Resolve Natural Language Ambiguities: A Unified Approach,” Proc. 15th Nat'l Conf. Artificial Intelligence, pp. 806-813, 1998.[126] H. Rowley, S. Baluja, and T. Kanade, “Human Face Detection in Visual Scenes,” Advances in Neural Information Processing Systems 8, D.S. Touretzky, M.C. Mozer, and M.E. Hasselmo, eds., pp. 875-881, 1996.[127] H. Rowley, S. Baluja, and T. Kanade, “Neural Network-Based Face Detection,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 203-208, 1996.[128] H. Rowley, S. Baluja, and T. Kanade, "Neural Network-Based Face Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 1, Jan. 1998, pp. 23-38.[129] H.A. Rowley, S. Baluja, and T. Kanade, “Rotation Invariant Neural Network-Based Face Detection,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1998.[130] H.A. Rowley, “Neural Network-Based Face Detection,” PhD thesis, Carnegie Mellon Univ., 1999.[131] E. Saber and A.M. Tekalp, “Frontal-View Face Detection and Facial Feature Extraction Using Color, Shape and Symmetry Based Cost Functions,” Pattern Recognition Letters, vol. 19, pp. 669-680, 1998.[132] T. Sakai, M. Nagao, and S. Fujibayashi, “Line Extraction and Pattern Detection in a Photograph,” Pattern Recognition, vol. 1, pp. 233-248, 1969.[133] A. Samal and P.A. Iyengar,“Automatic recognition and analysis of human faces and facial expressions: A survey,” Pattern Recognition, vol. 25, no. 1, pp. 65-77, 1992.[134] A. Samal and P.A. Iyengar, “Human Face Detection Using Silhouettes,” Int'l J. Pattern Recognition and Artificial Intelligence, vol. 9, no. 6, pp. 845-867, 1995.[135] F. Samaria and S. Young, “HMM Based Architecture for Face Identification,” Image and Vision Computing, vol. 12, pp. 537-583, 1994.[136] F.S. Samaria, “Face Recognition Using Hidden Markov Models,” PhD thesis, Univ. of Cambridge, 1994.[137] S. Satoh, Y. Nakamura, and T. Kanade, "Name-It: Naming and Detecting Faces in News Videos," IEEE MultiMedia, vol. 6, no. 1, Jan.-Mar. 1999, pp. 22-35.[138] D. Saxe and R. Foulds, Toward Robust Skin Identification in Video Images Proc. Int'l Conf. Automatic Face and Gesture Recognition, pp. 379-384, 1996.[139] B. Scassellati, “Eye Finding via Face Detection for a Foevated, Active Vision System,” Proc. 15th Nat'l Conf. Artificial Intelligence, 1998.[140] H. Schneiderman and T. Kanade, “Probabalistic Modeling of Local Appearance and Spatial Relationships for Object Recognition,” IEEE Conf. Computer Vision and Pattern Recognition, pp. 45-51, 1998.[141] H. Schneiderman and T. Kanade, "A Statistical Method for 3D Object Detection Applied to Faces and Cars," Proc. IEEE Computer Vision and Pattern Recognition (CVPR 00), IEEE CS Press, 2000, pp. 746—751.[142] J.A. Shufelt, “Performance Evaluation and Analysis of Monocular Building Extraction,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 4, pp. 311-326, Apr. 1997.[143] P. Sinha, “Object Recognition via Image Invariants: A Case Study,” Investigative Ophthalmology and Visual Science, vol. 35, no. 4, pp. 1735-1740, 1994.[144] P. Sinha, “Processing and Recognizing 3D Forms,” PhD thesis, Massachusetts Inst. of Tech nology, 1995.[145] S.A. Sirohey, “Human Face Segmentation and Identification,” Technical Report CS-TR-3176, Univ. of Maryland, 1993.[146] J. Sobottka and I. Pitas, “Segmentation and Tracking of Faces in Color Images,” Proc. Second Int'l Conf. Automatic Face and Gesture Recognition, pp. 236-241, 1996.[147] K. Sobottka and I. Pitas, “Face Localization and Feature Extraction Based on Shape and Color Information,” Proc. IEEE Int'l Conf. Image Processing, pp. 483-486, 1996.[148] F. Soulie, E. Viennet, and B. Lamy, “Multi-Modular Neural Network Architectures: Pattern Recognition Applications in Optical Character Recognition and Human Face Recognition,” Int'l J. Pattern Recognition and Artificial Intelligence, vol. 7, no. 4, pp. 721-755, 1993.[149] T. Starner and A. Pentland, “Real-Time ASL Recognition from Video Using HMM's,” Technical Report 375, Media Lab, Massachusetts Inst. of Tech nology, 1996.[150] Y. Sumi and Y. Ohta, “Detection of Face Orientation and Facial Components Using Distributed Appearance Modeling,” Proc. First Int'l Workshop Automatic Face and Gesture Recognition, pp. 254-259, 1995.[151] Q.B. Sun, W.M. Huang, and J.K. Wu, Face Detection Based on Color and Local Symmetry Information Proc. Third Int'l Conf. Face and Gesture Recognition, pp. 130-135, 1998.[152] K. Sung, Learning and Example Selection for Object and Pattern Detection, PhD thesis, MIT AI Lab and Center for Biological and Computational Learning, 1995.[153] K. Sung and T. Poggio, Example-Based Learning for View-Based Human Face Detection, A.I. Memo 1521, C.B.C.L Paper 112, Dec. 1994.[154] K.K. Sung and T. Poggio, "Example-Based Learning for View-Based Human Face Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 1, pp. 39-50, Jan. 1998.[155] M.J. Swain and B.H. Ballard, “Color Indexing,” Int'l J. Computer Vision, vol. 7, no. 1, pp. 11-32, 1991.[156] D.L. Swets and J. Weng, Using Discriminant Eigenfeatures for Image Retrieval IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 8, pp. 831-836, Aug. 1996.[157] B. Takacs and H. Wechsler, “Face Location Using a Dynamic Model of Retinal Feature Extraction,” Proc. First Int'l Workshop Automatic Face and Gesture Recognition, pp. 243-247, 1995.[158] A. Tefas, C. Kotropoulos, and I. Pitas, “Variants of Dynamic Link Architecture Based on Mathematical Morphology for Frontal Face Authentication,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 814-819, 1998.[159] J.C. Terrillon, M. David, and S. Akamatsu, “Automatic Detection of Human Faces in Natural Scene Images by Use of a Skin Color Model of Invariant Moments” Proc. Int'l Conf. Automatic Face and Gesture Recognition, pp. 112-117, 1998.[160] J.C. Terrillon, M. David, and S. Akamatsu, “Detection of Human Faces in Complex Scene Images by Use of a Skin Color Model and Invariant Fourier-Mellin Moments,” Proc. Int'l Conf. Pattern Recognition, pp. 1350-1355, 1998.[161] A. Tsukamoto, C.-W. Lee, and S. Tsuji, “Detection and Tracking of Human Face with Synthesized Templates,” Proc. First Asian Conf. Computer Vision, pp. 183-186, 1993.[162] A. Tsukamoto, C. Lee, and S. Tsuji, "Detection and Pose Estimation of Human Faces with Synthesized Image Models," Proc. 12th Int'l Conf. Pattern Recognition, vol. 1, pp. 754-757.Los Alamitos, Calif.: IEEE CS Press, 1994.[163] M. Turk and A. Pentland, “Eigenfaces for Recognition,” J. Cognitive Neuroscience, vol. 3, no. 1, pp. 71-86, 1991.[164] R. Vaillant, C. Monrocq, and Y. Le Cun, Original Approach for the Localisation of Objects in Images IEEE Proc. Visual Image Signal Process., vol. 141, no. 4, Aug. 1994.[165] M. Venkatraman and V. Govindaraju, “Zero-Crossings of a Nonorthogonal Wavelet Transform for Complex Object Location,” Proc. Int’l Conf. on Image Processing , IEEE Signal Processing Society, to appear in Oct. 1995. [166] A. Waibel,T. Hanazawa,G. Hinton,K. Shikano,, and K. Lang,“Phoneme recognition using time-delay neural networks,” IEEE Trans. ASSP, vol. 37, no. 3, Mar. 1989.[167] H. Wang and S.-F. Chang, “A Highly Efficient System for Automatic Face Region Detection in MPEG Video,” IEEE Trans. Circuits and Systems for Video Technology, vol. 7, no. 4, pp. 615-628, 1997.[168] H. Wu, Q. Chen, and M. Yachida, “Face Detection from Color Images Using a Fuzzy Pattern Matching Method,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 6, pp. 557-563, June 1999.[169] H. Wu, T. Yokoyama, D. Pramadihanto, and M. Yachida, “Face and Facial Feature Extraction from Color Image,” Proc. Int'l Conf. Automatic Face and Gesture Recognition, pp. 345-350, 1996.[170] G. Yang and T. S. Huang, “Human Face Detection in Complex Background,” Pattern Recognition, vol. 27, no. 1, pp. 53-63, 1994.[171] J. Yang, R. Stiefelhagen, U. Meier, and A. Waibel, “Visual Tracking for Multimodal Human Computer Interaction,” Proc. ACM Human Factors in Computing Systems Conf. (CHI 98), pp. 140-147, 1998.[172] J. Yang and A. Waibel, “A Real-Time Face Tracker,” Workshop Applications of Computer Vision, pp. pp. 142-147, 1996.[173] M.-H. Yang and N. Ahuja, ”Detecting Human Faces in Color Images,” Proc. IEEE Int'l Conf. Image Processing, pp. 127-139, Oct. 1998.[174] M.-H. Yang and N. Ahuja, “Gaussian Mixture Model for Human Skin Color and Its Application in Image and Video Databases,” Proc. SPIE: Storage and Retrieval for Image and Video Databases VII, vol. 3656, pp. 458-466, 1999.[175] M.H. Yang, N. Ahuja, and D. Kriegman, Face Detection Using Mixtures of Linear Subspaces Proc. Fifth Int'l Conf. Automatic Face and Gesture Recognition, pp. 70-76, 2000.[176] M.-H. Yang, D. Roth, and N. Ahuja, “A SNoW-Based Face Detector,” Advances in Neural Information Processing Systems 12, S.A. Solla, T. K. Leen, and K.-R. Müller, eds., pp. 855-861, MIT Press, 2000.[177] K.C. Yow and R. Cipolla, “A Probabilistic Framework for Perceptual Grouping of Features for Human Face Detection,” Proc. Second Int'l Conf. Automatic Face and Gesture Recognition, pp. 16-21, 1996.[178] K.C. Yow and R. Cipolla, “Feature-Based Human Face Detection,” Image and Vision Computing, vol. 15, no. 9, pp. 713-735, 1997.[179] K.C. Yow and R. Cipolla, “Enhancing Human Face Detection Using Motion and Active Contours,” Proc. Third Asian Conf. Computer Vision, pp. 515-522, 1998.[180] A.L. Yuille, P.W. Hallinan, and D.S. Cohen, "Feature extraction from faces using deformable templates," Int'l J. Computer Vision, vol. 8, no. 2, 133-144, 1992.[181] W. Zhao, R. Chellappa, and A. Krishnaswamy, “Discriminant Analysis of Principal Components for Face Recognition,” Proc. Third Int'l Conf. Automatic Face and Gesture Recognition, pp. 336-341, 1998.

Index Terms:
Face detection, face recognition, object recognition, view-based recognition, statistical pattern recognition, machine learning.
Citation:
Ming-Hsuan Yang, David J. Kriegman, Narendra Ahuja, "Detecting Faces in Images: A Survey," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 1, pp. 34-58, Jan. 2002, doi:10.1109/34.982883
Usage of this product signifies your acceptance of the Terms of Use.