| | This Article | |
| |
| |
| | Share | |
| |
| |
| | Bibliographic References | |
| |
| |
| | Add to: | |
| |
 Digg
 Furl
 Spurl
 Blink
 Simpy
 Google
 Del.icio.us
 Y!MyWeb
| |
| | Search | |
| |
| |
| | |
Face Recognition Based on Fitting a 3D Morphable Model
September 2003 (vol. 25 no. 9)
pp. 1063-1074
Abstract—This paper presents a method for face recognition across variations in pose, ranging from frontal to profile views, and across a wide range of illuminations, including cast shadows and specular reflections. To account for these variations, the algorithm simulates the process of image formation in 3D space, using computer graphics, and it estimates 3D shape and texture of faces from single images. The estimate is achieved by fitting a statistical, morphable model of 3D faces to images. The model is learned from a set of textured 3D scans of heads. We describe the construction of the morphable model, an algorithm to fit the model to images, and a framework for face identification. In this framework, faces are represented by model parameters for 3D shape and texture. We present results obtained with 4,488 images from the publicly available CMU-PIE database and 1,940 images from the FERET database.
[1] 1063 J.J. Atick, P.A. Griffin, and A.N. Redlich, Statistical Approach to Shape from Shading: Reconstruction of 3D Face Surfaces from Single 2D Images Computation in Neurological Systems, vol. 7, no. 1, 1996.[2] J.R. Bergen and R. Hingorani, Hierarchical Motion-Based Frame Rate Conversion technical report, David Sarnoff Research Center, Princeton N.J., 1990.[3] D. Beymer and T. Poggio, “Face Recognition from One Example View,” Proc. Int'l Conf. Computer Vision, pp. 500-507, 1995.[4] D. Beymer and T. Poggio, Image Representations for Visual Learning Science, vol. 272, pp. 1905-1909, 1996.[5] C.M. Bishop, Neural Networks for Pattern Recognition. Clarendon Press, 1995.[6] V. Blanz, Automatische Rekonstruktion der dreidimensionalen Form von Gesichtern aus einem Einzelbild PhD thesis, Tübingen, Germany, 2000.[7] V. Blanz, S. Romdhani, and T. Vetter, Face Identification across Different Poses and Illuminations with a 3D Morphable Model Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition, pp. 202-207, 2002.[8] V. Blanz and T. Vetter, "A Morphable Model for the Synthesis of 3D Faces," Proc. Siggraph 99, ACM Press, 1999, pp. 187-194.[9] P.J. Burt and E.H. Adelson, Merging Images through Pattern Decomposition Proc. Applications of Digital Image Processing VIII, no. 575, pp. 173-181, 1985.[10] C.S. Choi, T. Okazaki, H. Harashima, and T. Takebe, A System of Analyzing and Synthesizing Facial Images Proc. IEEE Int'l Symp. Circuit and Systems (ISCAS '91), pp. 2665-2668, 1991.[11] T. Cootes, K. Walker, and C. Taylor, “View-Based Active Appearance Models,” Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition, pp. 227-232, 2000.[12] R. Duda, P. Hart, and D. Stork, Pattern Classification. New York: John Wiley&Sons, 2001.[13] G.J. Edwards, T.F. Cootes, and C.J. Taylor, “Face Recognition Using Active Appearance Models,” Proc. European Conf. Computer Vision, pp. 582-595, June 1998.[14] J.D. Foley et al., Computer Graphics: Principles and Practice, Second Edition in C, Addison-Wesley, Reading, Mass., 1995.[15] A.S. Georghiades, P.N. Belhumeur, and D.J. Kriegman, From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 643-660, June 2001.[16] D.B. Graham and N.M. Allison, Face Recognition from Unfamiliar Views: Subspace Methods and Pose Dependency Proc. Int'l Conf. Automatic Face and Gesture Recognition, pp. 348-353, 1998.[17] R. Gross, I. Matthews, and S. Baker, Eigen Light-Fields and Face Recognition across Pose Proc. Fifth IEEE Int'l Conf. Face and Gesture Recognition, 2002.[18] P. Hallinan, “A Deformable Model for Face Recognition Under Arbitrary Lighting Conditions,” PhD thesis, Harvard Univ., 1995.[19] R.M. Haralick and L.G. Shapiro, Computer and Robot Vision. New York: Addison-Wesley, 1993.[20] B.K.P. Horn and B.G. Schunck, Determining Optical Flow Artificial Intelligence, vol. 17, pp. 185-203, 1981.[21] T.S. Huang and L.A. Tang, 3D Face Modeling and Its Applications Int'l J. Pattern Recognition and Artificial Intelligence, vol. 10, no. 5, pp. 491-519, 1996.[22] M.J. Jones and T. Poggio, “Multidimensional Morphable Models: A Framework for Representing and Matching Object Classes,” Int'l J. Computer Vision, vol. 2, no. 29, pp. 107-131, 1998.[23] A. Lanitis, C.J. Taylor, and T.F. Cootes, Automatic Face Identification System Using Flexible Appearance Models Image and Vision Computing, vol. 13, no. 5, pp. 393-401, 1995.[24] D.G. Lowe, "Fitting Parameterized Three-Dimensional Models to Images," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 5, pp. 441-450, May 1991.[25] B.D. Lucas and T. Kanade, An Iterative Image Registration Technique with an Application to Stereo Vision Proc. Int'l Joint Conf. Artificial Intelligence, pp. 674-679, 1981.[26] T. Maurer and C. von der Malsburg, Single-View Based Recognition of Faces Rotated in Depth Proc. Int'l Conf. Automatic Face and Gesture Recognition, pp. 248-253, 1995.[27] H. Moon and P.J. Phillips, Computational and Performance Aspects of PCA-Based Face-Recognition Algorithms Perception, vol. 30, pp. 303-321, 2001.[28] A. Pentland, B. Moghaddam, and Starner, "View-Based and Modular Eigenspaces for Face Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1994, pp. 84-91.[29] P.J. Phillips, H. Wechsler, J. Huang, and P. Rauss, The Feret Database and Evaluation Procedure for Face Recognition Algorithms Image and Vision Computing J., vol. 16, no. 5, pp. 295-306, 1998.[30] P.J. Phillips, P. Grother, R.J. Michaels, D.M. Blackburn, E. Tabassi, and M. Bone, Face Recognition Vendor Test 2002: Evaluation Report NISTIR 6965, Nat'l Inst. of Standards and Tech nology, 2003.[31] W.H. Press, S.A. Teukolsky, W.T. Vetterling, and B.P. Flannery, Numerical Recipes in C. Cambridge Univ. Press, 1992.[32] H. Robbins and S. Munroe, A Stochastic Approximation Method Annals of Math. Statistics, vol. 22, pp. 400-407, 1951.[33] T. Sim, S. Baker, and M. Bsat, The CMU Pose, Illumination, and Expression (PIE) Database Proc. Fifth IEEE Int'l Conf. Face and Gesture Recognition, 2002.[34] T. Sim and T. Kanade, Illuminating the Face Technical Report CMU-RI-TR-01-31, The Robotics Inst., Carnegie Mellon Univ., Sept. 2001.[35] T. Vetter and V. Blanz, “Estimating Coloured 3D Face Models from Single Images: An Example-Based Approach,” Proc. European Conf. Computer Vision, pp. 499-513, 1998.[36] T. Vetter and T. Poggio, "Linear Object Classes and Image Synthesis from Single Example Image," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 733-741, July 1997.[37] P.A. Viola, “Alignment by Maximization of Mutual Information,” AI Technical Report No. 1548, MIT Artificial Intelligence Lab., 1995.[38] W. Zhao and R. Chellapa, “SFS Based View Synthesis for Robust Face Recognition,” Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition, pp. 285-292, 2000.[39] W. Zhao, R. Chellappa, A. Rosenfeld, and P. J. Phillips, Face Recognition: A Literature Survey UMD CfAR Technical Report CAR-TR-948, 2000.
Index Terms:
Face recognition, shape estimation, deformable model, 3D faces, pose invariance, illumination invariance.
Citation:
Volker Blanz, Thomas Vetter, "Face Recognition Based on Fitting a 3D Morphable Model," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 9, pp. 1063-1074, Sept. 2003, doi:10.1109/TPAMI.2003.1227983
