This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Deformation Modeling for Robust 3D Face Matching
August 2008 (vol. 30 no. 8)
pp. 1346-1357
Face recognition based on 3D surface matching is promising for overcoming some of the limitations of current 2D image-based face recognition systems. The 3D shape is generally invariant to the pose and lighting changes, but not invariant to the non-rigid facial movement, such as expressions. Collecting and storing multiple templates to account for various expressions for each subject in a large database is not practical. We propose a facial surface modeling and matching scheme to match 2.5D facial scans in the presence of both non-rigid deformations and pose changes (multiview) to a 3D face template. A hierarchical geodesic-based resampling approach is applied to extract landmarks for modeling facial surface deformations. We are able to synthesize the deformation learned from a small group of subjects (control group) onto a 3D neutral model (not in the control group), resulting in a deformed template. A user-specific (3D) deformable model is built by combining the templates with synthesized deformations. The matching distance is computed by fitting this generative deformable model to a test scan. A fully automatic and prototypic 3D face matching system has been developed. Experimental results demonstrate that the proposed deformation modeling scheme increases the 3D face matching accuracy.

[1] W. Zhao, R. Chellappa, P.J. Phillips, and A. Rosenfeld, “Face Recognition: A Literature Survey,” ACM Computing Surveys, vol. 35, no. 4, pp. 399-458, 2003.
[2] Handbook of Face Recognition, S. Li and A. Jain, eds. Springer, 2005.
[3] P.J. Phillips, P. Grother, R.J Micheals, D.M. Blackburn, E. Tabassi, and J.M. Bone, “FRVT 2002: Evaluation Report,” http://people.cs.uchicago.edu/~pff/segment/ http://www.frvt.org/FRVT2002documents.htm , Mar. 2003
[4] K.W. Bowyer, K. Chang, and P.J. Flynn, “A Survey of Approaches and Challenges in 3D and Multi-Modal 3D+2D Face Recognition,” Computer Vision and Image Understanding, vol. 101, no. 1, pp. 1-15, 2006.
[5] J. Lee and E. Milios, “Matching Range Images of Human Faces,” Proc. Third Int'l Conf. Computer Vision (ICCV '90), pp. 722-726, 1990.
[6] G. Gordon, “Face Recognition Based on Depth and Curvature Features,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition (CVPR '92), pp. 108-110, 1992.
[7] H. Tanaka, M. Ikeda, and H. Chiaki, “Curvature-Based Face Surface Recognition Using Spherical Correlation,” Proc. Third IEEE Int'l Conf. Automatic Face and Gesture Recognition (AFGR '98), pp. 372-377, 1998.
[8] C. Beumier and M. Acheroy, “Automatic 3D Face Authentication,” Image and Vision Computing, vol. 18, no. 4, pp. 315-321, 2000.
[9] G. Pan, Z. Wu, and Y. Pan, “Automatic 3D Face Verification from Range Data,” Proc. Int'l Conf. Acoustics, Speech, and Signal Processing (ICASSP '03), vol. 3, pp. 193-196, 2003.
[10] K.I. Chang, K.W. Bowyer, and P.J. Flynn, “Multi-Modal 2D and 3D Biometrics for Face Recognition,” Proc. IEEE Workshop Analysis and Modeling of Faces and Gestures (AMFG '03), pp. 187-194, Oct. 2003.
[11] X. Lu, A.K. Jain, and D. Colbry, “Matching 2.5D Face Scans to 3D Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 1, pp. 31-43, Jan. 2006.
[12] C. Chua, F. Han, and Y. Ho, “3D Human Face Recognition Using Point Signature,” Proc. Fourth IEEE Int'l Conf. Automatic Face and Gesture Recognition (AFGR '00), pp. 233-238, Mar. 2000.
[13] K.I. Chang, K.W. Bowyer, and P.J. Flynn, “Multiple Nose Region Matching for 3D Face Recognition under Varying Facial Expression,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 10, pp. 1695-1700, Oct. 2006.
[14] A.M. Bronstein, M.M. Bronstein, and R. Kimmel, “Expression-Invariant 3D Face Recognition,” Proc. Fourth Int'l Conf. Audio- and Video-Based Biometric Person Authentication (AVBPA '03), pp. 62-70, 2003.
[15] A.M. Bronstein, M.M. Bronstein, and R. Kimmel, “Three-Dimensional Face Recognition,” Int'l J. Computer Vision, vol. 64, no. 1, pp.5-30, 2005.
[16] G. Passalis, I.A. Kakadiaris, T. Theoharis, G. Toderici, and N. Murtuza, “Evaluation of the UR3D Algorithm Using the FRGC v2 Data Set,” Proc. IEEE Workshop Face Recognition Grand Challenge Experiments (FRGC '05), June 2005.
[17] I.A. Kakadiaris, G. Passalis, G. Toderici, M.N. Murtuza, Y. Lu, N. Karampatziakis, and T. Theoharis, “Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 4, pp. 640-649, Apr. 2007.
[18] P. Phillips, P. Flynn, T. Scruggs, K. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. Worek, “Overview of the Face Recognition Grand Challenge,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition (CVPR '05), pp. 947-954, 2005.
[19] T.F. Cootes, G.J. Edwards, and C.J. Taylor, “Active Appearance Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 681-685, June 2001.
[20] V. Blanz and T. Vetter, “Face Recognition Based on Fitting a 3D Morphable Model,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 9, pp. 1063-1074, Sept. 2003.
[21] R. Gross, I. Matthews, and S. Baker, “Generic vs. Person Specific Active Appearance Models,” Image and Vision Computing, vol. 23, no. 11, pp. 1080-1093, 2005.
[22] L. Williams, “Performance-Driven Facial Animation,” Proc. ACM SIGGRAPH '90, pp. 235-242, 1990.
[23] F. Pighin, J. Hecker, D. Lischinski, R. Szeliski, and D.H. Salesin, “Synthesizing Realistic Facial Expression from Photographs,” Proc. ACM SIGGRAPH '98, pp. 75-84, 1998.
[24] J. Noh and U. Neumann, “Expression Cloning,” Proc. ACM SIGGRAPH '01, pp. 277-288, 2001.
[25] R. Sumner and J. Popovic, “Deformation Transfer for Triangle Meshes,” Proc. ACM SIGGRAPH '04, pp. 399-405, Aug. 2004.
[26] F.L. Bookstein, “Principal Warps: Thin-Plate Splines and the Decomposition of Deformations,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, pp. 567-585, 1989.
[27] X. Lu and A.K. Jain, “Automatic Feature Extraction for Multiview 3D Face Recognition,” Proc. Seventh IEEE Int'l Conf. Automatic Face and Gesture Recognition (AFGR '06), pp. 585-590, 2006.
[28] L.G. Farkas, Anthropometry of the Head and Face, second ed. Raven Press, 1994.
[29] R. Kimmel and J.A. Sethian, “Computing Geodesic Paths on Manifolds,” Proc. Nat'l Academy of Sciences, vol. 95, pp. 8431-8435, 1998.
[30] I.L. Dryden and K.V. Mardia, Statistical Shape Analysis. John Wiley & Sons, 1998.
[31] P. Besl and N. McKay, “A Method for Registration of 3-D Shapes,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 239-256, Feb. 1992.
[32] P.E. Gill, W. Murray, and M.H. Wright, Practical Optimization. Academic Press, 1981.
[33] Minolta Vivid 910 Non-Contact 3D Laser Scanner, http://www. minoltausa.comvivid/, 2007.
[34] X. Lu and A.K. Jain, “Deformation Modeling for Robust 3D Face Matching,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition (CVPR '06), pp. 1377-1383, 2006.

Index Terms:
Face and gesture recognition, Range data
Citation:
Xiaoguang Lu, Anil Jain, "Deformation Modeling for Robust 3D Face Matching," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30, no. 8, pp. 1346-1357, Aug. 2008, doi:10.1109/TPAMI.2007.70784
Usage of this product signifies your acceptance of the Terms of Use.