The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.08 - August (2008 vol.30)
pp: 1346-1357
ABSTRACT
Face recognition based on 3D surface matching is promising for overcoming some of the limitations of current 2D image-based face recognition systems. The 3D shape is generally invariant to the pose and lighting changes, but not invariant to the non-rigid facial movement, such as expressions. Collecting and storing multiple templates to account for various expressions for each subject in a large database is not practical. We propose a facial surface modeling and matching scheme to match 2.5D facial scans in the presence of both non-rigid deformations and pose changes (multiview) to a 3D face template. A hierarchical geodesic-based resampling approach is applied to extract landmarks for modeling facial surface deformations. We are able to synthesize the deformation learned from a small group of subjects (control group) onto a 3D neutral model (not in the control group), resulting in a deformed template. A user-specific (3D) deformable model is built by combining the templates with synthesized deformations. The matching distance is computed by fitting this generative deformable model to a test scan. A fully automatic and prototypic 3D face matching system has been developed. Experimental results demonstrate that the proposed deformation modeling scheme increases the 3D face matching accuracy.
INDEX TERMS
Face and gesture recognition, Range data
CITATION
Xiaoguang Lu, Anil Jain, "Deformation Modeling for Robust 3D Face Matching", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.30, no. 8, pp. 1346-1357, August 2008, doi:10.1109/TPAMI.2007.70784
REFERENCES
[1] W. Zhao, R. Chellappa, P.J. Phillips, and A. Rosenfeld, “Face Recognition: A Literature Survey,” ACM Computing Surveys, vol. 35, no. 4, pp. 399-458, 2003.
[2] Handbook of Face Recognition, S. Li and A. Jain, eds. Springer, 2005.
[3] P.J. Phillips, P. Grother, R.J Micheals, D.M. Blackburn, E. Tabassi, and J.M. Bone, “FRVT 2002: Evaluation Report,” http://people.cs.uchicago.edu/~pff/segment/ http://www.frvt.org/FRVT2002documents.htm , Mar. 2003
[4] K.W. Bowyer, K. Chang, and P.J. Flynn, “A Survey of Approaches and Challenges in 3D and Multi-Modal 3D+2D Face Recognition,” Computer Vision and Image Understanding, vol. 101, no. 1, pp. 1-15, 2006.
[5] J. Lee and E. Milios, “Matching Range Images of Human Faces,” Proc. Third Int'l Conf. Computer Vision (ICCV '90), pp. 722-726, 1990.
[6] G. Gordon, “Face Recognition Based on Depth and Curvature Features,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition (CVPR '92), pp. 108-110, 1992.
[7] H. Tanaka, M. Ikeda, and H. Chiaki, “Curvature-Based Face Surface Recognition Using Spherical Correlation,” Proc. Third IEEE Int'l Conf. Automatic Face and Gesture Recognition (AFGR '98), pp. 372-377, 1998.
[8] C. Beumier and M. Acheroy, “Automatic 3D Face Authentication,” Image and Vision Computing, vol. 18, no. 4, pp. 315-321, 2000.
[9] G. Pan, Z. Wu, and Y. Pan, “Automatic 3D Face Verification from Range Data,” Proc. Int'l Conf. Acoustics, Speech, and Signal Processing (ICASSP '03), vol. 3, pp. 193-196, 2003.
[10] K.I. Chang, K.W. Bowyer, and P.J. Flynn, “Multi-Modal 2D and 3D Biometrics for Face Recognition,” Proc. IEEE Workshop Analysis and Modeling of Faces and Gestures (AMFG '03), pp. 187-194, Oct. 2003.
[11] X. Lu, A.K. Jain, and D. Colbry, “Matching 2.5D Face Scans to 3D Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 1, pp. 31-43, Jan. 2006.
[12] C. Chua, F. Han, and Y. Ho, “3D Human Face Recognition Using Point Signature,” Proc. Fourth IEEE Int'l Conf. Automatic Face and Gesture Recognition (AFGR '00), pp. 233-238, Mar. 2000.
[13] K.I. Chang, K.W. Bowyer, and P.J. Flynn, “Multiple Nose Region Matching for 3D Face Recognition under Varying Facial Expression,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 10, pp. 1695-1700, Oct. 2006.
[14] A.M. Bronstein, M.M. Bronstein, and R. Kimmel, “Expression-Invariant 3D Face Recognition,” Proc. Fourth Int'l Conf. Audio- and Video-Based Biometric Person Authentication (AVBPA '03), pp. 62-70, 2003.
[15] A.M. Bronstein, M.M. Bronstein, and R. Kimmel, “Three-Dimensional Face Recognition,” Int'l J. Computer Vision, vol. 64, no. 1, pp.5-30, 2005.
[16] G. Passalis, I.A. Kakadiaris, T. Theoharis, G. Toderici, and N. Murtuza, “Evaluation of the UR3D Algorithm Using the FRGC v2 Data Set,” Proc. IEEE Workshop Face Recognition Grand Challenge Experiments (FRGC '05), June 2005.
[17] I.A. Kakadiaris, G. Passalis, G. Toderici, M.N. Murtuza, Y. Lu, N. Karampatziakis, and T. Theoharis, “Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 4, pp. 640-649, Apr. 2007.
[18] P. Phillips, P. Flynn, T. Scruggs, K. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. Worek, “Overview of the Face Recognition Grand Challenge,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition (CVPR '05), pp. 947-954, 2005.
[19] T.F. Cootes, G.J. Edwards, and C.J. Taylor, “Active Appearance Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 681-685, June 2001.
[20] V. Blanz and T. Vetter, “Face Recognition Based on Fitting a 3D Morphable Model,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 9, pp. 1063-1074, Sept. 2003.
[21] R. Gross, I. Matthews, and S. Baker, “Generic vs. Person Specific Active Appearance Models,” Image and Vision Computing, vol. 23, no. 11, pp. 1080-1093, 2005.
[22] L. Williams, “Performance-Driven Facial Animation,” Proc. ACM SIGGRAPH '90, pp. 235-242, 1990.
[23] F. Pighin, J. Hecker, D. Lischinski, R. Szeliski, and D.H. Salesin, “Synthesizing Realistic Facial Expression from Photographs,” Proc. ACM SIGGRAPH '98, pp. 75-84, 1998.
[24] J. Noh and U. Neumann, “Expression Cloning,” Proc. ACM SIGGRAPH '01, pp. 277-288, 2001.
[25] R. Sumner and J. Popovic, “Deformation Transfer for Triangle Meshes,” Proc. ACM SIGGRAPH '04, pp. 399-405, Aug. 2004.
[26] F.L. Bookstein, “Principal Warps: Thin-Plate Splines and the Decomposition of Deformations,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, pp. 567-585, 1989.
[27] X. Lu and A.K. Jain, “Automatic Feature Extraction for Multiview 3D Face Recognition,” Proc. Seventh IEEE Int'l Conf. Automatic Face and Gesture Recognition (AFGR '06), pp. 585-590, 2006.
[28] L.G. Farkas, Anthropometry of the Head and Face, second ed. Raven Press, 1994.
[29] R. Kimmel and J.A. Sethian, “Computing Geodesic Paths on Manifolds,” Proc. Nat'l Academy of Sciences, vol. 95, pp. 8431-8435, 1998.
[30] I.L. Dryden and K.V. Mardia, Statistical Shape Analysis. John Wiley & Sons, 1998.
[31] P. Besl and N. McKay, “A Method for Registration of 3-D Shapes,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 239-256, Feb. 1992.
[32] P.E. Gill, W. Murray, and M.H. Wright, Practical Optimization. Academic Press, 1981.
[33] Minolta Vivid 910 Non-Contact 3D Laser Scanner, http://www. minoltausa.comvivid/, 2007.
[34] X. Lu and A.K. Jain, “Deformation Modeling for Robust 3D Face Matching,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition (CVPR '06), pp. 1377-1383, 2006.
26 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool