The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.10 - October (2010 vol.32)
pp: 1858-1870
Yueming Wang , The Chinese University of Hong Kong, Hong Kong
Jianzhuang Liu , The Chinese University of Hong Kong, Hong Kong and Chinese Academy of Sciences, Shenzhen
Xiaoou Tang , The Chinese University of Hong Kong, Hong Kong and Chinese Academy of Sciences, Shenzhen
ABSTRACT
This paper proposes a new 3D face recognition approach, Collective Shape Difference Classifier (CSDC), to meet practical application requirements, i.e., high recognition performance, high computational efficiency, and easy implementation. We first present a fast posture alignment method which is self-dependent and avoids the registration between an input face against every face in the gallery. Then, a Signed Shape Difference Map (SSDM) is computed between two aligned 3D faces as a mediate representation for the shape comparison. Based on the SSDMs, three kinds of features are used to encode both the local similarity and the change characteristics between facial shapes. The most discriminative local features are selected optimally by boosting and trained as weak classifiers for assembling three collective strong classifiers, namely, CSDCs with respect to the three kinds of features. Different schemes are designed for verification and identification to pursue high performance in both recognition and computation. The experiments, carried out on FRGC v2 with the standard protocol, yield three verification rates all better than 97.9 percent with the FAR of 0.1 percent and rank-1 recognition rates above 98 percent. Each recognition against a gallery with 1,000 faces only takes about 3.6 seconds. These experimental results demonstrate that our algorithm is not only effective but also time efficient.
INDEX TERMS
3D shape matching, collective shape difference classifier, face recognition, signed shape difference map.
CITATION
Yueming Wang, Jianzhuang Liu, Xiaoou Tang, "Robust 3D Face Recognition by Local Shape Difference Boosting", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.32, no. 10, pp. 1858-1870, October 2010, doi:10.1109/TPAMI.2009.200
REFERENCES
[1] G. Medioni and R. Waupotitsch, "Face Modeling and Recognition in 3-D," Proc. IEEE Int'l Workshop Analysis and Modeling of Faces and Gestures, pp. 232-233, 2003.
[2] W. Zhao, R. Chellappa, P.J. Phillips, and A. Rosenfeld, "Face Recognition: A Literature Survey," ACM Computing Surveys, vol. 35, no. 4, pp. 399-458, 2003.
[3] P.J. Besl and N.D. McKay, "A Method for Registration of 3-D Shapes," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 239-256, Feb. 1992.
[4] A. Scheenstra, A. Ruifrok, and R.C. Veltkamp, "A Survey of 3D Face Recognition Methods," Proc. Int'l Conf. Audio- and Video-Based Biometric Person Authentication, pp. 891-899, 2005.
[5] K. Chang, K.W. Bowyer, and P. Flynn, "Effects on Facial Expression in 3D Face Recognition," Proc. SPIE Conf. Biometric Technology for Human Identification, pp. 132-143, 2005.
[6] K. Chang, K.W. Bowyer, and P. Flynn, "Multiple Nose Region Matching for 3D Face Recognition under Varying Facial Expression," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 10, pp. 1695-1700, Oct. 2006.
[7] K.W. Bowyer, K. Chang, and P. Flynn, "A Survey of Approaches and Challenges in 3D and Multi-Modal 2D+3D Face Recognition," Computer Vision and Image Understanding, vol. 101, no. 1, pp. 1-15, 2006.
[8] T. Nagamine, T. Uemura, and I. Masuda, "3D Facial Image Analysis for Human Identification," Proc. Int'l Conf. Pattern Recognition, pp. 324-327, 1992.
[9] C. Samir, A. Srivastava, and M. Daoudi, "Three-Dimensional Face Recognition Using Shapes of Facial Curves," IEEE Trans. Pattern Analysis and Machine Integlligence, vol. 28, no. 11, pp. 1858-1863, Nov. 2006.
[10] A.B. Moreno, A. Sánchez, J.F. Vélez, and F.J. Díaz, "Face Recognition Using 3D Surface-Extracted Descriptors," Proc. Irish Machine Vision and Image Processing Conf., 2003.
[11] S. Gupta, J.K. Aggatwal, M.K. Markey, and A.C. Bovik, "3D Face Recognition Founded on the Structural Diversity of Human Faces," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[12] Y. Wang, G. Pan, Z. Wu, and Y. Wang, "Exploring Facial Expression Effects in 3D Face Recognition Using Partial ICP," Proc. Asian Conf. Computer Vision, vol. 3851, pp. 581-590, 2006.
[13] X. Lu, A.K. Jain, and D. Colbry, "Matching 2.5D Face Scans to 3D Models," IEEE Trans. Pattern Analysis and Machine Integlligence, vol. 28, no. 1, pp. 31-43, Jan. 2006.
[14] G.G. Gordon, "Face Recognition Based on Depth and Curvature Features," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 808-810, 1992.
[15] H.T. Tanaka, M. Ikeda, and H. Chiaki, "Curvature-Based Face Surface Recognition Using Spherical Correlation—Principal Directions for Curved Object Recognition," Proc. Int'l Conf. Automatic Face and Gesture Recognition, pp. 372-377, 1998.
[16] B. Achermann and H. Bunke, "Classifying Range Images of Human Faces with Hausdorff Distance," Proc. Int'l Conf. Pattern Recognition, pp. 809-813, 2000.
[17] B. Achermann, X. Jiang, and H. Bunke, "Face Recognition Using Range Images," Proc. Int'l Conf. Virtual Systems and MultiMedia, pp. 129-136, 1997.
[18] C. Hesher, A. Srivastava, and G. Erlebacher, "A Novel Technique for Face Recognition Using Range Imaging," Proc. Int'l Symp. Signal Processing and Its Applications, pp. 201-204, 2003.
[19] Y. Lee and J. Shim, "Curvature-Based Human Face Recognition Using Depth-Weighted Hausdorff Distance," Proc. Int'l Conf. Image Processing, pp. 1429-1432, 2004.
[20] T.D. Russ, M.W. Koch, and C.Q. Little, "A 2D Range Hausdorff Approach for 3D Face Recognition," Proc. IEEE Workshop Face Recognition Grand Challenge Experiments, 2005.
[21] X. Lu and A.K. Jain, "Deformation Modeling for Robust 3D Race Matching," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1377-1383, 2006.
[22] X. Lu and A.K. Jain, "Deformation Modeling for Robust 3D Face Matching," IEEE Trans. Pattern Analysis and Machine Integlligence, vol. 30, no. 8, pp. 1346-1357, Aug. 2008.
[23] C. Xu, Y. Wang, T. Tan, and L. Quan, "Automatic 3D Face Recognition Combining Global Geometric Features with Local Shape Variation Information," Proc. Int'l Conf. Automatic Face and Gesture Recognition, pp. 308-313, 2004.
[24] C. Xu, T. Tan, S. Li, Y. Wang, and C. Zhong, "Learning Effective Intrinsic Features to Boost 3D-Based Face Recognition," Proc. European Conf. Computer Vision, pp. 416-427, 2006.
[25] C. Zhong, Z. Sun, and T. Tan, "Robust 3D Face Recognition Using Learned Visual Codebook," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[26] G. Passalis, I.A. Kakadiaris, T. Theoharis, G. Toderici, and N. Murtuza, "Evaluation of 3D Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach," Proc. IEEE Workshop Face Recognition Grand Challenge Experiments, 2005.
[27] C. Chua, F. Han, and Y. Ho, "3D Human Face Recognition Using Point Signature," Proc. Int'l Conf. Automatic Face and Gesture Recognition, pp. 233-238, 2000.
[28] Z. Wu, Y. Wang, and G. Pan, "3D Face Recognition Using Local Shape Map," Proc. IEEE Int'l Conf. Image Processing, pp. 2003-2006, 2004.
[29] T. Maurer, D. Guigonis, I. Maslov, B. Pesenti, A. Tsaregorodtsev, D. West, and G. Medioni, "Performance of Geometrix ActiveID™ 3D Face Recognition Engine on the FRGC Data," Proc. IEEE Workshop Face Recognition Grand Challenge Experiments, 2005.
[30] M. Hüsken, M. Brauckmann, S. Gehlen, and C. von der Malsburg, "Strategies and Benefits of Fusion of 2D and 3D Face Recognition," Proc. IEEE Workshop Face Recognition Grand Challenge Experiments, 2005.
[31] J. Cook, V. Chandran, and C. Fookes, "3D Face Recognition Using Log-Gabor Templates," Proc. British Machine Vision Conf., pp. 83-83, 2006.
[32] C. Beumier and M. Acheroy, "Automatic 3D Face Authentication," Image Vision Computing, vol. 18, no. 4, pp. 315-321, 2000.
[33] G. Pan, Y. Wu, Z. Wu, and W. Liu, "3D Face Recognition by Profile and Surface Matching," Proc. IEEE Int'l Joint Conf. Neural Network, pp. 2168-2174, 2003.
[34] P.J. Phillips, P. Grother, R.J. Michaels, D.M. Blackburn, E. Tabassi, and J. Bone, "FRVT 2002: Overview and Summary," www.frvt.org, 2002.
[35] P.J. Phillips, W.T. Scruggs, A.J. O'Toole, P. Flynn, K.W. Bowyer, C.L. Schott, and M. Sharpe, "FRVT 2006 and ICE 2006 Large-Scale Results," www.frvt.org, 2006.
[36] A.M. Bronstein, M.M. Bronstein, and R. Kimmel, "Expression-Invariant 3D Face Recognition," Proc. Int'l Conf. Audio- and Video-Based Biometric Person Authentication, pp. 62-70, 2003.
[37] A.M. Bronstein, M.M. Bronstein, and R. Kimmel, "Three-Dimensional Face Recognition," Int'l J. Computer Vision, vol. 64, no. 1, pp. 5-30, 2005.
[38] P.J. Phillips, P. Flynn, T. Scruggs, K.W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. Worek, "Overview of the Face Recognition Grand Challenge," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 947-954, 2005.
[39] L. Yin, X. Wei, Y. Sun, J. Wang, and M. Rosato, "A 3D Facial Expression Database for Facial Behavior Research," Proc. Int'l Conf. Automatic Face and Gesture Recognition, pp. 211-216, 2006.
[40] Y. Wang, G. Pan, and Z. Wu, "3D Face Recognition in the Presence of Expression: A Guidance-Based Constraint Deformation Approach," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[41] R. Schapire and Y. Singer, "Improved Boosting Algorithms Using Confidence-Rated Predictions," Machine Learning, vol. 37, no. 3, pp. 297-336, 1999.
[42] I.A. Kakadiaris, G. Passalis, G. Toderici, N. Murtuza, Y. Lu, N. Karampatziakis, and T. Theoharis, "Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach," IEEE Trans. Pattern Analysis and Machine Integlligence, vol. 29, no. 4, pp. 640-649, Apr. 2007.
[43] A.S. Mian, M. Bennamoun, and R. Owens, "An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition," IEEE Trans. Pattern Analysis and Machine Integlligence, vol. 29, no. 11, pp. 1927-1943, Nov. 2007.
[44] A.S. Mian, M. Bennamoun, and R. Owens, "Keypoint Detection and Local Feature Matching for Textured 3D Face Recognition," Int'l J. Computer Vision, vol. 79, no. 1, pp. 1-12, 2008.
[45] T. Faltemier, K.W. Bowyer, and P. Flynn, "A Region Ensemble for 3D Face Recognition," IEEE Trans. Information Forensics and Security, vol. 3, no. 1, pp. 62-73, Mar. 2008.
[46] Y. Wang, X. Tang, J. Liu, G. Pan, and R. Xiao, "3D Face Recognition by Local Shape Difference Boosting," Proc. European Conf. Computer Vision, pp. 603-616, 2008.
[47] C. Huang, H. Ai, Y. Li, and S. Lao, "High-Performance Rotation Invariant Multiview Face Detection," IEEE Trans. Pattern Analysis and Machine Integlligence, vol. 29, no. 4, pp. 671-686, Apr. 2007.
[48] P. Viola and M. Jones, "Rapid Object Detection Using a Boosted Cascade of Simple Features," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 511-518, 2001.
[49] C. Liu and H. Wechsler, "Gabor Feature Based Classification Using the Enhanced Fisher Linear Discriminant Model for Face Recognition," IEEE Trans. Image Processing, vol. 11, no. 4, pp. 467-476, Apr. 2002.
[50] T. Ojala, M. Pietikainen, and D. Harwood, "A Comparative Study of Texture Measures with Classification Based on Feature Distributions," Pattern Recognition, vol. 29, no. 1, pp. 51-59, 1996.
[51] L. Zhang, R. Chu, S. Xiang, S. Liao, and S. Li, "Face Detection Based on Multi-Block LBP Representation," Proc. Int'l Conf. Biometrics, pp. 11-18, 2007.
[52] X. Wang and X. Tang, "A Unified Framework for Subspace Face Recognition," IEEE Trans. Pattern Analysis and Machine Integlligence, vol. 26, no. 9, pp. 1222-1228, Sept. 2004.
[53] T. Russ, C. Boehnen, and T. Peters, "3D Face Recognition Using 3D Alignment for PCA," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1391-1398, 2006.
[54] C. Boehnen, T. Peters, and P. Flynn, "3D Signatures for Fast 3D Face Recognition," Proc. IAPR/IEEE Int'l Conf. Biometrics, pp. 12-21, 2009.
8 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool