The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.09 - Sept. (2013 vol.35)
pp: 2270-2283
Hassen Drira , Lab. d'Inf. Fondamentale de Lille (LIFL), Inst. Mines-Telecom/Telecom Lille 1, Villeneuve d'Ascq, France
Boulbaba Ben Amor , Lab. d'Inf. Fondamentale de Lille (LIFL), Inst. Mines-Telecom/Telecom Lille 1, Villeneuve d'Ascq, France
A. Srivastava , Dept. of Stat., Florida State Univ., Tallahassee, FL, USA
M. Daoudi , Lab. d'Inf. Fondamentale de Lille (LIFL), Inst. Mines-Telecom/Telecom Lille 1, Villeneuve d'Ascq, France
R. Slama , Lab. d'Inf. Fondamentale de Lille (LIFL), Inst. Mines-Telecom/Telecom Lille 1, Villeneuve d'Ascq, France
ABSTRACT
We propose a novel geometric framework for analyzing 3D faces, with the specific goals of comparing, matching, and averaging their shapes. Here we represent facial surfaces by radial curves emanating from the nose tips and use elastic shape analysis of these curves to develop a Riemannian framework for analyzing shapes of full facial surfaces. This representation, along with the elastic Riemannian metric, seems natural for measuring facial deformations and is robust to challenges such as large facial expressions (especially those with open mouths), large pose variations, missing parts, and partial occlusions due to glasses, hair, and so on. This framework is shown to be promising from both-empirical and theoretical-perspectives. In terms of the empirical evaluation, our results match or improve upon the state-of-the-art methods on three prominent databases: FRGCv2, GavabDB, and Bosphorus, each posing a different type of challenge. From a theoretical perspective, this framework allows for formal statistical inferences, such as the estimation of missing facial parts using PCA on tangent spaces and computing average shapes.
INDEX TERMS
Face, Shape, Face recognition, Nose, Mouth, Probes, Lips,data restoration, 3D face recognition, shape analysis, biometrics, quality control
CITATION
Hassen Drira, Boulbaba Ben Amor, A. Srivastava, M. Daoudi, R. Slama, "3D Face Recognition under Expressions, Occlusions, and Pose Variations", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 9, pp. 2270-2283, Sept. 2013, doi:10.1109/TPAMI.2013.48
REFERENCES
[1] N. Alyuz, B. Gokberk, and L. Akarun, "A 3D Face Recognition System for Expression and Occlusion Invariance," Proc. Second IEEE Int'l Conf. Biometrics: Theory, Applications and Systems, 2008.
[2] S. Berretti, A. Del Bimbo, and P. Pala, "3D Face Recognition Using Isogeodesic Stripes," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 12, pp. 2162-2177, Dec. 2010.
[3] K.W.K. Bowyer, K. Chang, and P. Flynn, "A Survey of Approaches and Challenges in 3D and Multi-Modal 3D + 2D Face Recognition," Computer Vision and Image Understanding, vol. 101, no. 1, pp. 1-15, 2006.
[4] A.M.A. Bronstein, M.M.M. Bronstein, and R. Kimmel, "Three-Dimensional Face Recognition," Int'l J. Computer Vision, vol. 64, no. 1, pp. 5-30, 2005.
[5] A.M.A. Bronstein, M.M.M. Bronstein, and R. Kimmel, "Expression-Invariant Representations of Faces," IEEE Trans. Image Processing, vol. 16, no. 1, pp. 188-197, Jan. 2007.
[6] A. Colombo, C. Cusano, and R. Schettini, "Three-Dimensional Occlusion Detection and Restoration of Partially Occluded Faces," J. Math. Imaging and Vision, vol. 40, no. 1, pp. 105-119, 2011.
[7] H. Drira, B. Ben Amor, M. Daoudi, and A. Srivastava, "Pose and Expression-Invariant 3D Face Recognition Using Elastic Radial Curves," Proc. British Machine Vision Conf., pp. 1-11, 2010.
[8] H. Drira, B. Ben Amor, A. Srivastava, and M. Daoudi, "A Riemannian Analysis of 3D Nose Shapes for Partial Human Biometrics," Proc. IEEE Int'l Conf. Computer Vision, pp. 2050-2057, 2009.
[9] T.C.T. Faltemier, K.W.K. Bowyer, and P.J.P. Flynn, "A Region Ensemble for 3D Face Recognition," IEEE Trans. Information Forensics and Security, vol. 3, no. 1, pp. 62-73, Mar. 2008.
[10] G. Gordan, "Face Recognition Based on Depth and Curvature Features," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 108-110, 1992.
[11] S. Gupta, J.K. Aggarwal, M.K. Markey, and A.C. Bovik, "3D Face Recognition Founded on the Structural Diversity of Human Faces," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[12] D. Huang, G. Zhang, M. Ardabilian, Wang, and L. Chen, "3D Face Recognition Using Distinctiveness Enhanced Facial Representations and Local Feature Hybrid Matching," Proc. Fourth IEEE Int'l Conf. Biometrics: Theory Applications and Systems, pp. 1-7, 2010.
[13] I.A.I. Kakadiaris, G. Passalis, G. Toderici, M.N.M. Murtuza, Y. Lu, N. Karampatziakis, and T. Theoharis, "Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 4, pp. 640-649, Apr. 2007.
[14] H. Karcher, "Riemannian Center of Mass and Mollifier Smoothing," Comm. Pure and Applied Math., vol. 30, pp. 509-541, 1977.
[15] Y. Lee, H. Song, U. Yang, H. Shin, and K. Sohn, "Local Feature Based 3D Face Recognition," Proc. Audio- and Video-Based Biometric Person Authentication, pp. 909-918, 2005.
[16] X. Li, T. Jia, and H. Zhang, "Expression-Insensitive 3D Face Recognition Using Sparse Representation," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 2575-2582, 2009.
[17] X. Lu and A. Jain, "Deformation Modeling for Robust 3D Face Matching," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 8, pp. 1346 -1357, Aug. 2008.
[18] M.H.M. Mahoor and M. Abdel-Mottaleb, "Face Recognition Based on 3D Ridge Images Obtained from Range Data," Pattern Recognition, vol. 42, no. 3, pp. 445-451, 2009.
[19] R. McKeon and T. Russ, "Employing Region Ensembles in a Statistical Learning Framework for Robust 3D Facial Recognition," Proc. Fourth IEEE Int'l Conf. Biometrics: Theory Applications and Systems, pp. 1-7, 2010.
[20] A. Moorthy, A. Mittal, S. Jahanbin, K. Grauman, and A. Bovik, "3D Facial Similarity: Automatic Assessment versus Perceptual Judgments," Proc. Fourth IEEE Int'l Conf. Biometrics: Theory Applications and Systems, pp. 1-7, 2010.
[21] A.B.A. Moreno and A. Sanchez, "GavabDB: A 3D Face Database," Proc. Workshop Biometrics on the Internet, pp. 77-85, 2004.
[22] A.B. Moreno, A. Sanchez, J.F. Velez, and F.J. Díaz, "Face Recognition Using 3D Local Geometrical Features: PCA versus SVM," Proc. Int'l Symp. Image and Signal Processing and Analysis, 2005.
[23] M.H.M. Mousavi, K. Faez, and A. Asghari, "Three Dimensional Face Recognition Using SVM Classifier," Proc. Seventh IEEE/ACIS Int'l Conf. Computer and Information Science, pp. 208-213, 2008.
[24] I. Mpiperis, S. Malassiotis, and M.G.M. Strintzis, "3D Face Recognition with the Geodesic Polar Representation," IEEE Trans. Information Forensics and Security, vol. 2, no. 3, pp. 537-547, Sept. 2007.
[25] G. Passalis, P. Perakis, T. Theoharis, and I.A.I. Kakadiaris, "Using Facial Symmetry to Handle Pose Variations in Real-World 3D Face Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 33, no. 10, pp. 1938-1951, Oct. 2011.
[26] C.C.C. Queirolo, L. Silva, O.R.O. Bellon, and M.P.M. Segundo, "3D Face Recognition Using Simulated Annealing and the Surface Interpenetration Measure," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 2, pp. 206-219, Feb. 2010.
[27] C. Samir, A. Srivastava, and M. Daoudi, "Three-Dimensional Face Recognition Using Shapes of Facial Curves," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 11, pp. 1858-1863, Nov. 2006.
[28] C. Samir, A. Srivastava, M. Daoudi, and E. Klassen, "An Intrinsic Framework for Analysis of Facial Surfaces," Int'l J. Computer Vision, vol. 82, no. 1, pp. 80-95, 2009.
[29] L. Spreeuwers, "Fast and Accurate 3D Face Recognition Using Registration to an Intrinsic Coordinate System and Fusion of Multiple Region Classifiers," Int'l J. Computer Vision, vol. 93, no. 3, pp. 389-414, 2011.
[30] A. Srivastava, E. Klassen, S.H.S. Joshi, and I.H.I. Jermyn, "Shape Analysis of Elastic Curves in Euclidean Spaces," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 33, no. 7, pp. 1415-1428, July 2011.
[31] F. ter Haar and R.C.R. Velkamp, "Expression Modeling for Expression-Invariant Face Recognition," Computers and Graphics, vol. 34, no. 3, pp. 231-241, 2010.
[32] Y. Wang, J. Liu, and X. Tang, "Robust 3D Face Recognition by Local Shape Difference Boosting," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 10, pp. 1858-1870, Oct. 2010.
[33] L. Younes, P.W.P. Michor, J. Shah, and D. Mumford, "A Metric on Shape Space with Explicit Geodesics," Rendiconti Lincei-Matematica e Applicazioni, vol. 9, pp. 25-57, 2008.
57 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool