Subscribe
Issue No.12 - December (2010 vol.32)
pp: 2162-2177
Stefano Berretti , Università degli Studi di Firenze, Firenze
Alberto Del Bimbo , Università degli Studi di Firenze, Firenze
Pietro Pala , Università degli Studi di Firenze, Firenze
ABSTRACT
In this paper, we present a novel approach to 3D face matching that shows high effectiveness in distinguishing facial differences between distinct individuals from differences induced by nonneutral expressions within the same individual. The approach takes into account geometrical information of the 3D face and encodes the relevant information into a compact representation in the form of a graph. Nodes of the graph represent equal width isogeodesic facial stripes. Arcs between pairs of nodes are labeled with descriptors, referred to as 3D Weighted Walkthroughs (3DWWs), that capture the mutual relative spatial displacement between all the pairs of points of the corresponding stripes. Face partitioning into isogeodesic stripes and 3DWWs together provide an approximate representation of local morphology of faces that exhibits smooth variations for changes induced by facial expressions. The graph-based representation permits very efficient matching for face recognition and is also suited to being employed for face identification in very large data sets with the support of appropriate index structures. The method obtained the best ranking at the SHREC 2008 contest for 3D face recognition. We present an extensive comparative evaluation of the performance with the FRGC v2.0 data set and the SHREC08 data set.
INDEX TERMS
3D face recognition, 3D face model, isogeodesic stripe partitioning, 3D weighted walkthroughs, 3D face matching, performance evaluation.
CITATION
Stefano Berretti, Alberto Del Bimbo, Pietro Pala, "3D Face Recognition Using Isogeodesic Stripes", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.32, no. 12, pp. 2162-2177, December 2010, doi:10.1109/TPAMI.2010.43
REFERENCES
 [1] W. Zhao, R. Chellappa, P.J. Phillips, and A. Rosenfeld, "Face Recognition: A Literature Survey," ACM Computing Survey, vol. 35, no. 4, pp. 399-458, Dec. 2003. [2] P.J. Phillips, P. Grother, R.J. Micheals, D. Blackburn, E. Tabassi, and M. Bone, "FRVT 2002: Evaluation Report," Technical Report NISTIR 6965, Nat'l Inst. of Standards and Tech nology, Mar. 2003. [3] P.J. Phillips, W.T. Scruggs, A.J. O'Toole, P.J. Flynn, K.W. Bowyer, C.L. Schott, and M. Sharpe, "FRVT 2006 and ICE 2006 Large-Scale Results," technical report, Nat'l Inst. of Standards and Tech nology, Mar. 2007. [4] K.W. Bowyer, K.I. Chang, and P.J. Flynn, "A Survey of Approaches and Challenges in 3D and Multi-Modal 3D + 2D Face Recognition," Computer Vision and Image Understanding, vol. 101, no. 1, pp. 1-15, Jan. 2006. [5] I.A. Kakadiaris, G. Passalis, G. Toderici, N. Murtuza, Y. Lu, N. Karampatziakis, and T. Theoharis, "Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Approach," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 4, pp. 640-649, Apr. 2007. [6] A.S. Mian, M. Bennamoun, and R. Owens, "An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 11, pp. 1927-1943, Nov. 2007. [7] P.J. Phillips, P.J. Flynn, T. Scruggs, K.W. Bowyer, and W. Worek, "Preliminary Face Recognition Grand Challenge Results," Proc. Int'l Conf. Automatic Face and Gesture Recognition, pp. 15-24, Apr. 2006. [8] M. Daoudi, F. ter Haar, and R.C. Veltkamp, Shrec '08—Shape Retrieval Contest 2008, Utrecht Univ., http://give-lab.cs.uu.nl/SHRECshrec2008/, Mar. 2008. [9] L.G. Farkas, and I.R. Munro, Anthropometric Facial Proportions in Medicine. Thomas Books, 1987. [10] L.G. Farkas, Anthropometry of the Head and Face. Raven Press, 1994. [11] Q. Summerfield, Analysis, Synthesis and Perception of Visible Articulatory Movements. Academic Press, Inc., 1983. [12] A.M. Bronstein, M.M. Bronstein, and R. Kimmel, "Three Dimensional Face Recognition," Int'l J. Computer Vision, vol. 64, no. 1, pp. 5-30, Aug. 2005. [13] J.C. Lee and E. Milios, "Matching Range Images of Human Faces," Proc. IEEE Int'l Conf. Computer Vision, pp. 722-726, Dec. 1990. [14] C. Hesher, A. Srivastava, and G. Erlebacher, "Principal Component Analysis of Range Images for Facial Recognition," Proc. Int'l Conf. Imaging Science, Systems, and Technology, June 2002. [15] F. Tsalakanidou, D. Tzovaras, and M. Strintzis, "Use of Depth and Colour Eigenfaces for Face Recognition," Pattern Recognition Letters, vol. 24, nos. 9/10, pp. 1427-1435, June 2003. [16] G. Pan, S. Han, Z. Wu, and Y. Wang, "3D Face Recognition Using Mapped Depth Images," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 3, pp. 175-181, June 2005. [17] Y. Wang, M.-C. Chiang, and P.M. Thompson, "Mutual Information-Based 3D Surface Matching with Applications to Face Recognition and Brain Mapping," Proc. IEEE Int'l Conf. Computer Vision, pp. 527-534, Oct. 2005. [18] S. Wang, Y. Wang, M. Jin, X. Gu, and D. Samaras, "3D Surface Matching and Recognition Using Conformal Geometry," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 2453-2460, June 2006. [19] C. Samir, A. Srivastava, and M. Daoudi, "Three-Dimensional Face Recognition Using Shapes of Facial Curves," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 11, pp. 1853-1863, Nov. 2006. [20] F. ter Haar and R. Veltkamp, "A 3D Face Matching Framework," Proc. IEEE Int'l Conf. Shape Modeling and Applications, pp. 103-110, June 2008. [21] Y. Wang and C.-S. Chua, "Face Recognition from 2D and 3D Images Using 3D Gabor Filters," Image and Vision Computing, vol. 11, no. 23, pp. 1018-1028, Oct. 2005. [22] A.M. Bronstein, M.M. Bronstein, and R. Kimmel, "Robust Expression Invariant Face Recognition from Partially Missing Data," Proc. European Conf. Computer Vision, pp. 396-408, May 2006. [23] X. Lu and A.K. Jain, "Deformation Modeling for Robust 3D Face Matching," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1377-1383, June 2006. [24] G. Passalis, I.A. Kakadiaris, T. Theoharis, G. Toderici, and N. Murtuza, "Evaluation of 3D Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach," Proc. IEEE Workshop Face Recognition Grand Challenge Experiments, vol. 3, pp. 171-179, June 2005. [25] B. Amberg, R. Knothe, and T. Vetter, "Shrec '08 Entry: Shape Based Face Recognition with a Morphable Model," Proc. IEEE Int'l Conf. Shape Modeling and Applications, pp. 253-254, June 2008. [26] X. Lu, A.K. Jain, and D. Colbry, "Matching 2.5d Face Scans to 3D Models," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 1, pp. 31-43, Jan. 2006. [27] P. Yan and K.W. Bowyer, "A Fast Algorithm for ICP-Based 3D Shape Biometrics," Computer Vision and Image Understanding, vol. 107, no. 3, pp. 195-202, Sept. 2007. [28] J. Cook, V. Chandran, and C. Fookes, "3D Face Recognition Using Log-Gabor Templates," Proc. British Machine Vision Conf., vol. 2, pp. 769-778, Sept. 2006. [29] M. Huske¨n, M. Brauckmann, S. Gehlen, and C. Malsburg, "Strategies and Benefits of Fusion of 2D and 3D Face Recognition," Proc. IEEE Workshop Face Recognition Grand Challenge, June 2005. [30] D. Xu, P. Hu, W. Cao, and H. Li, "Shrec '08 Entry: 3D Face Recognition Using Moment Invariants," Proc. IEEE Int'l Conf. Shape Modeling and Applications, pp. 261-262, June 2008. [31] K.I. Chang, K.W. Bowyer, and P.J. Flynn, "Multiple Nose Region Matching for 3D Face Recognition under Varying Facial Expression," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 6, pp. 1695-1700, Oct. 2006. [32] T.C. Faltemier, K.W. Bowyer, and P.J. Flynn, "A Region Ensemble for 3D Face Recognition," IEEE Trans. Information Forensics and Security, vol. 3, no. 1, pp. 62-73, Mar. 2008. [33] T.C. Faltemier, K.W. Bowyer, and P.J. Flynn, "Using Multi Instance Enrollment to Improve Performance of 3D Face Recognition," Computer Vision and Image Understanding, vol. 112, no. 2, pp. 114-125, Nov. 2008. [34] G. Gordon, "Face Recognition Based on Depth and Curvature Features," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 808-810, June 1992. [35] A.B. Moreno, A. Sánchez, J.F. Vélez, and F.J. Díaz, "Face Recognition Using 3D Surface-Extracted Descriptors," Proc. Irish Machine Vision and Image Processing Conf., Sept. 2003. [36] K.I. Chang, K.W. Bowyer, and P.J. Flynn, "An Evaluation of Multimodal $2{\rm D}+3{\rm D}$ Face Biometrics," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 4, pp. 619-624, Apr. 2005. [37] C. Beumier and M. Acheroy, "Face Verification from 3D and Grey Level Clues," Pattern Recognition Letters, vol. 22, no. 12, pp. 1321-1329, Oct. 2001. [38] S. Berretti, A. Del Bimbo, and E. Vicario, "Weighted Walkthroughs between Extended Entities for Retrieval by Spatial Arrangement," IEEE Trans. Multimedia, vol. 5, no. 1, pp. 52-70, Mar. 2003. [39] S. Berretti, A. Del Bimbo, and E. Vicario, "Modelling Spatial Relationships between Colour Clusters," Pattern Analysis and Applications, vol. 4, nos. 2/3, pp. 83-92, June 2001. [40] T.H. Cormen, C.E. Leiserson, R.L. Rivest, and C. Stein, Introduction to Algorithms. MIT Press and McGraw-Hill, 2001. [41] A.M. Bronstein, M.M. Bronstein, and R. Kimmel, "Expression Invariant Representations of Faces," IEEE Trans. Image Processing, vol. 16, no. 1, pp. 188-197, Jan. 2007. [42] C. Samir, A. Srivastava, M. Daoudi, and E. Klassen, "An Intrinsic Framework for Analysis of Facial Surfaces," Int'l J. Computer Vision, vol. 82, no. 1, pp. 80-95, Apr. 2009. [43] S. Berretti, A. Del Bimbo, and P. Pala, "Description and Retrieval of 3D Face Models Using Iso-Geodesic Stripes," Proc. ACM SIGMM, pp. 13-22, Oct. 2006. [44] S. Berretti, A. Del Bimbo, and P. Pala, "Analysis and Retrieval of 3D Facial Models Using Iso-Geodesic Stripes," Proc. Sixth Int'l Workshop Content-Based Multimedia Indexing, pp. 257-264, June 2008. [45] S. Berretti, A. Del Bimbo, and E. Vicario, "Efficient Matching and Indexing of Graph Models in Content Based Retrieval," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 10, pp. 1089-1105, Oct. 2001. [46] P. Nair and A. Cavallaro, "SHREC '08 Entry: Registration and Retrieval of 3D Faces Using a Point Distribution Model," Proc. IEEE Int'l Conf. Shape Modeling and Applications, pp. 257-258, June 2008. [47] P.J. Phillips, P.J. Flynn, T. Scruggs, K.W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. Worek, "Overview of the Face Recognition Grand Challenge," Proc. IEEE Workshop Face Recognition Grand Challenge Experiments, pp. 947-954, June 2005. [48] T. Maurer, D. Guigonis, I. Maslov, B. Pesenti, A. Tsaregorodtsev, D. West, and G. Medioni, "Performance of Geometrix Activeid 3D Face Recognition Engine on the FRGC Data," Proc. IEEE Workshop Face Recognition Grand Challenge Experiments, June 2005. [49] A.M. Bronstein, M.M. Bronstein, A.M. Bruckstein, and R. Kimmel, "Partial Similarity of Objects, or How to Compare a Centaur to a Horse," Int'l J. Computer Vision, vol. 84, pp. 163-183, 2009.