The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.06 - June (2011 vol.33)
pp: 1274-1280
Shervin Rahimzadeh Arashloo , University of Surrey, Guildford
Josef Kittler , University of Surrey, Guildford
ABSTRACT
A pose-invariant face recognition system based on an image matching method formulated on MRFs is presented. The method uses the energy of the established match between a pair of images as a measure of goodness-of-match. The method can tolerate moderate global spatial transformations between the gallery and the test images and alleviate the need for geometric preprocessing of facial images by encapsulating a registration step as part of the system. It requires no training on nonfrontal face images. A number of innovations, such as a dynamic block size and block shape adaptation, as well as label pruning and error prewhitening measures have been introduced to increase the effectiveness of the approach. The experimental evaluation of the method is performed on two publicly available databases. First, the method is tested on the rotation shots of the XM2VTS data set in a verification scenario. Next, the evaluation is conducted in an identification scenario on the CMU-PIE database. The method compares favorably with the existing 2D or 3D generative model-based methods on both databases in both identification and verification scenarios.
INDEX TERMS
Markov random fields, structural image analysis, image matching, face recognition, pose invariance.
CITATION
Shervin Rahimzadeh Arashloo, Josef Kittler, "Energy Normalization for Pose-Invariant Face Recognition Based on MRF Model Image Matching", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.33, no. 6, pp. 1274-1280, June 2011, doi:10.1109/TPAMI.2010.209
REFERENCES
[1] W. Zhao, R. Chellappa, A. Rosenfeld, and P.J. Phillips, “Face Recognition: A Literature Survey,” Proc. ACM Computing Surveys, pp. 399-458, 2003.
[2] M. Tistarelli, S. Li, and R. Chellappa, Handbook of Remote Biometrics for Surveillance and Security. Springer, 2009.
[3] T. Werner, “High-Arity Interactions, Polyhedral Relaxations, and Cutting Plane Algorithm for Soft Constraint Optimisation (MAP-MRF),” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 1-8, June 2008.
[4] N. Komodakis and N. Paragios, “Beyond Pairwise Energies: Efficient Optimization for Higher-Order MRFS,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 2985-2992, 2009.
[5] C. Rother, P. Kohli, W. Feng, and J. Jia, “Minimizing Sparse Higher Order Energy Functions of Discrete Variables,” Proc. IEEE CS Computer Vision and Pattern Recognition, vol. 0, pp. 1382-1389, 2009.
[6] S.R. Arashloo and J. Kittler, “Pose-Invariant Face Matching Using mrf Energy Minimization Framework,” Proc. Int'l Conf. Energy Minimization Methods in Computer Vision and Pattern Recognition, pp. 56-69, 2009.
[7] A. Shekhovtsov, I. Kovtun, and V. Hlavac, “Efficient MRF Deformation Model for Non-Rigid Image Matching,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 1-6, June 2007.
[8] A. Pentland, B. Moghaddam, and T. Starner, “View-Based and Modular Eigenspaces for Face Recognition,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 84-91, June 1994.
[9] D. Beymer, “Face Recognition Under Varying Pose,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 756-761, June 1994.
[10] D. Gonzalez-Jimenez and J. Alba-Castro, “Toward Pose-Invariant 2-D Face Recognition through Point Distribution Models and Facial Symmetry,” IEEE Trans. Information Forensics and Security, vol. 2, no. 3, pp. 413-429, Sept. 2007.
[11] X. Chai, S. Shan, X. Chen, and W. Gao, “Locally Linear Regression for Pose-Invariant Face Recognition,” IEEE Trans. Image Processing, vol. 16, no. 7, pp. 1716-1725, July 2007.
[12] T. Cootes, K. Walker, and C. Taylor, “View-Based Active Appearance Models,” Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition, pp. 227-232, 2000.
[13] V. Blanz, S. Romdhani, and T. Vetter, “Face Identification Across Different Poses and Illuminations with a 3d Morphable Model,” Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition, pp. 192-197, May 2002.
[14] X. Liu and T. Chen, “Pose-Robust Face Recognition Using Geometry Assisted Probabilistic Modeling,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 502-509, June 2005.
[15] T.-K. Kim and J. Kittler, “Locally Linear Discriminant Analysis for Multimodally Distributed Classes for Face Recognition with a Single Model Image,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 3, pp. 318-327, Mar. 2005.
[16] J. Huang, P. Yuen, W.-S. Chen, and J.H. Lai, “Choosing Parameters of Kernel Subspace lDA for Recognition of Face Images under Pose and Illumination Variations,” IEEE Trans. Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 37, no. 4, pp. 847-862, Aug. 2007.
[17] T. Kanade and A. Yamada, “Multi-Subregion-Based Probabilistic Approach toward Pose-Invariant Face Recognition,” Proc. Int'l Symp. Computational Intelligence in Robotics and Automation, vol. 2, pp. 954-959, July 2003.
[18] C. Castillo and D. Jacobs, “Using Stereo Matching for 2-D Face Recognition Across Pose,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 1-8, June 2007.
[19] R. Wang, Z. Lei, M. Ao, and S.Z. Li, “Bayesian Face Recognition Based on Markov Random Field Modeling,” Proc. Third Int'l Conf. Advances in Biometrics, pp. 42-51, 2009.
[20] B.-G. Park, K.-M. Lee, and S.-U. Lee, “Face Recognition Using Face-ARG Matching,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 12, pp. 1982-1988, Dec. 2005.
[21] R. Huang, V. Pavlovic, and D. Metaxas, “A Hybrid Face Recognition Method Using Markov Random Fields,” Proc. Int'l Conf. Pattern Recognition, vol. 3, pp. 157-160, Aug. 2004.
[22] D. Kisku, A. Rattani, M. Tistarelli, and P. Gupta, “Graph Application on Face for Personal Authentication and Recognition,” Proc. 10th Int'l Conf. Control, Automation, Robotics and Vision, pp. 1150 -1155, Dec. 2008.
[23] B. Glocker, N. Komodakis, N. Paragios, G. Tziritas, and N. Navab, “Inter- and Intra-Modal Deformable Registration: Continuous Deformations Meet Efficient Optimal Linear Programming,” Proc. Information Processing in Medical Imaging, pp. 408-420, 2007.
[24] Y. Boykov, O. Veksler, and R. Zabih, “Fast Approximate Energy Minimization via Graph Cuts,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 11, pp. 1222-1239, Nov. 2001.
[25] M. Pawan Kumar, P.H. Torr, and A. Zisserman, “Learning Layered Motion Segmentations of Video,” Int'l J. Computer Vision, vol. 76, no. 3, pp. 301-319, 2008.
[26] V. Kolmogorov, “Convergent Tree-Reweighted Message Passing for Energy Minimization,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 10, pp. 1568-1583, Oct. 2006.
[27] R. Szeliski, R. Zabih, D. Scharstein, O. Veksler, V. Kolmogorov, A. Agarwala, M. Tappen, and C. Rother, “A Comparative Study of Energy Minimization Methods for Markov Random Fields with Smoothness-Based Priors,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 6, pp. 1068-1080, June 2008.
[28] A. Ashraf, S. Lucey, and T. Chen, “Learning Patch Correspondences for Improved Viewpoint Invariant Face Recognition,” Proc. IEEE CS Int'l Conf. Computer Vision and Pattern Recognition, pp. 1-8, June 2008.
[29] W.H. Press, B.P. Flannery, S.A. Teukolsky, and W.T. Vetterling, Numerical Recipes in C: The Art of Scientific Computing, second ed. Cambridge Univ. Press, Oct. 1992.
[30] A.R. Ahmadyfard and J. Kittler, “Region-Based Object Recognition: Pruning Multiple Representations and Hypotheses,” Proc. British Machine Vision Conf., vol. 2, pp. 745-754, 2000.
[31] J. Kittler and A. Lucas, “A New Method for Dynamic Time Alignment of Speech Waveforms in Pattern Recognition and Understanding,” Speech Recognition and Understanding, P. Laface and R. D. Mori, eds., pp. 537-542, Springer-Verlag, 1991.
[32] K. Messer, J. Matas, J. Kittler, and K. Jonsson, “XM2VTSDB: The Extended M2VTS Database,” Proc. Second Int'l Conf. Audio and Video-Based Biometric Person Authentication, pp. 72-77, 1999.
[33] X. Tan and B. Triggs, “Enhanced Local Texture Feature Sets for Face Recognition under Difficult Lighting Conditions,” Proc. Analysis and Modelling of Faces and Gestures, pp. 168-182, 2007.
[34] T. Ojala, M. Pietikainen, and T. Maenpaa, “Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 7, pp. 971-987, July 2002.
[35] C.-H. Chan, “Multi-Scale Local Binary Pattern Histogram for Face Recognition,” PhD dissertation, 2008.
[36] J. Tena, R. Smith, M. Hamouz, J. Kittler, A. Hilton, and J. Illingworth, “2D Face Pose Normalisation Using a 3D Morphable Model,” Proc. Int'l Conf. Video and Signal Based Surveillance, pp. 1-6, Sept. 2007.
[37] R. Gross, I. Matthews, and S. Baker, “Appearance-Based Face Recognition and Light-Fields,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 4, pp. 449-465, Apr. 2004.
[38] X. Zhang, Y. Gao, and M. Leung, “Recognizing Rotated Faces from Frontal and Side Views: An Approach toward Effective Use of Mugshot Databases,” IEEE Trans. Information Forensics and Security, vol. 3, no. 4, pp. 684-697, Dec. 2008.
[39] S. Romdhani, V. Blanz, and T. Vetter, “Face Identification by Fitting a 3d Morphable Model Using Linear Shape and Texture Error Functions,” Proc. Seventh European Conf. Computer Vision-Part IV, pp. 3-19, 2002.
[40] S. Arashloo, J. Kittler, and W. Christmas, “Facial Feature Localization Using Graph Matching with Higher Order Statistical Shape Priors and Global Optimization,” Fourth IEEE Int'l Conf. Biometrics: Theory Applications and Systems. pp. 1-16, 2010.
24 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool