The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.06 - June (2008 vol.30)
pp: 970-984
Simon J.D. Prince , University College London
James H. Elder , York University
Jonathan Warrell , University College London
Fatima M. Felisberti , Kingston University
ABSTRACT
Face recognition algorithms perform very unreliably when the pose of the probe face is different from the gallery face: typical feature vectors vary more with pose than with identity. We propose a generative model that creates a one-to-many mapping from an idealized "identity" space to the observed data space. In identity space, the representation for each individual does not vary with pose. We model the measured feature vector as being generated by a pose-contingent linear transformation of the identity variable in the presence of Gaussian noise. We term this model "tied" factor analysis. The choice of linear transformation (factors) depends on the pose, but the loadings are constant (tied) for a given individual. We use the EM algorithm to estimate the linear transformations and the noise parameters from training data. We propose a probabilistic distance metric which allows a full posterior over possible matches to be established. We introduce a novel feature extraction process and investigate recognition performance using the FERET, XM2VTS and PIE databases. Recognition performance compares favourably to contemporary approaches.
INDEX TERMS
Computer vision, Face and gesture recognition
CITATION
Simon J.D. Prince, James H. Elder, Jonathan Warrell, Fatima M. Felisberti, "Tied Factor Analysis for Face Recognition across Large Pose Differences", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.30, no. 6, pp. 970-984, June 2008, doi:10.1109/TPAMI.2008.48
REFERENCES
[1] P. Belhumeur, J. Hespanha, and D. Kriegman, “Eigenfaces vs. Fisherfaces: Recognition Using Class-Specific Linear Projection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, pp.711-720, 1997.
[2] D. Beymer, “Face Recognition under Varying Pose,” Technical Report AIM-1461, AI Laboratory, Massachussetts Inst. of Tech nology, 1993.
[3] D. Beymer and T. Poggio, “Face Recognition from One Example View,” Technical Report AIM-1536, AI Laboratory, Massachussetts Inst. of Tech nology, Sept. 1995.
[4] C. Bishop, Pattern Recognition and Machine Learning. Springer, 2007.
[5] V. Blanz, P. Grother, P.J. Phillips, and T. Vetter, “Face Recognition Based on Frontal Views Generated from Non-Frontal Images,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp.454-461, 2005.
[6] V. Blanz, S. Romdhani, and T. Vetter, “Face Identification across Different Poses and Illumination with a 3D Morphable Model,” Proc. Fifth IEEE Int'l Conf. Automatic Face and Gesture Recognition, pp. 202-207, 2002.
[7] X. Chai, S. Shan, X. Chen, and W. Gao, “Locally Linear Regression for Pose-Invariant Face Recognition,” IEEE Trans. Image Processing, vol. 16, pp. 1716-1725, 2007.
[8] A. Dempster, N. Laird, and D. Rubin, “Maximum Likelihood from Incomplete Data via the EM Algorithm,” J. Royal Statistical Soc. B, vol. 39, pp. 1-38, 1977.
[9] J. Elder, S. Prince, Y. Hou, M. Sizinstev, and E. Olevskiy, “Pre-Attentive and Attentive Detection of Humans in Wide-Field Scenes,” Int'l J. Computer Vision, vol. 72, no. 1, pp. 47-66, 2007.
[10] K. Fukui and O. Yamaguchi, “Face Recognition Using Multi-Viewpoint Patterns for Robot Vision,” Proc. 11th Int'l Symp. Robotics Research, pp. 192-201, 2003.
[11] A. Georghiades, P. Belhumeur, and D. Kriegman, “From Few to Many: Illumination Cone Models and Face Recognition under Variable Lighting and Pose,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, pp. 129-139, 2001.
[12] R. Gross, I. Matthews, and S. Baker, “Appearance-Based Face Recognition and Light Fields,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, pp. 449-465, 2004.
[13] X. He, S. Yan, Y. Hu, P. Nihogi, and H. Zhang, “Face Recognition Using Laplacianfaces,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, pp. 328-340, 2005.
[14] T. Kanade and A. Yamada, “Multi-Subregion-Based Probabilistic Approach toward Pose-Invariant Face Recognition,” Proc. IEEE Int'l Symp. Computational Intelligence in Robotics and Automation, pp. 954-959, 2003.
[15] T. Kim and J. Kittler, “Locally Linear Discriminant Analysis for Multimodally Distributed Classes for Face Recognition with a Single Model Image,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, pp. 318-327, 2005.
[16] Y. Li, S. Gong, and H. Liddell, “Constructing Facial Identity Surfaces in a Nonlinear Discriminating Space,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 258-265, 2001.
[17] X. Liu and T. Chen, “Pose-Robust Face Recognition Using Geometry Assisted Probabilistic Modelling,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 502-509, 2005.
[18] S. Lucey and T. Chen, “Learning Patch Dependencies for Improved Pose Mismatched Face Verification,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 17-22, 2006.
[19] D. MacKay, Information Theory, Learning and Algorithms. Cambridge Univ. Press, 2003.
[20] T. Maurer and C. von der Malsburg, “Single-View Based Recognition of Faces Rotated in Depth,” Proc. Int'l Workshop Automatic Face and Gesture Recognition, pp. 80-85, 1995.
[21] K. Messer, J. Matas, J. Kittler, and J. Luettin, “XM2VTSDB: The Extended M2VTS Database,” Proc. Second Int'l Conf. Audio and Video-Based Biometric Person Authentication, pp. 72-77, 1999.
[22] B. Moghaddam, “Principal Manifolds and Probabilistic Subspaces for Visual Recognition,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, pp. 780-788, 2002.
[23] A. Pentland, B. Moghaddam, and T. Starner, “View-Based and Modular Eigenspaces for Face Recognition,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. 84-91, 1994.
[24] V. Perlibakas, “Distance Measures for PCA-Based Face Recognition,” Pattern Recognition Letters, vol. 25, pp. 711-724, 2004.
[25] P. Phillips, P. Grother, R. Micheals, D. Blackburn, E. Tabassi, and J. Bone, FRVT Evaluation Report, http://www.frvt.org/FRVT2002documents.htm , 2003.
[26] P. Phillips, H. Moon, S.A. Rizvi, and P. Rauss, “The FERET Evaluation Methodology for Face Recognition Algorithms,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, pp. 1090-1104, 2000.
[27] P. Phillips, H. Wechsler, J. Huang, and P.J. Rauss, “The FERET Database and Evaluation Procedure for Face Recognition Algorithms,” Image and Vision Computing, vol. 16, pp. 295-306, 1998.
[28] S. Prince and J. Elder, “Invariance to Nuisance Parameters in Face Recognition,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. 446-453, 2005.
[29] S. Romdhani, V. Blanz, and T. Vetter, “Face Identification by Fitting a 3D Morphable Model Using Linear Shape and Texture Error Functions,” Proc. Seventh European Conf. Computer Vision, 2002.
[30] C. Sanderson, S. Bengio, and Y. Gao, “Transforming Statistical Models for Non-Frontal Face Verification,” Pattern Recognition, vol. 39, pp. 288-302, 2006.
[31] T. Sim, S. Baker, and M. Bsat, “The CMU Pose, Illumination and Expression Database of Human Faces,” CMU Technical Report CMU-RI-TR-01-02, 2001.
[32] J. Tenenbaum and W. Freeman, “Separating Style and Content with Bilinear Models,” Neural Computation, vol. 12, pp. 1247-1283, 2000.
[33] M. Turk and A. Pentland, “Face Recognition Using Eigenfaces,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp.586-591, 1991.
[34] M. Vasilescu and D. Terzopoulos, “Multilinear Image Analysis for Facial Recognition,” Proc. 16th Int'l Conf. Pattern Recognition, pp.205-211, 2002.
[35] P. Viola and M. Jones, “Robust Real-Time Face Detection,” Int'l J. Computer Vision, vol. 57, pp. 1473-1505, 2004.
[36] F. Wallhoff, S. Muller, and G. Rigoll, “Hybrid Face Recognition Systems for Profile Views Using the Mugshot Database,” Proc. Second IEEE ICCV Workshop Recognition, Analysis and Tracking of Faces and Gestures in Real-Time Systems, pp. 149-156, 2001.
[37] L. Wiskott, J. Fellous, N. Kruger, and C. der Malsburg, “Face Recognition by Elastic Bunch Graph Matching,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, pp. 775-779, 1997.
[38] W. Yambor, B. Draper, and R. Beveridge, “Analyzing PCA-Based Face Recognition Algorithms: Eigenvector Selection and Distance Measures,” Proc. Second Workshop Empirical Evaluation Methods in Computer Vision, 2000.
[39] M. Yang, “Kernel Eigenfaces versus Kernel Fisherfaces: Face Recognition Using Kernel Methods,” Proc. Fifth IEEE Int'l Conf. Face and Gesture Recognition, 2002.
[40] L. Zhang and D. Samaras, “Pose Invariant Face Recognition under Arbitrary Unknown Lighting Using Spherical Harmonics,” Proc. ECCV Int'l Workshop Biometric Authentication Workshop, 2004.
[41] W. Zhao and R. Chellappa, “SFS-Based View Synthesis for Robust Face Recognition,” Proc. Fifth IEEE Int'l Conf. Automatic Face and Gesture Recognition, pp. 285-292, 2002.
[42] W. Zhao, R. Chellappa, A. Rosenfeld, and J. Phillips, “Face Recognition: A Literature Survey,” ACM Computing Surveys, vol. 12, pp. 399-458, 2003.
[43] S. Zhou and R. Chellappa, “Probabilistic Identity Characterization for Face Recognition,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 805-812, 2002.
18 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool