This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
A Probabilistic Model of Face Mapping with Local Transformations and Its Application to Person Recognition
July 2005 (vol. 27 no. 7)
pp. 1157-1171
This paper proposes a new measure of "distance” between faces. This measure involves the estimation of the set of possible transformations between face images of the same person. The global transformation, which is assumed to be too complex for direct modeling, is approximated by a patchwork of local transformations, under a constraint imposing consistency between neighboring local transformations. The proposed system of local transformations and neighboring constraints is embedded within the probabilistic framework of a two-dimensional hidden Markov model. More specifically, we model two types of intraclass variabilities involving variations in facial expressions and illumination, respectively. The performance of the resulting method is assessed on a large data set consisting of four face databases. In particular, it is shown to outperform a leading approach to face recognition, namely, the Bayesian intra/extrapersonal classifier.

[1] R. Duda, P. Hart, and D. Stork, Pattern Classification, second ed. John Wiley & Sons, 2000.
[2] A. Jain, A. Ross, and S. Prabhakar, “An Introduction to Biometric Recognition,” IEEE Trans. Circuits Systems Video Technology, vol. 14, no. 1, Jan. 2004.
[3] R. Chellappa, C. Wilson, and S. Sirohey, “Human and Machine Recognition of Faces: A Survey,” Proc IEEE, vol. 83, no. 5, pp. 705-740, May 1995.
[4] J. Weng and D. Swets, Biometrics: Personal Identification in Networked Society. Kluwer, 1999.
[5] P. Phillips, H. Moon, S. Rizvi, and P. Rauss, “The Feret Evaluation Methodology for Face Recognition Algorithms,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 10, pp. 1090-1104, Oct. 2000.
[6] D. Blackburn, M. Bone, and P. Phillips, “Face Recognition Vendor Test 2000: Evaluation Report,” technical report, 2001.
[7] P. Phillips, P. Grother, R. Micheals, D. Blackburn, E. Tabassi, and M. Bone, “Face Recognition Vendor Test 2002: Evaluation Report,” technical report, 2003.
[8] M. Turk and A. Pentland, “Face Recognition Using Eigenfaces,” Proc. IEEE Computer Soc. Conf. Computer Vision and Pattern Recognition, pp. 586-591, 1991.
[9] K. Etemad and R. Chellappa, “Face Recognition Using Discriminant Eigenvectors,” Proc. IEEE Int'l Conf. Acoustics Speech and Signal Processing, vol. 4, pp. 2148-2151, 1996.
[10] D. Swets and J. Weng, “Using Discriminant Eigenfeatures for Image Retrieval,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 8, pp. 831-836, Aug. 1996.
[11] P. Belhumeur, J. Hespanha, and D. Kriegman, “Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 711-720, July 1997.
[12] J. Beveridge, K. She, B. Draper, and G. Givens, “A Nonparameteric Statistical Comparison of Principal Component and Linear Discriminant Subspaces for Face Recognition,” Proc. IEEE Computer Soc. Conf. Computer Vision and Pattern Recognition, pp. 535-542, 2001.
[13] C. Liu and H. Wechsler, “Gabor Feature Based Classification Using the Enhanced Fisher Linear Discriminant Model for Face Recognition,” IEEE Trans. Image Processing, vol. 11, no. 4, pp. 467-476, Apr. 2002.
[14] R. Beveridge, D. Bolme, M. Teixeira, and B. Draper, The CSU Face Identification Evaluation System Users' Guide Version 5.0, technical report, Computer Science Dept., Colorado State Univ., May 2003.
[15] W. Zhao, “Robust Image Based 3d Face Recognition,” PhD dissertation, Dept. of Electrical and Computer Eng., Univ. of Maryland, 1999.
[16] B. Moghaddam and A. Pentland, “Probabilistic Visual Learning for Object Representation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 696-710, July 1997.
[17] B. Moghaddam, W. Wahid, and A. Pentland, “Beyond Eigenfaces: Probabilistic Matching for Face Recognition,” Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition, pp. 30-35, 1998.
[18] B. Moghaddam, “Principal Manfolds and Probabilistic Subspaces for Visual Recognition,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 6, pp. 780-788, June 2002.
[19] B. Moghaddam, C. Nastar, and A. Pentland, “A Bayesian Similarity Measure for Deformable Image Matching,” Image and Vision Computing, vol. 19, pp. 235-244, 2001.
[20] M. Lades, J. Vorbrüggen, J. Buhmann, J. Lange, C. von der Malsburg, R. Würtz, and W. Konen, “Distortion Invariant Object Recognition in the Dynamic Link Architecture,” IEEE Trans. Computers, vol. 42, no. 3, pp. 300-311, Mar. 1993.
[21] M. Vissac, J.-L. Dugelay, and K. Rose, “A Novel Indexing Approach for Multimedia Image Databases,” Proc. IEEE Workshop Multimedia Signal Processing, pp. 97-102, 1999.
[22] T. Sim, S. Baker, and M. Bsat, “The CMU Pose, Illumination, and Expression (Pie) Database,” Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition, 2002.
[23] A. Georghiades, P. Belhumeur, and D. Kriegman, “From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6 pp. 643-660, June 2001.
[24] A. Martínez and R. Benavente, “The AR Face Database,” Technical Report 24, CVC, 1998.
[25] F.S. Samaria, “Face Recognition Using Hidden Markov Models,” PhD dissertation, Univ. of Cambridge, Cambridge, U.K., 1994.
[26] A. Nefian, “A Hidden Markov Model-Based Approach for Face Detection and Recognition,” PhD dissertation, Georgia Inst. of Technology, Atlanta, 1999.
[27] S. Eickeler, S. Müller, and G. Rigoll, “Recognition of Jpeg Compressed Face Images Based on Statistical Methods,” Image and Vision Computing, vol. 18, no. 4, pp. 279-287, Mar. 2000.
[28] F. Cardinaux, C. Sanderson, and S. Bengio, “Face Verification Using Adapted Generative Models,” Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition (AFGR), pp. 825-830, 2004.
[29] T. Anastasakos, J. McDonough, R. Schwartz, and J. Makhoul, “A Compact Model for Speaker-Adaptive Training,” Proc. Int'l Conf. Spoken Language Processing, vol. 2, pp. 1137-1140, 1996.
[30] A. Acero and X. Huang, “Speaker and Gender Normalization for Continuous-Density Hidden Markov Models,” Proc. IEEE Int'l Conf. Acoustics Speech and Signal Processing, vol. 1, pp. 342-345, 1996.
[31] E. Bocchieri, “Phonetic Context Dependency Modeling by Transform,” Proc. Int'l Conf. Spoken Language Processing, vol. 4, pp. 179-182, 2000.
[32] L. Rabiner, “A Tutorial on Hidden Markov Models and Selected Applications,” Proc. IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1989.
[33] S.-Z. Li, “Markov Random Field Models in Computer Vision,” Proc. IEEE European Conf. Computer Vision (ECCV), vol. B, pp. 361-370, 1994.
[34] K. Abend, T. Harley, and L. Kanal, “Classification of Binary Random Patterns,” IEEE Trans. Information Theory (IT), vol. 11, no. 4, pp. 538-544, Oct. 1965.
[35] S. Kuo and O. Agazzi, “Keyword Spotting in Poorly Printed Documents,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 8, pp. 842-848, Aug. 1994.
[36] J. Li, A. Najmi, and R. Gray, “Image Classification by a Two-Dimensional Hidden Markov Model,” IEEE Trans. Signal Processing, vol. 48, no. 2, pp. 517-533, Feb. 2000.
[37] C. Miller, B. Hunt, M. Neifeld, and M. Marcellin, “Binary Image Reconstruction Via 2-D Viterbi Search,” Proc. IEEE Int'l Conf. Image Processing, vol. 1, pp. 181-184, 1997.
[38] K. Hallouli, L. Likforman-Sulem, and M. Sigelle, “A Comparative Study Between Decision Fusion and Data Fusion in Markovian Printed Character Recognition,” Proc. IEEE Int'l Conf. Pattern Recognition (ICPR), vol. 3, pp. 147-150, 2002.
[39] F. Perronnin, J.-L. Dugelay, and K. Rose, “Iterative Decoding of Two-Dimensional Hidden Markov Models,” Proc. IEEE Int'l Conf. Acoustics Speech and Signal Processing, vol. 3, pp. 329-332, 2003.
[40] A. Dempster, N. Laird, and D. Rubin, “Maximum Likelihood from Incomplete Data via the Em Algorithm,” J. the Royal Statistical Soc., vol. 39, no. 1, pp. 1-38, 1977.
[41] B. Horn, Robot Vision. McGraw-Hill, 1986.
[42] A.H.S.T. Kailath and B. Hassibi, Linear Estimation. Prentice Hall, 2000.
[43] F. Perronnin and J.-L. Dugelay, “From Turbo Hidden Markov Models to Turbo State-Space Models,” Proc. IEEE Int'l Conf. Acoustics Speech and Signal Processing, 2004.
[44] R. Singh and B. Raj, “Tracking Noise via Dynamical Systems with a Continuum of States,” Proc. IEEE Int'l Conf. Acoustics Speech and Signal Processing (ICASSP), vol. 1, pp. 396-399, 2003.
[45] J. Droppo and A. Acero, “Noise Robust Speech Recognition with a Switching Linear Dynamic Model,” Proc. IEEE Int'l Conf. Acoustics Speech and Signal Processing (ICASSP), vol. 1, pp. 953-956, 2004.
[46] M. Grudin, “On Internal Representations in Face Recognition Systems,” Pattern Recognition, vol. 33, no. 7, pp. 1161-1177, 2000.
[47] R. Gross, J. Shi, and J. Cohn, “Quo Vadis Face Recognition,” Proc. Workshop Empirical Evaluation Methods in Computer Vision, 2001.
[48] Y. Adini, Y. Moses, and S. Ullman, “Face Recognition: The Problem of Compensating for Changes in Illumination Direction,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 721-732, July 1997.
[49] M. Savvides and V. Kumar, “Illumination Normalization Using Logarithm Transforms for Face Authentication,” Proc. IAPR Audio- and Video-Based Biometric Person Authentication, pp. 549-556, 2003.
[50] G. Donato, M. Bartlett, J. Hager, P. Ekman, and T. Sejnowski, “Classifying Facial Actions,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 10, pp. 974-989, Oct. 1999.
[51] B. Duc, S. Fischer, and J. Bigün, “Face Authentication with Gabor Information on Deformable Graphs,” IEEE Trans. Pattern Analysis Machine Intelligence, vol. 8, no. 4, pp. 504-516, Apr. 1999.
[52] HTK, Hidden Markov Model Toolkit, http:/htk.eng.cam.ac.uk, Cambridge Univ., 2004.
[53] M. Teixeira and J.R. Beveridge, “An Implementation and Study of the Moghaddam and Pentland Intrapresonal/Extrapersonal Image Difference Face Recognition Algorithm,” technical report, Colorado State Univ., 2003.
[54] X. Wang and X. Tang, “Unified Subspace Analysis for Face Recognition,” Proc. IEEE Int'l Conf. Computer Vision, pp. 679-686, 2003.
[55] L. Kaufman and P. Rousseeuw, Finding Groups in Data: An Introduction to Cluster Analysis. John Wiley and Sons, 1990.
[56] D. Maltoni, D. Maio, A.K. Jain, and S. Prabhakar, Handbook of Fingerprint Recognition. Springer Verlag, 2003.
[57] S. Prabhakar, “Fingerprint Classification and Matching Using a Filterbank,” PhD dissertation, Michigan State Univ., 2001.

Index Terms:
Index Terms- Biometrics, face recognition, image processing, hidden Markov model, distance.
Citation:
Florent Perronnin, Jean-Luc Dugelay, Kenneth Rose, "A Probabilistic Model of Face Mapping with Local Transformations and Its Application to Person Recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 7, pp. 1157-1171, July 2005, doi:10.1109/TPAMI.2005.130
Usage of this product signifies your acceptance of the Terms of Use.