The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.06 - June (2013 vol.35)
pp: 1410-1422
Brendan F. Klare , Noblis, Falls Church
Anil K. Jain , Michigan State University, East Lansing and Korea University, Seoul
ABSTRACT
Heterogeneous face recognition (HFR) involves matching two face images from alternate imaging modalities, such as an infrared image to a photograph or a sketch to a photograph. Accurate HFR systems are of great value in various applications (e.g., forensics and surveillance), where the gallery databases are populated with photographs (e.g., mug shot or passport photographs) but the probe images are often limited to some alternate modality. A generic HFR framework is proposed in which both probe and gallery images are represented in terms of nonlinear similarities to a collection of prototype face images. The prototype subjects (i.e., the training set) have an image in each modality (probe and gallery), and the similarity of an image is measured against the prototype images from the corresponding modality. The accuracy of this nonlinear prototype representation is improved by projecting the features into a linear discriminant subspace. Random sampling is introduced into the HFR framework to better handle challenges arising from the small sample size problem. The merits of the proposed approach, called prototype random subspace (P-RS), are demonstrated on four different heterogeneous scenarios: 1) near infrared (NIR) to photograph, 2) thermal to photograph, 3) viewed sketch to photograph, and 4) forensic sketch to photograph.
INDEX TERMS
Face, Face recognition, Kernel, Prototypes, Probes, Forensics, Training,forensic sketch, Heterogeneous face recognition, prototypes, nonlinear similarity, discriminant analysis, local descriptors, random subspaces, thermal image, infrared image
CITATION
Brendan F. Klare, Anil K. Jain, "Heterogeneous Face Recognition Using Kernel Prototype Similarities", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 6, pp. 1410-1422, June 2013, doi:10.1109/TPAMI.2012.229
REFERENCES
[1] S. Li, Encyclopedia of Biometrics. Springer, 2009.
[2] P.J. Grother, G.W. Quinn, and P.J. Phillips, "MBE 2010: Report on the Evaluation of 2D Still-Image Face Recognition Algorithms," Nat'l Inst. of Standards and Technology, vol. 7709, 2010.
[3] X. Tang and X. Wang, "Face Sketch Recognition," IEEE Trans. Circuits and Systems for Video Technology, vol. 14, no. 1, pp. 50-57, Jan. 2004.
[4] Q. Liu, X. Tang, H. Jin, H. Lu, and S. Ma, "A Nonlinear Approach for Face Sketch Synthesis and Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1005-1010, 2005.
[5] X. Wang and X. Tang, "Face Photo-Sketch Synthesis and Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 11, pp. 1955-1967, Nov. 2009.
[6] X. Gao, J. Zhong, J. Li, and C. Tian, "Face Sketch Synthesis Algorithm Based on E-HMM and Selective Ensemble," IEEE Trans. Circuits and Systems for Video Technology, vol. 18, no. 4, pp. 487-496, Apr. 2008.
[7] W. Zhang, X. Wang, and X. Tang, "Lighting and Pose Robust Face Sketch Synthesis," Proc. European Conf. Computer Vision, 2010.
[8] S. Liao, D. Yi, Z. Lei, R. Qin, and S. Li, "Heterogeneous Face Recognition from Local Structures of Normalized Appearance," Proc. Third Int'l Conf. Advances in Biometrics, 2009.
[9] B. Klare, Z. Li, and A. Jain, "Matching Forensic Sketches to Mugshot Photos," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 33, no. 3, pp. 639-646, Mar. 2011.
[10] B. Klare and A. Jain, "Heterogeneous Face Recognition: Matching NIR to Visible Light Images," Proc. Int'l Conf. Pattern Recognition, 2010.
[11] H. Bhatt, S. Bharadwaj, R. Singh, and M. Vatsa, "On Matching Sketches with Digital Face Images," Proc. IEEE Conf. Biometrics: Theory, Applications, and Systems, pp. 1-7, 2010.
[12] Z. Lei and S. Li, "Coupled Spectral Regression for Matching Heterogeneous Faces," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1123-1128, 2009.
[13] T. Ojala, M. Pietikäinen, and T. Mäenpää, "Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 7, pp. 971-987, July 2002.
[14] D. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," Int'l J. Computer Vision, vol. 60, no. 2, pp. 91-110, 2004.
[15] D. Yi, S. Liao, Z. Lei, J. Sang, and S. Li, "Partial Face Matching between Near Infrared and Visual Images in MBGC Portal Challenge," Proc. Third Int'l Conf. Advances in Biometrics, pp. 733-742, 2009.
[16] W. Zhang, X. Wang, and X. Tang, "Coupled Information-Theoretic Encoding for Face Photo-Sketch Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2011.
[17] J. Li, P. Hao, C. Zhang, and M. Dou, "Hallucinating Faces from Thermal Infrared Images," Proc. Int'l Conf. Image Processing, pp. 465-468, 2008.
[18] D. Lin and X. Tang, "Inter-Modality Face Recognition," Proc. European Conf. Computer Vision, 2006.
[19] M.-F. Balcan, A. Blum, and S. Vempala, "Kernels as Features: On Kernels, Margins, and Low-Dimensional Mappings," Machine Learning, vol. 65, pp. 79-94, 2006.
[20] A. Quattoni, M. Collins, and T. Darrell, "Transfer Learning for Image Classification with Sparse Prototype Representations," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[21] K.I. Kim, K. Jung, and H.J. Kim, "Face Recognition Using Kernel Principal Component Analysis," IEEE Signal Processing Letters, vol. 9, no. 2, pp. 40-42, Feb. 2002.
[22] Q. Liu, H. Lu, and S. Ma, "Improving Kernel Fisher Discriminant Analysis for Face Recognition," IEEE Trans. Circuits and Systems for Video Technology, vol. 14, no. 1, pp. 42-49, Jan. 2004.
[23] L. Juwei, K. Plataniotis, and A. Venetsanopoulos, "Face Recognition Using Kernel Direct Discriminant Analysis Algorithms," IEEE Trans. Neural Networks, vol. 14, no. 1, pp. 117-126, Jan. 2003.
[24] A. Gyaourova and A. Ross, "Index Codes for Multibiometric Pattern Retrieval," IEEE Trans. Information Forensics and Security, vol. 7, no. 2, pp. 518-529, Apr. 2012.
[25] B. Klare and A. Jain, "Sketch to Photo Matching: A Feature-Based Approach," Proc. SPIE Conf. Biometric Technology for Human Identification, 2010.
[26] M. Riesenhuber and T. Poggio, "Hierarchical Models of Object Recognition in Cortex," Nature Neuroscience, vol. 2, no. 11, pp. 1019-1025, 1999.
[27] B. Klare and A.K. Jain, "On a Taxonomy of Facial Features," Proc. IEEE Conf. Biometrics: Theory, Applications, and Systems, 2010.
[28] FaceVACS Software Developer Kit, Cognitec Systems GmbH, http:/www.cognitec-systems.de, 2012.
[29] X. Tan and B. Triggs, "Enhanced Local Texture Feature Sets for Face Recognition under Difficult Lighting Conditions," IEEE Trans. Image Processing, vol. 19, no. 6, pp. 1635-1650, June 2010.
[30] E. Meyers and L. Wolf, "Using Biologically Inspired Features for Face Processing," Int'l J. Computer Vision, vol. 76, no. 1, pp. 93-104, 2008.
[31] T. Ahonen, A. Hadid, and M. Pietikainen, "Face Description with Local Binary Patterns: Application to Face Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 12, pp. 2037-2041, Dec. 2006.
[32] S. Li, R. Chu, S. Liao, and L. Zhang, "Illumination Invariant Face Recognition Using Near-Infrared Images," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 4, pp. 627-639, Apr. 2007.
[33] P. Belhumeur, J. Hespanda, and D. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 711-720, July 1997.
[34] X. Wang and X. Tang, "Dual-Space Linear Discriminant Analysis for Face Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004.
[35] C. Liu and H. Wechsler, "Gabor Feature Based Classification Using the Enhanced Fisher Linear Discriminant Model for Face Recognition," IEEE Trans. Image Processing, vol. 11, no. 4, pp. 467-476, Apr. 2002.
[36] S. Raudys and A. Jain, "Small Sample Size Effects in Statistical Pattern Recognition: Recommendations for Practitioners," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 3, pp. 252-264, Mar. 1991.
[37] H.Y. Jie, H. Yu, and J. Yang, "A Direct LDA Algorithm for High-Dimensional Data—with Application to Face Recognition," Pattern Recognition, vol. 34, pp. 2067-2070, 2001.
[38] J. Lu, K. Plataniotis, and A. Venetsanopoulos, "Regularization Studies of Linear Discriminant Analysis in Small Sample Size Scenarios with Application to Face Recognition," Pattern Recognition Letters, vol. 26, no. 2, pp. 181-191, 2005.
[39] T.K. Ho, "The Random Subspace Method for Constructing Decision Forests," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 8, pp. 832-844, Aug. 1998.
[40] L. Breiman, "Bagging Predictors," Machine Learning, vol. 24, pp. 123-140, 1996.
[41] T. Dietterich, "Ensemble Methods in Machine Learning," Multiple Classifier Systems, vol. 1857, pp. 1-15, 2000.
[42] X. Wang and X. Tang, "Random Sampling for Subspace Face Recognition," Int'l J. Computer Vision, vol. 70, no. 1, pp. 91-104, 2006.
[43] A. Martinez and R. Benavente, "The AR Face Database," Technical Report 24, CVC, 1998.
[44] K. Messer, J. Matas, J. Kittler, and K. Jonsson, "XM2VTSDB: The Extended M2VTS Database," Proc. Audio and Video-Based Biometric Person Authentication, 1999.
[45] L. Gibson, Forensic Art Essentials. Elsevier, 2008.
[46] K. Taylor, Forensic Art and Illustration. CRC Press, 2001.
[47] P. Phillips, H. Moon, P. Rauss, and S. Rizvi, "The FERET Evaluation Methodology for Face-Recognition Algorithms," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1997.
64 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool