The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.03 - March (2011 vol.33)
pp: 639-646
Brendan F. Klare , Michigan State University, East Lansing
Zhifeng Li , Michigan State University, East Lansing
Anil K. Jain , Michigan State University, East Lansing and Korea University, Seoul
ABSTRACT
The problem of matching a forensic sketch to a gallery of mug shot images is addressed in this paper. Previous research in sketch matching only offered solutions to matching highly accurate sketches that were drawn while looking at the subject (viewed sketches). Forensic sketches differ from viewed sketches in that they are drawn by a police sketch artist using the description of the subject provided by an eyewitness. To identify forensic sketches, we present a framework called local feature-based discriminant analysis (LFDA). In LFDA, we individually represent both sketches and photos using SIFT feature descriptors and multiscale local binary patterns (MLBP). Multiple discriminant projections are then used on partitioned vectors of the feature-based representation for minimum distance matching. We apply this method to match a data set of 159 forensic sketches against a mug shot gallery containing 10,159 images. Compared to a leading commercial face recognition system, LFDA offers substantial improvements in matching forensic sketches to the corresponding face images. We were able to further improve the matching performance using race and gender information to reduce the target gallery size. Additional experiments demonstrate that the proposed framework leads to state-of-the-art accuracys when matching viewed sketches.
INDEX TERMS
Face recognition, forensic sketch, viewed sketch, local feature discriminant analysis, feature selection, heterogeneous face recognition.
CITATION
Brendan F. Klare, Zhifeng Li, Anil K. Jain, "Matching Forensic Sketches to Mug Shot Photos", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.33, no. 3, pp. 639-646, March 2011, doi:10.1109/TPAMI.2010.180
REFERENCES
[1] B. Klare and A. Jain, "Sketch to Photo Matching: A Feature-Based Approach," Proc. SPIE Conf. Biometric Technology for Human Identification VII, 2010.
[2] X. Tang and X. Wang, "Face Sketch Recognition," IEEE Trans. Circuits and Systems for Video Technology, vol. 14, no. 1, pp. 50-57, Jan. 2004.
[3] Q. Liu, X. Tang, H. Jin, H. Lu, and S. Ma, "A Nonlinear Approach for Face Sketch Synthesis and Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1005-1010, 2005.
[4] J. Zhong, X. Gao, and C. Tian, "Face Sketch Synthesis Using E-HMM and Selective Ensemble," Proc. IEEE Conf. Acoustics, Speech, and Signal Processing, 2007.
[5] X. Wang and X. Tang, "Face Photo-Sketch Synthesis and Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 11, pp. 1955-1967, Nov. 2009.
[6] X. Tang and X. Wang, "Face Sketch Synthesis and Recognition," Proc. IEEE Int'l Conf. Computer Vision, pp. 687-694, 2003.
[7] D. Lin and X. Tang, "Inter-Modality Face Recognition," Proc. European Conf. Computer Vision, 2006.
[8] X. Gao, J. Zhong, J. Li, and C. Tian, "Face Sketch Synthesis Algorithm Based on E-HMM and Selective Ensemble," IEEE Trans. Circuits and Systems for Video Technology, vol. 18, no. 4, pp. 487-496, Apr. 2008.
[9] B. Xiao, X. Gao, D. Tao, and X. Li, "A New Approach for Face Recognition by Sketches in Photos," Signal Processing, vol. 89, no. 8, pp. 1576-1588, 2009.
[10] W. Liu, X. Tang, and J. Liu, "Bayesian Tensor Inference for Sketch-Based Facial Photo Hallucination," Proc. 20th Int'l Joint Conf. Artificial Intelligence, 2007.
[11] Y. Li, M. Savvides, and V. Bhagavatula, "Illumination Tolerant Face Recognition Using a Novel Face from Sketch Synthesis Approach and Advanced Correlation Filters," Proc. IEEE Int'l Conf. Acoustics, Speech and Signal Processing, 2006.
[12] H. Nizami, J. Adkins-Hill, Y. Zhang, J. Sullins, C. McCullough, S. Canavan, and L. Yin, "A Biometric Database with Rotating Head Videos and Hand-Drawn Face Sketches," Proc. IEEE Conf. Biometrics: Theory, Applications, and Systems, 2009.
[13] D. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," Int'l J. Computer Vision, vol. 60, no. 2, pp. 91-110, 2004.
[14] S. Liao, D. Yi, Z. Lei, R. Qin, and S. Li, "Heterogeneous Face Recognition from Local Structures of Normalized Appearance," Proc. Third Int'l Conf. Biometrics, 2009.
[15] Z. Lei and S. Li, "Coupled Spectral Regression for Matching Heterogeneous Faces," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1123-1128, June 2009.
[16] B. Klare and A. Jain, "Heterogeneous Face Recognition: Matching NIR to Visible Light Images," Proc. Int'l Conf. Pattern Recognition, 2010.
[17] T. Ojala, M. Pietikäinen, and T. Mäenpää, "Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 7, pp. 971-987, July 2002.
[18] K. Mikolajczyk and C. Schmid, "A Performance Evaluation of Local Descriptors," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 10, pp. 1615-1630, Oct. 2005.
[19] T. Ahonen, A. Hadid, and M. Pietikainen, "Face Description with Local Binary Patterns: Application to Face Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 12, pp. 2037-2041, Dec. 2006.
[20] B. Klare, Z. Li, and A. Jain, "On Matching Forensic Sketches to Mug Shot Photos," MSU Technical Report MSU-CSE-10-3, 2010.
[21] E. Meyers and L. Wolf, "Using Biologically Inspired Features for Face Processing," Int'l J. Computer Vision, vol. 76, no. 1, pp. 93-104, 2008.
[22] S. Raudys and A. Jain, "Small Sample Size Effects in Statistical Pattern Recognition: Recommendations for Practitioners," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 3, pp. 252-264, Mar. 1991.
[23] X. Wang and X. Tang, "Random Sampling for Subspace Face Recognition," Int'l J. Computer Vision, vol. 70, no. 1, pp. 91-104, 2006.
[24] J. Lu, K. Plataniotis, and A. Venetsanopoulos, "Regularization Studies of Linear Discriminant Analysis in Small Sample Size Scenarios with Application to Face Recognition," Pattern Recognition Letters, vol. 26, no. 2, pp. 181-191, 2005.
[25] H.Y. Jie, H. Yu, and J. Yang, "A Direct LDA Algorithm for High-Dimensional Data—with Application to Face Recognition," Pattern Recognition, vol. 34, pp. 2067-2070, 2001.
[26] FaceVACS Software Developer Kit, Cognitec Systems GmbH, http:/www.cognitec-systems.de, 2010.
[27] A. Martinez and R. Benavente, "The AR Face Database," CVC Technical Report 24, 1998.
[28] K. Messer, J. Matas, J. Kittler, and K. Jonsson, "XM2VTSDB: The Extended M2VTS Database," Proc. Int'l Conf. Audio and Video-Based Biometric Person Authentication, 1999.
[29] A. Ross and A. Jain, "Information Fusion in Biometrics," Pattern Recognition Letters, vol. 24, no. 13, pp. 2115-2125, 2003.
[30] R. Uhl and N. Lobo, "A Framework for Recognizing a Facial Image from a Police Sketch," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1996.
[31] P. Yuen and C. Man, "Human Face Image Searching System Using Sketches," IEEE Trans. Systems, Man, and Cybernetics, vol. 37, no. 4, pp. 493-504, July 2007.
[32] L. Gibson, Forensic Art Essentials. Elsevier, 2008.
[33] K. Taylor, Forensic Art and Illustration. CRC Press, 2001.
[34] A.K. Jain, S.C. Dass, and K. Nandakumar, "Soft Biometric Traits for Personal Recognition Systems," Proc. Int'l Conf. Biometric Authentication, 2004.
[35] C. Frowd, V. Bruce, A. McIntyr, and P. Hancock, "The Relative Importance of External and Internal Features of Facial Composites," British J. Psychology, vol. 98, no. 1, pp. 61-77, 2007.
7 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool