The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.10 - Oct. (2012 vol.34)
pp: 2019-2030
Soma Biswas , University of Notre Dame, Notre Dame
Kevin W. Bowyer , University of Notre Dame, Notre Dame
Patrick J. Flynn , University of Notre Dame, Notre Dame
ABSTRACT
Face recognition performance degrades considerably when the input images are of Low Resolution (LR), as is often the case for images taken by surveillance cameras or from a large distance. In this paper, we propose a novel approach for matching low-resolution probe images with higher resolution gallery images, which are often available during enrollment, using Multidimensional Scaling (MDS). The ideal scenario is when both the probe and gallery images are of high enough resolution to discriminate across different subjects. The proposed method simultaneously embeds the low-resolution probe images and the high-resolution gallery images in a common space such that the distance between them in the transformed space approximates the distance had both the images been of high resolution. The two mappings are learned simultaneously from high-resolution training images using an iterative majorization algorithm. Extensive evaluation of the proposed approach on the Multi-PIE data set with probe image resolution as low as 8 × 6 pixels illustrates the usefulness of the method. We show that the proposed approach improves the matching performance significantly as compared to performing matching in the low-resolution domain or using super-resolution techniques to obtain a higher resolution test image prior to recognition. Experiments on low-resolution surveillance images from the Surveillance Cameras Face Database further highlight the effectiveness of the approach.
INDEX TERMS
Probes, Iterative methods, Face recognition, Cameras, Spatial resolution, iterative majorization., Face recognition, low-resolution matching, multidimensional scaling
CITATION
Soma Biswas, Kevin W. Bowyer, Patrick J. Flynn, "Multidimensional Scaling for Matching Low-Resolution Face Images", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.34, no. 10, pp. 2019-2030, Oct. 2012, doi:10.1109/TPAMI.2011.278
REFERENCES
[1] W. Zhao, R. Chellappa, P. Phillips, and A. Rosenfeld, "Face Recognition: A Literature Survey," ACM Computing Surveys, vol. 35, no. 4, pp. 399-458, 2003.
[2] P. Hennings-Yeomans, S. Baker, and B. Kumar, "Simultaneous Super-Resolution and Feature Extraction for Recognition of Low-Resolution Faces," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2008.
[3] K. Jia and S. Gong, "Multi-Modal Tensor Face for Simultaneous Super-Resolution and Recognition," Proc. IEEE Int'l Conf. Computer Vision, pp. 1683-1690, 2005.
[4] S. Baker and T. Kanade, "Hallucinating Faces," Proc. Fourth Int'l Conf. Automatic Face and Gesture Recognition, Mar. 2000.
[5] A. Chakrabarti, A. Rajagopalan, and R. Chellappa, "Super-Resolution of Face Images Using Kernel PCA-Based Prior," IEEE Trans. Multimedia, vol. 9, no. 4, pp. 888-892, June 2007.
[6] R. Gross, I. Matthews, J. Cohn, T. Kanade, and S. Baker, "Guide to the CMU Multi-Pie Database," technical report, Carnegie Mellon Univ., 2007.
[7] M. Grgic, K. Delac, and S. Grgic, "SCface—Surveillance Cameras Face Database," Multimedia Tools and Applications J., vol. 51, pp. 863-879, 2009.
[8] S. Biswas, K.W. Bowyer, and P.J. Flynn, "Multidimensional Scaling for Matching Low-Resolution Facial Images," Proc. IEEE Int'l Conf. Biometrics: Theory, Applications, and Systems, 2010.
[9] S. Baker and T. Kanade, "Limits on Super-Resolution and How to Break Them," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 9, pp. 1167-1183, Sept. 2002.
[10] C. Liu, H.Y. Shum, and W.T. Freeman, "Face Hallucination: Theory and Practice," Int'l J. Computer Vision, vol. 75, no. 1, pp. 115-134, 2007.
[11] W.T. Freeman, T. Jones, and E. Pasztor, "Example-Based Super-Resolution," IEEE Computer Graphics and Applications, vol. 22, no. 2, pp. 56-65, Mar./Apr. 2002.
[12] H. Chang, D. Yeung, and Y. Xiong, "Super-Resolution through Neighbor Embedding," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 275-282, 2004.
[13] W. Liu, D. Lin, and X. Tang, "Hallucinating Faces: Tensorpatch Super-Resolution and Coupled Residue Compensation," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 478-484, 2005.
[14] J. Yang, J. Wright, T. Huang, and Y. Ma, "Image Super-Resolution via Sparse Representation," IEEE Trans. Image Processing, vol. 19, no. 11, pp. 2861-2873, Nov. 2010.
[15] I.K. Kim and Y. Kwon, "Single-Image Super-Resolution Using Sparse Regression and Natural Image Prior," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 6, pp. 1127-1133, June 2010.
[16] B. Gunturk, A. Batur, Y. Altunbasak, M. Hayes, and R. Mersereau, "Eigenface-Domain Super-Resolution for Face Recognition," IEEE Trans. Image Processing, vol. 12, no. 5, pp. 597-606, May 2003.
[17] S. Lee, J. Park, and S. Lee, "Low Resolution Face Recognition Based on Support Vector Data Description," Pattern Recognition, vol. 39, no. 9, pp. 1809-1812, 2006.
[18] J. Heo, M. Savvides, and B. Vijayakumar, "Advanced Correlation Filters for Face Recognition Using Low-Resolution Visual and Thermal Imagery," Proc. Int'l Conf. Image Analysis and Recognition, pp. 1089-1097, 2005.
[19] M. Elad and A. Feuer, "Super-Resolution Reconstruction of Image Sequences," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 9, pp. 817-834, Sept. 1999.
[20] O. Arandjelovic and R. Cipolla, "A Manifold Approach to Face Recognition from Low Quality Video across Illumination and Pose Using Implicit Super-Resolution," Proc. IEEE Int'l Conf. Computer Vision, 2007.
[21] A. Webb, "Multidimensional Scaling by Iterative Majorization Using Radial Basis Functions," Pattern Recognition, vol. 28, no. 5, pp. 753-759, May 1995.
[22] J.d. Leeuw, Recent Developments in Statistics, chap. Applications of Convex Analysis to Multi-Dimensional Scaling, pp. 133-145, 1977.
[23] I. Borg and P. Groenen, Modern Multidimensional Scaling: Theory and Applications, second ed. Springer, 2005.
[24] T. Sim, S. Baker, and M. Bsat, "The CMU Pose, Illumination, and Expression Database," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 12, pp. 1615-1618, Dec. 2003.
[25] M. Turk and A. Pentland, "Eigenfaces for Recognition," J. Cognitive Neurosicence, vol. 3, no. 1, pp. 71-86, 1991.
[26] P. Phillips, P. Flynn, T. Scruggs, K. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. Worek, "Overview of the Face Recognition Grand Challenge," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 947-954, 2005.
[27] J.G. Daugman and G.O. Williams, "A Proposed Standard for Biometric Decidability," Proc. CardTechSecureTech, pp. 223-234, 1996.
[28] http://www.ifp.illinois.edu jyang29/, 2011.
[29] http://www.mpi-inf.mpg.de kkim/, 2012.
[30] P.J. Phillips, "Support Vector Machines Applied to Face Recognition," Proc. Conf. Advances in Neural Information Processing Systems, pp. 803-809, 1998.
[31] P.N. Belhumeur, J.P. Hespanha, and D.J. Kriegman, "Eigenfaces versus Fisherfaces: Recognition Using Class Specific Linear Projection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 711-720, July 1997.
[32] S.K. Zhou, G. Aggarwal, R. Chellappa, and D.W. Jacobs, "Appearance Characterization of Linear Lambertian Objects, Generalized Photometric Stereo, and Illumination-Invariant Face Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 2, pp. 230-245, Feb. 2007.
[33] J. Wright, A.Y. Yang, A. Ganesh, S. Sastry, and D.W. Jacobs, "Robust Face Recognition via Sparse Representation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 2, pp. 210-227, Feb. 2009.
[34] T. Ahonen, A. Hadid, and M. Pietikinen, "Face Description with Local Binary Patterns: Application to Face Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 12, pp. 2037-2041, Dec. 2006.
18 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool