The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.05 - May (2013 vol.35)
pp: 1164-1177
Chi Ho Chan , Center for Vision, Speech & Signal Process., Univ. of Surrey, Guildford, UK
M. A. Tahir , Center for Vision, Speech & Signal Process., Univ. of Surrey, Guildford, UK
J. Kittler , Center for Vision, Speech & Signal Process., Univ. of Surrey, Guildford, UK
M. Pietikäinen , Dept. of Electr. & Inf. Eng., Univ. of Oulu, Oulu, Finland
ABSTRACT
Face recognition subject to uncontrolled illumination and blur is challenging. Interestingly, image degradation caused by blurring, often present in real-world imagery, has mostly been overlooked by the face recognition community. Such degradation corrupts face information and affects image alignment, which together negatively impact recognition accuracy. We propose a number of countermeasures designed to achieve system robustness to blurring. First, we propose a novel blur-robust face image descriptor based on Local Phase Quantization (LPQ) and extend it to a multiscale framework (MLPQ) to increase its effectiveness. To maximize the insensitivity to misalignment, the MLPQ descriptor is computed regionally by adopting a component-based framework. Second, the regional features are combined using kernel fusion. Third, the proposed MLPQ representation is combined with the Multiscale Local Binary Pattern (MLBP) descriptor using kernel fusion to increase insensitivity to illumination. Kernel Discriminant Analysis (KDA) of the combined features extracts discriminative information for face recognition. Last, two geometric normalizations are used to generate and combine multiple scores from different face image scales to further enhance the accuracy. The proposed approach has been comprehensively evaluated using the combined Yale and Extended Yale database B (degraded by artificially induced linear motion blur) as well as the FERET, FRGC 2.0, and LFW databases. The combined system is comparable to state-of-the-art approaches using similar system configurations. The reported work provides a new insight into the merits of various face representation and fusion methods, as well as their role in dealing with variable lighting and blur degradation.
INDEX TERMS
Face, Kernel, Face recognition, Histograms, Vectors, Lighting, Databases,kernel fusion, Face recognition, face image representation, local binary pattern, local phase quantization, kernel discriminant analysis
CITATION
Chi Ho Chan, M. A. Tahir, J. Kittler, M. Pietikäinen, "Multiscale Local Phase Quantization for Robust Component-Based Face Recognition Using Kernel Fusion of Multiple Descriptors", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 5, pp. 1164-1177, May 2013, doi:10.1109/TPAMI.2012.199
REFERENCES
[1] T. Ahonen, A. Hadid, and M. Pietikäinen, "Face Description with Local Binary Patterns: Application to Face Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 12, pp. 2037-2041, Dec. 2006.
[2] T. Ahonen, E. Rahtu, V. Ojansivu, and J. Heikkilä, "Recognition of Blurred Faces Using Local Phase Quantization," Proc. Int'l Conf. Pattern Recognition, pp. 1-4, 2008.
[3] E. Bailly-Bailliére, S. Bengio, F. Bimbot, M. Hamouz, J. Kittler, J. Mariéthoz, J. Matas, K. Messer, V. Popovici, F. Porée, B. Ruíz, and J.-P. Thiran, "The BANCA Database and Evaluation Protocol," Proc. Int'l Conf. Audio- and Video-Based Biometric Person Authentication, pp. 625-638, 2003.
[4] M.R. Banham and A.K. Katsaggelos, "Digital Image Restoration," IEEE Signal Processing Magazine, vol. 14, no. 2, pp. 24-41, Mar. 1997.
[5] P.N. Belhumeur, J.P. Hespanha, and D.J. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 711-720, July 1997.
[6] R. Beveridge, D. Bolme, M. Teixeira, and B. Draper, "The CSU Face Identification Evaluation System User's Guide: Version 5.0.," technical report, 2003.
[7] D. Cai, X. He, and J. Han, "Efficient Kernel Discriminant Analysis via Spectral Regression," Proc. Int'l Conf. Data Mining, 2007.
[8] C-H. Chan and J. Kittler, "Sparse Representation of (Multiscale) Histograms for Face Recognition Robust to Registration and Illumination Problems," Proc. Int'l Conf. Image Processing, pp. 2441-2444, 2010.
[9] C-H. Chan, J. Kittler, and K. Messer, "Multi-Scale Local Binary Pattern Histograms for Face Recognition," Proc. Int'l Conf. Biometrics, pp. 809-818, 2007.
[10] C-H. Chan, J. Kittler, N. Poh, T. Ahonen, and M. Pietikäinen, "(Multiscale) Local Phase Quantization Histogram Discriminant Analysis with Score Normalisation for Robust Face Recognition," Proc. Int'l Workshop Video-Oriented Object and Event Classification, pp. 633-640, 2009.
[11] C-H. Chan, J. Kittler, and M.A. Tahir, "Kernel Fusion of Multiple Histogram Descriptors for Robust Face Recognition," Proc. IAPR Int'l Conf. Structural, Syntactic, and Statistical Pattern Recognition, pp. 718-727, 2010.
[12] J.G. Daugman, "High Confidence Visual Recognition of Persons by a Test of Statistical Independence," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 11, pp. 1148-1161, Nov. 1993.
[13] A.S. Georghiades, P.N. Belhumeur, and D.J. Kriegman, "From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 643-660, June 2001.
[14] M. Guillaumin, J. Verbeek, and C. Schmid, "Is That You? Metric Learning Approaches for Face Identification," Proc. IEEE Int'l Conf. Computer Vision, 2009.
[15] J. Heikkilä and V. Ojansivu, "Methods for Local Phase Quantization in Blur-Insensitive Image Analysis," Proc. Int'l Workshop Local and Non-Local Approximation in Image Processing, pp. 104-111, 2009.
[16] C. Huang, S. Zhu, and K. Yu, "Large Scale Strongly Supervised Ensemble Metric Learning, with Applications to Face Verification and Retrieval," Technical Report TR115, NEC Laboratories Am., 2011.
[17] G.B. Huang and V. Jain, "Unsupervised Joint Alignment of Complex Images," Proc. IEEE Int'l Conf. Computer Vision, 2007.
[18] G.B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller, "Labeled Faces in the Wild: A Database for Studying Face Recognition in Unconstrained Environments," Technical Report 07-49, Univ. of Massachusetts, Amherst, Oct. 2007.
[19] W. Hwang, G. Park, J. Lee, and S-C. Kee, "Multiple Face Model of Hybrid Fourier Feature for Large Face Image Set," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1574-1581, 2006.
[20] A.K. Jain and S.Z. Li, Handbook of Face Recognition. Springer-Verlag, 2004.
[21] P. Li, Y. Fu, U. Mohammed, J.H. Elder, and S.J.D. Prince, "Probabilistic Models for Inference About Identity," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 34, no. 1, pp. 144-157, Jan. 2012.
[22] Z. Liu and C. Liu, "Robust Face Recognition Using Color Information," Proc. Int'l Conf. Biometrics, pp. 122-131, 2009.
[23] V. Ojansivu and J. Heikkilä, "Blur Insensitive Texture Classification Using Local Phase Quantization," Proc. Int'l Conf. Image and Signal Processing, pp. 236-243, 2008.
[24] A.V. Oppenheim and J.S. Lim, "The Importance of Phase in Signals," Proc. IEEE, vol. 69, no. 5, pp. 529-541, May 1981.
[25] P.J. Phillips, P.J. Flynn, W.T. Scruggs, K.W. Bowyer, J. Chang, K.J. Hoffman, J. Marques, J. Min, and W.J. Worek, "Overview of the Face Recognition Grand Challenge," Proc. IEEE Computer Vision and Pattern Recognition, pp. 947-954, 2005.
[26] P.J. Phillips, H. Moon, P. Rauss, and S.A. Rizvi, "The FERET Evaluation Methodology for Face-Recognition Algorithms," Proc. IEEE Computer Vision and Pattern Recognition, p. 137, 1997.
[27] N. Pinto, J.J. DiCarlo, and D.D. Cox, "How Far Can You Get with a Modern Face Recognition Test Set Using Only Simple Features?" Proc. IEEE Computer Vision and Pattern Recognition, pp. 2591-2598, 2009.
[28] E. Rahtu, J. Heikkilä, V. Ojansivu, and T. Ahonen, "Local Phase Quantization for Blur-Insensitive Image Analysis," Image and Vision Computing, vol 30, pp. 501-512, 2012.
[29] S. Shan, W. Zhang, Y. Su, X. Chen, and W. Gao, "Ensemble of Piecewise FDA Based on Spatial Histograms of Local (Gabor) Binary Patterns for Face Recognition," Proc. Int'l Conf. Pattern Recognition, 2006.
[30] S. Shan, Y. Chang, W. Gao, B. Cao, and P. Yang, "Curse of Mis-Alignment in Face Recognition: Problem and a Novel Mis-Alignment Learning Solution," Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition, pp. 314-320, 2004.
[31] Y. Su, S. Shan, X. Chen, and W. Gao, "Hierarchical Ensemble of Global and Local Classifiers for Face Recognition," IEEE Trans. Image Processing, vol. 18, no. 8, pp. 1885-1896, Aug. 2009.
[32] Y. Taigman, L. Wolf, and T. Hassner, "Multiple One-Shots for Utilizing Class Label Information," Proc. British Machine Vision Conf., Sept. 2009.
[33] Y. Taigman and L. Wolf, "Leveraging Billions of Faces to Overcome Performance Barriers in Unconstrained Face Recognition," CoRR, abs/1108.1122, 2011.
[34] X. Tan and B. Triggs, "Enhanced Local Texture Feature Sets for Face Recognition under Difficult Lighting Conditions," Proc. Int'l Conf. Analysis and Modeling of Faces and Gestures, pp. 168-182, 2007.
[35] X. Tan and B. Triggs, "Fusing Gabor and LBP Feature Sets for Kernel-Based Face Recognition," Proc. Int'l Conf. Analysis and Modeling of Faces and Gestures, 2007.
[36] X. Tan and B. Triggs, "Enhanced Local Texture Feature Sets for Face Recognition under Difficult Lighting Conditions," IEEE Trans. Image Processing, vol. 19, no. 6, pp. 1635-1650, June 2010.
[37] M.A. Turk and A.P. Pentland, "Face Recognition Using Eigenfaces," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 586-591, 1991.
[38] A. Wagner, J. Wright, A. Ganesh, Z. Zhou, and Y. Ma, "Towards a Practical Face Recognition System: Robust Registration and Illumination by Sparse Representation," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 597-604, 2009.
[39] H. Wang, S. Yan, T.S. Huang, J. Liu, and X. Tang, "Misalignment-Robust Face Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[40] L. Wolf, T. Hassner, and Y. Taigman, "Similarity Scores Based on Background Samples," Proc. Asian Conf. Computer Vision, pp. 88-97, 2009.
[41] J. Wright, A.Y. Yang, A. Ganesh, S.S. Sastry, and Y. Ma, "Robust Face Recognition via Sparse Representation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 2, pp. 210-227, Feb. 2009.
[42] B. Zhang, S. Shan, X. Chen, and W. Gao, "Histogram of Gabor Phase Patterns (HGPP): A Novel Object Representation Approach for Face Recognition," IEEE Trans. Image Processing, vol. 16, no. 1, pp. 57-68, Jan. 2007.
[43] J. Zhang, M. Marszaek, S. Lazebnik, and C. Schmid, "Local Features and Kernels for Classification of Texture and Object Categories: A Comprehensive Study," Int'l J. Computer Vision, vol. 73, no. 2, pp. 213-238, June 2007.
[44] J. Zhao, H. Wang, H. Ren, and S-C. Kee, "LBP Discriminant Analysis for Face Verification," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 3, pp. 167-167, 2005.
[45] W-Y. Zhao, R. Chellappa, P.J. Phillips, and A. Rosenfeld, "Face Recognition: A Literature Survey," ACM Computing Surveys, vol. 35, no. 4, pp. 399-458, 2003.
8 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool