This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Capitalize on Dimensionality Increasing Techniques for Improving Face Recognition Grand Challenge Performance
May 2006 (vol. 28 no. 5)
pp. 725-737
This paper presents a novel pattern recognition framework by capitalizing on dimensionality increasing techniques. In particular, the framework integrates Gabor image representation, a novel multiclass Kernel Fisher Analysis (KFA) method, and fractional power polynomial models for improving pattern recognition performance. Gabor image representation, which increases dimensionality by incorporating Gabor filters with different scales and orientations, is characterized by spatial frequency, spatial locality, and orientational selectivity for coping with image variabilities such as illumination variations. The KFA method first performs nonlinear mapping from the input space to a high-dimensional feature space, and then implements the multiclass Fisher discriminant analysis in the feature space. The significance of the nonlinear mapping is that it increases the discriminating power of the KFA method, which is linear in the feature space but nonlinear in the input space. The novelty of the KFA method comes from the fact that 1) it extends the two-class kernel Fisher methods by addressing multiclass pattern classification problems and 2) it improves upon the traditional Generalized Discriminant Analysis (GDA) method by deriving a unique solution (compared to the GDA solution, which is not unique). The fractional power polynomial models further improve performance of the proposed pattern recognition framework. Experiments on face recognition using both the FERET database and the FRGC (Face Recognition Grand Challenge) databases show the feasibility of the proposed framework. In particular, experimental results using the FERET database show that the KFA method performs better than the GDA method and the fractional power polynomial models help both the KFA method and the GDA method improve their face recognition performance. Experimental results using the FRGC databases show that the proposed pattern recognition framework improves face recognition performance upon the BEE baseline algorithm and the LDA-based baseline algorithm by large margins.

[1] E. Anderson et al., LAPACK Users' Guide, third ed., SIAM, 1999.
[2] G. Baudat and F. Anouar, “Generalized Discriminant Analysis Using a Kernel Approach,” Neural Computation, vol. 12, no. 10, pp. 2385-2404, 2000.
[3] P.N. Belhumeur, J.P. Hespanha, and D.J. Kriegman, “Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 711-720, July 1997.
[4] K.W. Bowyer, K. Chang, and P. Flynn, “A Survey of Approaches to Three-Dimensional Face Recognition,” Proc. 17th Int'l Conf. Pattern Recognition, pp. 358-361, 2004.
[5] T. Cooke, “Two Variations on Fisher's Linear Discriminant for Pattern Recognition,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 2, pp. 268-273, Feb. 2002.
[6] N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines and Other Kernel-Based Learning Method. Cambridge Univ. Press, 2000.
[7] J. Daugman, “Face and Gesture Recognition: Overview,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 675-676, July 1997.
[8] J.G. Daugman, “Two-Dimensional Spectral Analysis of Cortical Receptive Field Profiles,” Vision Research, vol. 20, pp. 847-856, 1980.
[9] J.G. Daugman, “Uncertainty Relation for Resolution in Space, Spatial Frequency, and Orientation Optimized by Two-Dimensional Cortical Filters,” J. Optical Soc. Am., vol. 2, no. 7, pp. 1160-1169, 1985.
[10] G. Donato, M.S. Bartlett, J.C. Hager, P. Ekman, and T.J. Sejnowski, “Classifying Facial Actions,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 10, pp. 974-989, Oct. 1999.
[11] K. Etemad and R. Chellappa, “Discriminant Analysis for Recognition of Human Face Images,” J. Optical Soc. Am. A, vol. 14, pp. 1724-1733, 1997.
[12] K. Fukunaga, Introduction to Statistical Pattern Recognition, second ed. Academic Press 1990.
[13] A.S. Georghiades, P.N. Belhumeur, and D.J. Kriegman, “From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 643-660, June 2001.
[14] R.C. Gonzalez and R.E. Woods, Digital Image Processing. Prentice Hall, 2001.
[15] S. Haykin, Neural Networks— A Comprehensive Foundation. Macmillan College Publishing Company, 1994.
[16] S. Haykin, Neural Networks— A Comprehensive Foundation, second ed. Prentice Hall, 1999.
[17] P. Howland and H. Park, “Generalizing Discriminant Analysis Using the Generalized Singular Value Decomposition,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 8, pp. 995-1006, Aug. 2004.
[18] A.K. Jain, S. Pankanti, S. Prabhakar, L. Hong, and A. Ross, “Biometrics: A Grand Challenge,” Proc. 17th Int'l Conf. Pattern Recognition, pp. 935-942, 2004.
[19] M. Kirby and L. Sirovich, “Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 1, pp. 103-108, Jan. 1990.
[20] M. Lades, J.C. Vorbruggen, J. Buhmann, J. Lange, C. von der Malsburg, R.P. Wurtz, and W. Konen, “Distortion Invariant Object Recognition in the Dynamic Link Architecture,” IEEE Trans. Computers, vol. 42, no. 3, pp. 300-311, Mar. 1993.
[21] Z. Liang and P. Shi, “Uncorrelated Discriminant Vectors Using a Kernel Method,” Pattern Recognition, vol. 38, no. 2, pp. 307-310, 2005.
[22] C. Liu, “A Bayesian Discriminating Features Method for Face Detection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 6, pp. 725-740, June 2003.
[23] C. Liu, “Enhanced Independent Component Analysis and Its Application to Content Based Face Image Retrieval,” IEEE Trans. Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 34, no. 2, pp. 1117-1127, 2004.
[24] C. Liu, “Gabor-Based Kernel PCA with Fractional Power Polynomial Models for Face Recognition,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 5, pp. 572-581, May 2004.
[25] C. Liu and H. Wechsler, “Evolutionary Pursuit and Its Application to Face Recognition,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 6, pp. 570-582, June 2000.
[26] C. Liu and H. Wechsler, “Robust Coding Schemes for Indexing and Retrieval from Large Face Databases,” IEEE Trans. Image Processing, vol. 9, no. 1, pp. 132-137, 2000.
[27] C. Liu and H. Wechsler, “Gabor Feature Based Classification Using the Enhanced Fisher Linear Discriminant Model for Face Recognition,” IEEE Trans. Image Processing, vol. 11, no. 4, pp. 467-476, 2002.
[28] M.J. Lyons, J. Budynek, A. Plante, and S. Akamatsu, “Classifying Facial Attributes Using a 2-D Gabor Wavelet Representation and Discriminant Analysis,” Proc. Fourth IEEE Int'l Conf. Automatic Face and Gesture Recognition, 2000.
[29] M.J. Lyons, J. Budynek, and S. Akamatsu, “Automatic Classification of Single Facial Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 12, pp. 1357-1362, Dec. 1999.
[30] S. Mika, G. Ratsch, J. Weston, B. Scholkopf, and K.R. Miller, “Fisher Discriminant Analysis with Kernels,” Neural Networks for Signal Processing IX, Y.H. Hu, J. Larsen, E. Wilson, and S. Douglas, eds., pp. 41-48, 1999.
[31] S. Pankanti, R.M. Bolle, and A. Jain, “Guest Editors' Introduction: Biometrics— The Future of Identification,” Computer, vol. 33, no. 2, pp. 46-49, Feb. 2000.
[32] C.H. Park and H. Park, “Nonlinear Discriminant Analysis Using Kernel Functions and the Generalized Singular Value Decomposition,” SIAM J. Matrix Analysis and Applications, vol. 27, no. 1, pp. 87-102, 2005.
[33] P.J. Phillips, P.J. Flynn, T. Scruggs, K.W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. Worek, “Overview of the Face Recognition Grand Challenge,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.
[34] P.J. Phillips, “Matching Pursuit Filters Applied to Face Identification,” IEEE Trans. Image Processing, vol. 7, no. 8, pp. 1150-1164, 1998.
[35] P.J. Phillips, P. Grother, R.J. Micheals, D.M. Blackburn, E. Tabassi, and J.M. Bone, “FRVT 2002: Evaluation Report,” technical report, http:/www.frvt.org/, Mar. 2003.
[36] P.J. Phillips and E.M. Newton, “Meta-Analysis of Face Recognition Algorithms,” Proc. Fifth Int'l Conf. Automatic Face and Gesture Recognition, pp. 224-230, Mar. 2002.
[37] P.J. Phillips, H. Wechsler, J. Huang, and P. Rauss, “The FERET Database and Evaluation Procedure for Face-Recognition Algorithms,” Image and Vision Computing, vol. 16, pp. 295-306, 1998.
[38] B. Scholkopf and A. Smola, Learning with Kernels: Support Vector Machines, Regularization, Optimization and Beyond. MIT Press, 2002.
[39] P. Shih and C. Liu, “Comparative Assessment of Content-Based Face Image Retrieval in Different Color Spaces,” Int'l J. Pattern Recognition and Artificial Intelligence, vol. 19, no. 7, pp. 873-893, 2005.
[40] D.L. Swets and J. Weng, “Using Discriminant Eigenfeatures for Image Retrieval,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 8, pp. 831-836, Aug. 1996.
[41] M. Turk and A. Pentland, “Eigenfaces for Recognition,” J. Cognitive Neuroscience, vol. 13, no. 1, pp. 71-86, 1991.
[42] Y.N. Vapnik, The Nature of Statistical Learning Theory, second ed. Springer-Verlag, 1999.
[43] M.A.O. Vasilescu and D. Terzopoulos, “Multilinear Analysis of Image Ensembles: Tensorfaces,” Proc. European Conf. Computer Vision, 2002.
[44] L. Wiskott, J.M. Fellous, N. Kruger, and C. von der Malsburg, “Face Recognition by Elastic Bunch Graph Matching,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 775-779, July 1997.
[45] J. Yang, F.F. Alejandro, J. Yang, D. Zhang, and Z. Jin, “KPCA Plus LDA: A Complete Kernel Fisher Discriminant Framework for Feature Extraction and Recognition,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 2, pp. 230-244, Feb. 2005.
[46] M.H. Yang, “Kernel eigenfaces vs. Kernel Fisherfaces: Face Recognition Using Kernel Methods,” Proc. Fifth Int'l Conf. Automatic Face and Gesture Recognition, May 2002.
[47] J. Ye, R. Janardan, C.H. Park, and H. Park, “An Optimization Criterion for Generalized Discriminant Analysis on Undersampled Problems,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 8, pp. 982-994, Aug. 2004.
[48] F. Zhang, Matrix Theory: Basic Results and Techniques. New York: Springer, 1999.
[49] W. Zhao, R. Chellappa, J. Phillips, and A. Rosenfeld, “Face Recognition: A Literature Survey,” ACM Computing Surveys, vol. 35, no. 4, pp. 399-458, 2003.
[50] W. Zheng, L. Zhao, and C. Zou, “A Modified Algorithm for Generalized Discriminant Analysis,” Neural Computation, vol. 16, no. 6, pp. 1283-1297, 2004.

Index Terms:
Dimensionality increasing techniques, face recognition, Face Recognition Grand Challenge (FRGC), fractional power polynomial models, Gabor image representation, Kernel Fisher Analysis (KFA) method.
Citation:
Chengjun Liu, "Capitalize on Dimensionality Increasing Techniques for Improving Face Recognition Grand Challenge Performance," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 5, pp. 725-737, May 2006, doi:10.1109/TPAMI.2006.90
Usage of this product signifies your acceptance of the Terms of Use.