This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Gabor-Based Kernel PCA with Fractional Power Polynomial Models for Face Recognition
May 2004 (vol. 26 no. 5)
pp. 572-581

Abstract—This paper presents a novel Gabor-based kernel Principal Component Analysis (PCA) method by integrating the Gabor wavelet representation of face images and the kernel PCA method for face recognition. Gabor wavelets first derive desirable facial features characterized by spatial frequency, spatial locality, and orientation selectivity to cope with the variations due to illumination and facial expression changes. The kernel PCA method is then extended to include fractional power polynomial models for enhanced face recognition performance. A fractional power polynomial, however, does not necessarily define a kernel function, as it might not define a positive semidefinite Gram matrix. Note that the sigmoid kernels, one of the three classes of widely used kernel functions (polynomial kernels, Gaussian kernels, and sigmoid kernels), do not actually define a positive semidefinite Gram matrix either. Nevertheless, the sigmoid kernels have been successfully used in practice, such as in building support vector machines. In order to derive real kernel PCA features, we apply only those kernel PCA eigenvectors that are associated with positive eigenvalues. The feasibility of the Gabor-based kernel PCA method with fractional power polynomial models has been successfully tested on both frontal and pose-angled face recognition, using two data sets from the FERET database and the CMU PIE database, respectively. The FERET data set contains 600 frontal face images of 200 subjects, while the PIE data set consists of 680 images across five poses (left and right profiles, left and right half profiles, and frontal view) with two different facial expressions (neutral and smiling) of 68 subjects. The effectiveness of the Gabor-based kernel PCA method with fractional power polynomial models is shown in terms of both absolute performance indices and comparative performance against the PCA method, the kernel PCA method with polynomial kernels, the kernel PCA method with fractional power polynomial models, the Gabor wavelet-based PCA method, and the Gabor wavelet-based kernel PCA method with polynomial kernels.

[1] J.J. Atick, P.A. Griffin, and A.N. Redlich, Statistical Approach to Shape from Shading: Reconstruction of Three-Dimensional Face Surfaces from Single Two-Dimensional Images Neural Computation, vol. 8, no. 6, pp. 1321-1340, 1996.
[2] S. Baker, S.K. Nayar, and H. Murase, Parametric Feature Detection Int'l J. Computer Vision, vol. 27, no. 1, pp. 27-50, 1998.
[3] P.N. Belhumeur, J. Hespanda, and D. Kriegeman, Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 711-720, July 1997.
[4] D. Beymer, Vectorizing Face Images by Interleaving Shape and Texture Computations A.I. memo no. 1537, Artificial Intelligence Laboratory, MIT, 1995.
[5] V. Blanz and T. Vetter, Face Recognition Based on Fitting a 3D Morphable Model IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 9, pp. 1063-1074, Sept. 2003.
[6] R. Brunelli and T. Poggio, "Face Recognition: Features vs. Templates," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 10, pp. 1,042-1,053, Oct. 1993.
[7] D. Burr, M. Morrone, and D. Spinelli, Evidence for Edge and Bar Detectors in Human Vision Vision Research, vol. 29, no. 4, pp. 419-431, 1989.
[8] R. Chellappa, C. Wilson, and S. Sirohey, "Human and Machine Recognition of Faces: A Survey," Proc. IEEE, vol. 83, no. 5, pp. 705-740, 1995.
[9] I. Craw and D. Tock, The Computer Understanding of Faces Processing Images of Faces, V. Bruce and M. Burton, eds., Ablex Publishing Corp., 1992.
[10] N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods, Cambridge Univ. Press, 2000.
[11] J. Daugman, “Face and Gesture Recognition: An Overview,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 675-676, July 1997
[12] J.G. Daugman, Two-Dimensional Spectral Analysis of Cortical Receptive Field Profiles Vision Research, vol. 20, pp. 847-856, 1980.
[13] J.G. Daugman, Uncertainty Relation for Resolution in Space, Spatial Frequency, and Orientation Optimized by Two-Dimensional Cortical Filters J. Optical Soc. Am., vol. 2, no. 7, pp. 1160-1169, 1985.
[14] J.G. Daugman, “Complete Discrete 2D Gabor Transforms by Neural Networks for Image Analysis and Compression,” IEEE Trans. Acoustics, Speech, and Signal Processing, vol. 36, no. 7, 1988.
[15] K.I. Diamantaras and S.Y. Kung, Principal Component Neural Networks: Theory and Applications. New York: John Wiley, 1996.
[16] G. Donato, M.S. Bartlett, J.C. Hager, P. Ekman, and T.J. Sejnowski, “Classifying Facial Actions,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 10, pp. 974-989, Oct. 1999.
[17] K. Etemad and R. Chellappa, Discriminant Analysis for Recognition of Human Face Images J. Optical Soc. Am. A, vol. 14, pp. 1724-1733, 1997.
[18] D. Field, Relations between the Statistics of Natural Images and the Response Properties of Cortical Cells J. Optical Soc. Amer. A, vol. 4, no. 12, pp. 2379-2394, 1987.
[19] A.S. Georghiades, P.N. Belhumeur, and D.J. Kriegman, From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 643-660, June 2001.
[20] S. Haykin, Neural Networks A Comprehensive Foundation, second ed. Prentice Hall, 1999.
[21] J. Jones and L. Palmer, An Evaluation of the Two-Dimensional Gabor Filter Model of Simple Receptive Fields in Cat Striate Cortex J. Neurophysiology, pp. 1233-1258, 1987.
[22] M. Kirby and L. Sirovich,“Application of Karhunen-Loève procedure for the characterization of human faces,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 1, pp. 103-108, Jan. 1990.
[23] M. Lades, J.C. Vorbruggen, J. Buhmann, J. Lange, C. von der Malsburg, R.P. Wurtz, and W. Konen, “Distortion Invariant Object Recognition in the Dynamic Link Architecture,” IEEE Trans. Computers, vol. 42, no. 3, pp. 300-311, Mar. 1993.
[24] A. Lanitis, C.J. Taylor, and T.F. Cootes, “Automatic Interpretation and Coding of Face Images using Flexible Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 743-756, July 1997.
[25] C. Liu, A Bayesian Discriminating Features Method for Face Detection IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 6, pp. 725-740, June 2003.
[26] C. Liu and H. Wechsler, Evolutionary Pursuit and Its Application to Face Recognition IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 6, pp. 570-582, June 2000.
[27] C.J. Liu and H. Wechsler, A Shape- and Texture-Based Enhanced Fisher Classifier for Face Recognition IEEE Trans. Image Processing, vol. 10, no. 4, pp. 598-608, 2001.
[28] C. Liu and H. Wechsler, Independent Component Analysis of Gabor Features for Face Recognition IEEE Trans. Neural Networks, vol. 14, no. 4, pp. 919-928, 2003.
[29] M.J. Lyons, J. Budynek, A. Plante, and S. Akamatsu, Classifying Facial Attributes Using a 2-D Gabor Wavelet Representation and Discriminant Analysis Proc. Fourth IEEE Int'l Conf. Automatic Face and Gesture Recognition, 2000.
[30] M.J. Lyons, J. Budynek, and S. Akamatsu, “Automatic Classification of Single Facial Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 12, pp. 1357-1362, 1999.
[31] S. Marcelja, Mathematical Description of the Responses of Simple Cortical Cells J. Optical Soc. Am., vol. 70, pp. 1297-1300, 1980.
[32] B. Moghaddam, Principle Manifolds and Probabilistic Subspace for Visual Recognition IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 6, pp. 780-788, June 2002.
[33] B. Moghaddam and A. Pentland, “Probabilistic Visual Learning for Object Representation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 696-710, July 1997.
[34] B.A. Olshausen and D.J. Field, Emergence of Simple-Cell Receptive Field Properties by Learning a Sparse Code for Natural Images Nature, vol. 381, no. 13, pp. 607-609, 1996.
[35] S. Pankanti, R. M. Bolle, and A. Jain, "Biometrics: The Future of Identification," Computer, vol. 33, no. 2, Feb. 2000, pp. 46-49.
[36] A. Pentland and T. Choudhury, “Face Recognition for Smart Environments,” Computer, vol. 33, no. 2, pp. 50-, Feb. 2000.
[37] A. Pentland, B. Moghaddam, and Starner, "View-Based and Modular Eigenspaces for Face Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1994, pp. 84-91.
[38] P.J. Phillips, H. Wechsler, J. Huang, and P. Rauss, The FERET Database and Evaluation Procedure for Face-Recognition Algorithms Image and Vision Computing, vol. 16, pp. 295-306, 1998.
[39] R. Rao and D. Ballard, An Active Vision Architecture Based on Iconic Representations Artificial Intelligence, vol. 78, pp. 461-505, 1995.
[40] A. Samal and P.A. Iyengar, Automatic Recognition and Analysis of Human Faces and Facial Expression: A Survey Pattern Recognition, vol. 25, no. 1, pp. 65-77, 1992.
[41] B. Schiele and J.L. Crowley, Recognition without Correspondence Using Multidimensional Receptive Field Histograms Int'l J. Computer Vision, vol. 36, no. 1, pp. 31-52, 2000.
[42] B. Scholkopf and A. Smola, Learning with Kernels: Support Vector Machines, Regularization, Optimization and Beyond. MIT Press, 2002.
[43] B. Scholkopf, A. Smola, and K. Muller, Nonlinear Component Analysis as a Kernel Eigenvalue Problem Neural Computation, vol. 10, pp. 1299-1319, 1998.
[44] T. Sim, S. Baker, and M. Bsat, The CMU Pose, Illumination, and Expression (PIE) Database Proc. Fifth IEEE Int'l Conf. Face and Gesture Recognition, 2002.
[45] K.K. Sung and T. Poggio, "Example-Based Learning for View-Based Human Face Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 1, pp. 39-50, Jan. 1998.
[46] D.L. Swets and J. Weng, Using Discriminant Eigenfeatures for Image Retrieval IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 8, pp. 831-836, Aug. 1996.
[47] M. Turk and A. Pentland, Eigenfaces for Recognition J. Cognitive Neuroscience, vol. 13, no. 1, pp. 71-86, 1991.
[48] D. Valentin, H. Abdi, A.J. O'Toole, and G.W. Cottrell, Connectionist Models of Face Processing: A Survey Pattern Recognition, vol. 27, no. 9, pp. 1209-1230, 1994.
[49] T. Vetter and T. Poggio, "Linear Object Classes and Image Synthesis from Single Example Image," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 733-741, July 1997.
[50] L. Wiskott, J.M. Fellous, N. Kruger, and C. von der Malsburg, Face Recognition by Elastic Bunch Graph Matching IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 775-779, July 1997.
[51] M. Yang, N. Ahuja, and D. Kriegman, Face Recognition Using Kernel Eigenfaces Proc. Int'l Conf. Image Processing, vol. 1, pp. 37-40, 2000.

Index Terms:
Face recognition, fractional power polynomial models, Gabor wavelet representation, Gabor-based kernel PCA method, kernel Principal Component Analysis (PCA).
Citation:
Chengjun Liu, "Gabor-Based Kernel PCA with Fractional Power Polynomial Models for Face Recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 5, pp. 572-581, May 2004, doi:10.1109/TPAMI.2004.1273927
Usage of this product signifies your acceptance of the Terms of Use.