This Article 
 Bibliographic References 
 Add to: 
Two-Dimensional PCA: A New Approach to Appearance-Based Face Representation and Recognition
January 2004 (vol. 26 no. 1)
pp. 131-137

Abstract—In this paper, a new technique coined two-dimensional principal component analysis (2DPCA) is developed for image representation. As opposed to PCA, 2DPCA is based on 2D image matrices rather than 1D vectors so the image matrix does not need to be transformed into a vector prior to feature extraction. Instead, an image covariance matrix is constructed directly using the original image matrices, and its eigenvectors are derived for image feature extraction. To test 2DPCA and evaluate its performance, a series of experiments were performed on three face image databases: ORL, AR, and Yale face databases. The recognition rate across all trials was higher using 2DPCA than PCA. The experimental results also indicated that the extraction of image features is computationally more efficient using 2DPCA than PCA.

[1] L. Sirovich and M. Kirby, “Low-Dimensional Procedure for Characterization of Human Faces,” J. Optical Soc. Am., vol. 4, pp. 519-524, 1987.
[2] M. Kirby and L. Sirovich, “Application of the KL Procedure for the Characterization of Human Faces,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 1, pp. 103-108, Jan. 1990.
[3] M. Turk and A. Pentland, “Eigenfaces for Recognition,” J. Cognitive Neuroscience, vol. 3, no. 1, pp. 71-86, 1991.
[4] A. Pentland, “Looking at People: Sensing for Ubiquitous and Wearable Computing,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 1, pp. 107-119, Jan. 2000.
[5] M.A. Grudin, “On Internal Representations in Face Recognition Systems,” Pattern Recognition, vol. 33, no. 7, pp. 1161-1177, 2000.
[6] G.W. Cottrell and M.K. Fleming, “Face Recognition Using Unsupervised Feature Extraction,” Proc. Int'l Neural Network Conf., pp. 322-325, 1990.
[7] D. Valentin, H. Abdi, A.J. O'Toole, and G.W. Cottrell, “Connectionist Models of Face Processing: a Survey,” Pattern Recognition, vol. 27, no. 9, pp. 1209-1230, 1994.
[8] P.S. Penev and L. Sirovich, “The Global Dimensionality of Face Space,” Proc. Fourth IEEE Int'l Conf. Automatic Face and Gesture Recognition, pp. 264-270, 2000.
[9] L. Zhao and Y. Yang, “Theoretical Analysis of Illumination in PCA-Based Vision Systems,” Pattern Recognition, vol. 32, no. 4, pp. 547-564, 1999.
[10] L. Wiskott, J.M. Fellous, N. Krüger, and C. von der Malsburg, “Face Recognition by Elastic Bunch Graph Matching,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 775-779, July 1997.
[11] M.S. Bartlett, J.R. Movellan, and T.J. Sejnowski, “Face Recognition by Independent Component Analysis,” IEEE Trans. Neural Networks, vol. 13, no. 6, pp. 1450-1464, 2002.
[12] B.A. Draper, K. Baek, M.S. Bartlett, J.R. Beveridge, “Recognizing Faces with PCA and ICA,” Computer Vision and Image Understanding: special issue on face recognition, in press.
[13] P.C. Yuen and J.H. Lai, “Face Representation Using Independent Component Analysis,” Pattern Recognition, vol. 35, no. 6, pp. 1247-1257, 2002.
[14] M.H. Yang, “Kernel Eigenfaces vs. Kernel Fisherfaces: Face Recognition Using Kernel Methods,” Proc. Fifth IEEE Int'l Conf. Automatic Face and Gesture Recognition (RGR'02), pp. 215-220, May 2002.
[15] K. Liu et al., “Algebraic Feature Extraction for Image Recognition Based on an Optimal Discriminant Criterion,” Pattern Recognition, vol. 26, no. 6, pp. 903-911, 1993.
[16] P.N. Belhumeur, J.P. Hespanha, and D.J. Kriengman, “Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 711-720, July 1997.
[17] A.M. Martinez and R. Benavente, “The AR Face Database,” CVC Technical Report, no. 24, June 1998.
[18] A.M. Martinez and R. Benavente, “The AR Face Database,” , 2003.
[19] J. Yang, J.Y. Yang, “From Image Vector to Matrix: A Straightforward Image Projection Technique— IMPCA vs. PCA,” Pattern Recognition, vol. 35, no. 9, pp. 1997-1999, 2002.
[20] W. Yambor, B. Draper, and R. Beveridge, “Analyzing PCA-Based Face Recognition Algorithms: Ei-Genvector Selection and Distance Measures,” Empirical Evaluation Methods in Computer Vision, H. Christensen and J. Phillips, eds., Singapore: World Scientific Press, 2002.
[21] J.R. Beveridge, K. She, B. Draper, and G.H. Givens, “Parametric and Nonparametric Methods for the Statistical Evaluation of Human ID Algorithms,” Proc. Third Workshop Empirical Evaluation of Computer Vision Systems, Dec. 2001.

Index Terms:
Principal Component Analysis (PCA), Eigenfaces, feature extraction, image representation, face recognition.
Jian Yang, David Zhang, Alejandro F. Frangi, Jing-yu Yang, "Two-Dimensional PCA: A New Approach to Appearance-Based Face Representation and Recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 1, pp. 131-137, Jan. 2004, doi:10.1109/TPAMI.2004.10004
Usage of this product signifies your acceptance of the Terms of Use.