Subscribe
Issue No.01 - Jan. (2013 vol.35)
pp: 39-51
Jiwen Lu , Adv. Digital Sci. Center, Singapore, Singapore
Yap-Peng Tan , Sch. of Electr. & Electron. Eng., Nanyang Technol. Univ., Singapore, Singapore
Gang Wang , Sch. of Electr. & Electron. Eng., Nanyang Technol. Univ., Singapore, Singapore
ABSTRACT
Conventional appearance-based face recognition methods usually assume that there are multiple samples per person (MSPP) available for discriminative feature extraction during the training phase. In many practical face recognition applications such as law enhancement, e-passport, and ID card identification, this assumption, however, may not hold as there is only a single sample per person (SSPP) enrolled or recorded in these systems. Many popular face recognition methods fail to work well in this scenario because there are not enough samples for discriminant learning. To address this problem, we propose in this paper a novel discriminative multimanifold analysis (DMMA) method by learning discriminative features from image patches. First, we partition each enrolled face image into several nonoverlapping patches to form an image set for each sample per person. Then, we formulate the SSPP face recognition as a manifold-manifold matching problem and learn multiple DMMA feature spaces to maximize the manifold margins of different persons. Finally, we present a reconstruction-based manifold-manifold distance to identify the unlabeled subjects. Experimental results on three widely used face databases are presented to demonstrate the efficacy of the proposed approach.
INDEX TERMS
Manifolds, Face recognition, Face, Training, Feature extraction, Semantics, Educational institutions,single training sample per person, Face recognition, manifold learning, subspace learning
CITATION
Jiwen Lu, Yap-Peng Tan, Gang Wang, "Discriminative Multimanifold Analysis for Face Recognition from a Single Training Sample per Person", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 1, pp. 39-51, Jan. 2013, doi:10.1109/TPAMI.2012.70
REFERENCES
 [1] T. Ahonen, A. Hadid, and M. Pietikäinen, "Face Recognition with Local Binary Patterns," Proc. European Conf. Computer Vision, pp. 469-481, 2004. [2] P.N. Belhumeur, J. Hespanha, and D.J. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 711-720, July 1997. [3] D. Cai, X. He, and J. Han, "Spectral Regression for Efficient Regularized Subspace Learning," Proc. IEEE 11th Int'l Conf. Computer Vision, pp. 1-8, 2007. [4] D. Cai, X. He, Y. Hu, J. Han, and T. Huang, "Learning a Spatially Smooth Subspace for Face Recognition," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. 1-7, 2007. [5] H. Chen, H. Chang, and T. Liu, "Local Discriminant Embedding and Its Variants," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. 846-853, 2005. [6] S. Chen, J. Liu, and Z. Zhou, "Making FLDA Applicable to Face Recognition with One Sample per Person," Pattern Recognition, vol. 37, no. 7, pp. 1553-1555, 2004. [7] S. Chen, D. Zhang, and Z. Zhou, "Enhanced ${\rm \; (PC)}^{2}{\rm \; A}$ for Face Recognition with One Training Image per Person," Pattern Recognition Letters, vol. 25, no. 10, pp. 1173-1181, 2004. [8] W. Deng, J. Hu, J. Guo, W. Cai, and D. Feng, "Robust, Accurate and Efficient Face Recognition from a Single Training Image: A Uniform Pursuit Approach," Pattern Recognition, vol. 43, no. 5, pp. 1748-1762, 2010. [9] Y. Fu, S. Yan, and T.S. Huang, "Classification and Feature Extraction by Simplexization," IEEE Trans. Information Forensics and Security, vol. 3, no. 1, pp. 91-100, Mar. 2008. [10] Q. Gao, L. Zhang, and D. Zhang, "Face Recognition Using FLDA with Single Training Image per Person," Applied Math. and Computation, vol. 205, no. 2, pp. 726-734, 2008. [11] X. Geng, D. Zhan, and Z. Zhou, "Supervised Nonlinear Dimensionality Reduction for Visualization and Classification," IEEE Trans. Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 35, no. 6, pp. 1098-1107, Dec. 2005. [12] R. Gottumukkal and V. Asari, "An Improved Face Recognition Technique Based on Modular PCA Approach," Pattern Recognition Letters, vol. 25, no. 4, pp. 429-436, 2004. [13] R. Gross, I. Matthews, and S. Baker, "Generic vs. Person Specific Active Appearance Models," Image and Vision Computing, vol. 23, no. 12, pp. 1080-1093, 2005. [14] X. He, D. Cai, S. Yan, and H. Zhang, "Neighborhood Preserving Embedding," Proc. IEEE Int'l Conf. Computer Vision, pp. 1208-1213, 2005. [15] X. He, S. Yan, Y. Hu, P. Niyogi, and H.J. Zhang, "Face Recognition Using Laplacianfaces," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 3, pp. 328-340, Mar. 2005. [16] H. Hu, "Orthogonal Neighborhood Preserving Discriminant Analysis for Face Recognition," Pattern Recognition, vol. 41, no. 6, pp. 2045-2054, 2008. [17] A. Jain and B. Chandrasekaran, "Dimensionality and Sample Size Considerations in Pattern Recognition Practice," Handbook of Statistics, vol. 2, pp. 835-855, 1982. [18] T. Jebara, J. Wang, and S. Chang, "Graph Construction and B-Matching for Semi-Supervised Learning," Proc. Int'l Conf. Machine Learning, pp. 441-448, 2009. [19] H. Kanan, K. Faez, and Y. Gao, "Face Recognition Using Adaptively Weighted Patch PZM Array from a Single Exemplar Image per Person," Pattern Recognition, vol. 41, no. 12, pp. 3799-3812, 2008. [20] T. Kim and J. Kittler, "Locally Linear Discriminant Analysis for Multimodally Distributed Classes for Face Recognition with a Single Model Image," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 3, pp. 318-327, Mar. 2005. [21] A. Lanitis, "Evaluating the Performance of Face-Aging Algorithms," Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition, pp. 1-6, 2008. [22] Z. Lei, S. Liao, M. Pietikainen, and S. Li, "Face Recognition by Exploring Information Jointly in Space, Scale and Orientation," IEEE Trans. Image Processing, vol. 20, no. 1, pp. 247-256, Jan. 2011. [23] H. Lu, K. Plataniotis, and A. Venetsanopoulos, "MPCA: Multilinear Principal Component Analysis of Tensor Objects," IEEE Trans. Neural Networks, vol. 19, no. 1, pp. 18-39, Jan. 2008. [24] J. Lu and Y. Tan, "A Doubly Weighted Approach for Appearance-Based Subspace Learning Methods," IEEE Trans. Information Forensics and Security, vol. 5, no. 1, pp. 71-81, Mar. 2010. [25] J. Lu and Y.-P. Tan, "Regularized Locality Preserving Projections and Its Extensions for Face Recognition," IEEE Trans. Systems, Man, and Cybernetics: Part B, Cybernetics, vol. 40, no. 2, pp. 958-963, June 2010. [26] J. Lu, Y.-P. Tan, G. Wang, and X. Zhou, "Discriminative Multi-Manifold Analysis for Face Recognition from a Single Training Sample per Person," Proc. IEEE Int'l Conf. Computer Vision, pp. 1943-1950, 2011. [27] J. Luo, Y. Ma, E. Takikawa, S. Lao, M. Kawade, and B. Lu, "Person-Specific Sift Features for Face Recognition," Proc. IEEE Int'l Conf. Acoustics, Speech, and Signal Processing, pp. 593-596, 2007. [28] A. Martínez, "Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample per Class," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 6, pp. 748-763, June 2002. [29] A. Martínez and A. Kak, "PCA versus LDA," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 2, pp. 228-233, Feb. 2002. [30] A.M. Martinez and R. Benavente, "The AR Face Database," technical report, CVC, 1998. [31] P. Phillips, H. Moon, S. Rizvi, and P. Rauss, "The FERET Evaluation Methodology for Face-Recognition Algorithms," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 10, pp. 1090-1104, Oct. 2000. [32] P. Phillips, H. Wechsler, J. Huang, and P. Rauss, "The FERET Database and Evaluation Procedure for Face-Recognition Algorithms," Image and Vision Computing, vol. 16, no. 5, pp. 295-306, 1998. [33] D. Ridder, O. Kouropteva, O. Okun, M. Pietikäinen, and R. Duin, "Supervised Locally Linear Embedding," Proc. Int'l Conf. Artificial Neural Networks and Neural Information Processing, pp. 175-175, 2003. [34] S. Roweis and L. Saul, "Nonlinear Dimensionality Reduction by Locally Linear Embedding," Science, vol. 290, no. 5500, pp. 2323-2326, 2000. [35] W. Schwartz, H. Guo, and L. Davis, "A Robust and Scalable Approach to Face Identification," Proc. European Conf. Computer Vision, pp. 476-489, 2010. [36] S. Si, D. Tao, and B. Geng, "Bregman Divergence Based Regularization for Transfer Subspace Learning," IEEE Trans. Knowledge and Data Eng., vol. 22, no. 7, pp. 929-942, July 2010. [37] Y. Su, S. Shan, X. Chen, and W. Gao, "Adaptive Generic Learning for Face Recognition from a Single Sample per Person," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 2699-2706, 2010. [38] X. Tan, S. Chen, Z. Zhou, and F. Zhang, "Recognizing Partially Occluded, Expression Variant Faces from Single Training Image per Person with SOM and Soft K-NN Ensemble," IEEE Trans. Neural Networks, vol. 16, no. 4, pp. 875-886, July 2005. [39] X. Tan, S. Chen, Z. Zhou, and F. Zhang, "Face Recognition from a Single Image per Person: A Survey," Pattern Recognition, vol. 39, no. 9, pp. 1725-1745, 2006. [40] J.B. Tenenbaum, V. Silva, and J. Langford, "A Global Geometric Framework for Nonlinear Dimensionality Reduction," Science, vol. 290, no. 5500, pp. 2319-2323, 2000. [41] M. Turk and A. Pentland, "Eigenfaces for Recognition," J. Cognitive Neuroscience, vol. 3, no. 1, pp. 71-86, 1991. [42] N. Vu and A. Caplier, "Face Recognition with Patterns of Oriented Edge Magnitudes," Proc. European Conf. Computer Vision, pp. 313-326, 2010. [43] S. Vu et al., "Mining Patterns of Orientations and Magnitudes for Face Recognition," Proc. Int'l Joint Conf. Biometrics, pp. 1-8, 2011. [44] R. Wang and X. Chen, "Manifold Discriminant Analysis," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2009. [45] R. Wang, S. Shan, X. Chen, and W. Gao, "Manifold-Manifold Distance with Application to Face Recognition Based on Image Set," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2008. [46] X. Wang and X. Tang, "A Unified Framework for Subspace Face Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 9, pp. 1222-1228, Sept. 2004. [47] X. Wang and X. Tang, "Random Sampling for Subspace Face Recognition," Int'l J. Computer Vision, vol. 70, no. 1, pp. 91-104, 2006. [48] J. Wu and Z. Zhou, "Face Recognition with One Training Image per Person," Pattern Recognition Letters, vol. 23, no. 14, pp. 1711-1719, 2002. [49] S. Yan, J. Liu, X. Tang, and T. Huang, "A Parameter-Free Framework for General Supervised Subspace Learning," IEEE Trans. Information Forensics and Security, vol. 2, no. 1, pp. 69-76, Mar. 2007. [50] S. Yan, D. Xu, Q. Yang, L. Zhang, X. Tang, and H. Zhang, "Multilinear Discriminant Analysis for Face Recognition," IEEE Trans. Image Processing, vol. 16, no. 1, pp. 212-220, Jan. 2007. [51] S. Yan, D. Xu, B. Zhang, H. Zhang, Q. Yang, and S. Lin, "Graph Embedding and Extensions: A General Framework for Dimensionality Reduction," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 1, pp. 40-51, Jan. 2007. [52] J. Yang, D. Zhang, A. Frangi, and J. Yang, "Two-Dimensional PCA: A New Approach to Appearance-Based Face Representation and Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 1, pp. 131-137, Jan. 2004. [53] M.H. Yang, "Kernel Eigenfaces vs. Kernel Fisherfaces: Face Recognition Using Kernel Methods," Proc. IEEE Int'l Conf. Face and Gesture Recognition, pp. 215-220, 2002. [54] B. Yao, H. Ai, and S. Lao, "Person-Specific Face Recognition in Unconstrained Environments: A Combination of Offline and Online Learning," Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition, pp. 1-8, 2009. [55] W. Yu, X. Teng, and C. Liu, "Face Recognition Using Discriminant Locality Preserving Projections," Image and Vision Computing, vol. 24, no. 3, pp. 239-248, 2006. [56] B. Zhang, Y. Gao, S. Zhao, and J. Liu, "Local Derivative Pattern versus Local Binary Pattern: Face Recognition with High-Order Local Pattern Descriptor," IEEE Trans. Image Processing, vol. 19, no. 2, pp. 533-544, Feb. 2010. [57] B. Zhang, S. Shan, X. Chen, and W. Gao, "Histogram of Gabor Phase Patterns (HGPP): A Novel Object Representation Approach for Face Recognition," IEEE Trans. Image Processing, vol. 16, no. 1, pp. 57-68, Jan. 2007. [58] D. Zhang, S. Chen, and Z. Zhou, "A New Face Recognition Method Based on SVD Perturbation for Single Example Image per Person," Applied Math. and Computation, vol. 163, no. 2, pp. 895-907, 2005. [59] D. Zhang and Z. Zhou, "${\rm \; (2D)}^{2}{\rm \; PCA}$ : Two-Directional Two-Dimensional PCA for Efficient Face Representation and Recognition," Neurocomputing, vol. 69, nos. 1-3, pp. 224-231, 2005. [60] W. Zhang, S. Shan, W. Gao, X. Chen, and H. Zhang, "Local Gabor Binary Pattern Histogram Sequence (LGBPHS): A Novel Non-Statistical Model for Face Representation and Recognition," Proc. IEEE Int'l Conf. Computer Vision, pp. 786-791, 2005. [61] J. Zou, Q. Ji, and G. Nagy, "A Comparative Study of Local Matching Approach for Face Recognition," IEEE Trans. Image Processing, vol. 16, no. 10, pp. 2617-2628, Oct. 2007.