| | This Article | |
| |
| |
| | Share | |
| |
| |
| | Bibliographic References | |
| |
| |
| | Add to: | |
| |
 Digg
 Furl
 Spurl
 Blink
 Simpy
 Google
 Del.icio.us
 Y!MyWeb
| |
| | Search | |
| |
| |
| | |
Orthogonal Neighborhood Preserving Projections: A Projection-Based Dimensionality Reduction Technique
December 2007 (vol. 29 no. 12)
pp. 2143-2156
This paper considers the problem of dimensionality reduction by orthogonal projection techniques. The main feature of the proposed techniques is that they attempt to preserve both the intrinsic neighborhood geometry of the data samples and the global geometry. In particular we propose a method, named Orthogonal Neighborhood Preserving Projections, which works by first building an “affinity” graph for the data, in a way that is similar to the method of Locally Linear Embedding (LLE). However, in contrast with the standard LLE where the mapping between the input and the reduced spaces is implicit, ONPP employs an explicit linear mapping between the two. As a result, handling new data samples becomes straightforward, as this amounts to a simple linear transformation.We show how to define kernel variants of ONPP, as well as how to apply the method in a supervised setting. Numerical experiments are reported to illustrate the performance of ONPP and to compare it with a few competing methods.
[1] 2143 S. Roweis and L. Saul, “Nonlinear Dimensionality Reduction by Locally Linear Embedding,” Science, vol. 290, pp. 2323-2326, 2000.[2] L. Saul and S. Roweis, “Think Globally, Fit Locally: Unsupervised Learning of Nonlinear Manifolds,” J. Machine Learning Research, vol. 4, pp. 119-155, 2003.[3] E. Kokiopoulou and Y. Saad, “Orthogonal Neighborhood Preserving Projections,” Proc. Fifth IEEE Int'l Conf. Data Mining, Nov. 2005.[4] K.R. Müller, S. Mika, G. Ratsch, K. Tsuda, and B. Schölkopf, “An Introduction to Kernel-Based Learning Algorithms,” IEEE Trans. Neural Networks, vol. 12, pp. 181-201, 2001.[5] V. Vapnik, Statistical Learning Theory. John Wiley & Sons, 1998.[6] V. de Silva, J.B. Tenenbaum, and J.C. Langford, “A Global Geometric Framework for Nonlinear Dimensionality Reduction,” Science, vol. 290, no. 5500, pp. 2319-2323, 2000.[7] Y. Bengio, J.-.F. Paiement, P. Vincent, O. Delalleau, N. Le Roux, and M. Ouimet, “Out-of-Sample Extensions for LLE, Isomap, MDS, Eigenmaps and Spectral Clustering,” Advances in Neural Information Processing Systems 16, S. Thrun, L. Saul, and B.Schölkopf, eds., MIT Press, 2004.[8] X. He and P. Niyogi, “Locality Preserving Projections,” Proc. Advances in Neural Information Processing Systems Conf., 2003.[9] M. Belkin and P. Niyogi, “Laplacian Eigenmaps for Dimensionality Reduction and Data Representation,” Neural Computation, vol. 15, no. 6, pp. 1373-1396, 2003.[10] D. Cai and X. He, “Orthogonal Locality Preserving Indexing,” Proc. 28th Ann. Int'l ACM Conf. Research and Development in Information Retrieval, Aug. 2005.[11] X. He, S. Yan, Y. Hu, P. Niyogi, and H.-J. Zhang, “Face Recognition Using Laplacian Faces,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 3, pp. 328-340, Mar. 2005.[12] Y. Saad, Numerical Methods for Large Eigenvalue Problems. Halstead Press, 1992.[13] D.B Graham and N.M Allinson, “Characterizing Virtual Eigensignatures for General Purpose Face Recognition,” Face Recognition: From Theory to Applications, vol. 163, pp. 446-456, 1998.[14] F. Samaria and A. Harter, “Parameterisation of a Stochastic Model for Human Face Identification,” Proc. Second IEEE Workshop Applications of Computer Vision, Dec. 1994.[15] A.M. Martinez and R. Benavente, “The AR Face Database,” Technical Report CVC 24, 1998.[16] P. Belhumeur, J. Hespanha, and D. Kriegman, “Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection,” IEEE Trans. Pattern Analysis and Machine Intelligence, special issue on face recognition, vol. 19, no. 7, pp. 711-720, July 1997.
Index Terms:
Linear Dimensionality Reduction, Face Recognition, Data Visualization
Citation:
Effrosyni Kokiopoulou, Yousef Saad, "Orthogonal Neighborhood Preserving Projections: A Projection-Based Dimensionality Reduction Technique," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 29, no. 12, pp. 2143-2156, June 2007, doi:10.1109/TPAMI.2007.1131
