2007 Seventh IEEE International Conference on Data Mining
Spectral Regression: A Unified Approach for Sparse Subspace Learning
Omaha, Nebraska, USA
October 28-October 31
ISBN: 0-7695-3018-4
Recently the problem of dimensionality reduction (or, subspace learning) has received a lot of interests in many fields of information processing, including data mining, information retrieval, and pattern recognition. Some popular methods include Principal Component Analysis (PCA), Linear Discriminant Analysis (LDA) and Locality Preserving Projection (LPP). However, a disadvantage of all these approaches is that the learned projective functions are linear combinations of all the original features, thus it is often difficult to interpret the results. In this paper, we propose a novel dimensionality reduction framework, called Unified Sparse Subspace Learning (USSL), for learning sparse projections. USSL casts the problem of learning the projective functions into a regression framework, which facilitates the use of different kinds of regularizers. By using a L1-norm regularizer (lasso), the sparse projections can be efficiently computed. Experimental results on real world classification and clustering problems demonstrate the effectiveness of our method.
Citation:
Deng Cai, Xiaofei He, Jiawei Han, "Spectral Regression: A Unified Approach for Sparse Subspace Learning," icdm, pp.73-82, 2007 Seventh IEEE International Conference on Data Mining, 2007