CSDL Home IEEE Transactions on Pattern Analysis & Machine Intelligence 2005 vol.27 Issue No.09 - September
Issue No.09 - September (2005 vol.27)
We propose a nonparametric approach to learning of principal surfaces based on an unsupervised formulation of the Nadaraya-Watson kernel regression estimator. As compared with previous approaches to principal curves and surfaces, the new method offers several advantages: First, it provides a practical solution to the model selection problem because all parameters can be estimated by leave-one-out cross-validation without additional computational cost. In addition, our approach allows for a convenient incorporation of nonlinear spectral methods for parameter initialization, beyond classical initializations based on linear PCA. Furthermore, it shows a simple way to fit principal surfaces in general feature spaces, beyond the usual data space setup. The experimental results illustrate these convenient features on simulated and real data.
Index Terms- Dimensionality reduction, principal curves, principal surfaces, density estimation, model selection, kernel methods.
Stefan Klanke, Roland Memisevic, Helge Ritter, "Principal Surfaces from Unsupervised Kernel Regression", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.27, no. 9, pp. 1379-1391, September 2005, doi:10.1109/TPAMI.2005.183