CSDL Home IEEE Transactions on Pattern Analysis & Machine Intelligence 2010 vol.32 Issue No.05 - May

Subscribe

Issue No.05 - May (2010 vol.32)

pp: 847-860

Robert Jenssen , University of Tromsø, Tromsø

ABSTRACT

We introduce kernel entropy component analysis (kernel ECA) as a new method for data transformation and dimensionality reduction. Kernel ECA reveals structure relating to the Renyi entropy of the input space data set, estimated via a kernel matrix using Parzen windowing. This is achieved by projections onto a subset of entropy preserving kernel principal component analysis (kernel PCA) axes. This subset does not need, in general, to correspond to the top eigenvalues of the kernel matrix, in contrast to the dimensionality reduction using kernel PCA. We show that kernel ECA may produce strikingly different transformed data sets compared to kernel PCA, with a distinct angle-based structure. A new spectral clustering algorithm utilizing this structure is developed with positive results. Furthermore, kernel ECA is shown to be an useful alternative for pattern denoising.

INDEX TERMS

Spectral data transformation, Renyi entropy, Parzen windowing, kernel PCA, clustering, pattern denoising.

CITATION

Robert Jenssen, "Kernel Entropy Component Analysis",

*IEEE Transactions on Pattern Analysis & Machine Intelligence*, vol.32, no. 5, pp. 847-860, May 2010, doi:10.1109/TPAMI.2009.100REFERENCES