Subscribe

Issue No.02 - Feb. (2013 vol.25)

pp: 387-401

Robson L.F. Cordeiro , University of São Paulo, São Carlos

Agma J.M. Traina , Universidade de São Paulo, São Carlos

Christos Faloutsos , Carnegie Mellon University, Pittsburgh

Caetano Traina Jr. , University of São Paulo, São Carlos

DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TKDE.2011.176

ABSTRACT

This paper proposes Halite, a novel, fast, and scalable clustering method that looks for clusters in subspaces of multidimensional data. Existing methods are typically superlinear in space or execution time. Halite's strengths are that it is fast and scalable, while still giving highly accurate results. Specifically the main contributions of Halite are: 1) Scalability: it is linear or quasi linear in time and space regarding the data size and dimensionality, and the dimensionality of the clusters' subspaces; 2) Usability: it is deterministic, robust to noise, doesn't take the number of clusters as an input parameter, and detects clusters in subspaces generated by original axes or by their linear combinations, including space rotation; 3) Effectiveness: it is accurate, providing results with equal or better quality compared to top related works; and 4) Generality: it includes a soft clustering approach. Experiments on synthetic data ranging from five to 30 axes and up to 1 \rm million points were performed. Halite was in average at least 12 times faster than seven representative works, and always presented highly accurate results. On real data, Halite was at least 11 times faster than others, increasing their accuracy in up to 35 percent. Finally, we report experiments in a real scenario where soft clustering is desirable.

INDEX TERMS

Shape, Correlation, Laplace equations, Convolution, Proposals, Accuracy, Complexity theory, data mining, Local-correlation clustering, moderate-to-high dimensional data

CITATION

Robson L.F. Cordeiro, Agma J.M. Traina, Christos Faloutsos, Caetano Traina Jr., "Halite: Fast and Scalable Multiresolution Local-Correlation Clustering",

*IEEE Transactions on Knowledge & Data Engineering*, vol.25, no. 2, pp. 387-401, Feb. 2013, doi:10.1109/TKDE.2011.176REFERENCES