The Community for Technology Leaders
Green Image
Issue No. 02 - Feb. (2013 vol. 25)
ISSN: 1041-4347
pp: 387-401
Caetano Traina Jr. , University of São Paulo, São Carlos
Christos Faloutsos , Carnegie Mellon University, Pittsburgh
Agma J.M. Traina , Universidade de São Paulo, São Carlos
Robson L.F. Cordeiro , University of São Paulo, São Carlos
This paper proposes Halite, a novel, fast, and scalable clustering method that looks for clusters in subspaces of multidimensional data. Existing methods are typically superlinear in space or execution time. Halite's strengths are that it is fast and scalable, while still giving highly accurate results. Specifically the main contributions of Halite are: 1) Scalability: it is linear or quasi linear in time and space regarding the data size and dimensionality, and the dimensionality of the clusters' subspaces; 2) Usability: it is deterministic, robust to noise, doesn't take the number of clusters as an input parameter, and detects clusters in subspaces generated by original axes or by their linear combinations, including space rotation; 3) Effectiveness: it is accurate, providing results with equal or better quality compared to top related works; and 4) Generality: it includes a soft clustering approach. Experiments on synthetic data ranging from five to 30 axes and up to 1 \rm million points were performed. Halite was in average at least 12 times faster than seven representative works, and always presented highly accurate results. On real data, Halite was at least 11 times faster than others, increasing their accuracy in up to 35 percent. Finally, we report experiments in a real scenario where soft clustering is desirable.
Shape, Correlation, Laplace equations, Convolution, Proposals, Accuracy, Complexity theory, data mining, Local-correlation clustering, moderate-to-high dimensional data
Caetano Traina Jr., Christos Faloutsos, Agma J.M. Traina, Robson L.F. Cordeiro, "Halite: Fast and Scalable Multiresolution Local-Correlation Clustering", IEEE Transactions on Knowledge & Data Engineering, vol. 25, no. , pp. 387-401, Feb. 2013, doi:10.1109/TKDE.2011.176
90 ms
(Ver 3.3 (11022016))