Issue No. 02 - Feb. (2013 vol. 25)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TKDE.2011.176
Robson L.F. Cordeiro , University of São Paulo, São Carlos
Agma J.M. Traina , Universidade de São Paulo, São Carlos
Christos Faloutsos , Carnegie Mellon University, Pittsburgh
Caetano Traina Jr. , University of São Paulo, São Carlos
This paper proposes Halite, a novel, fast, and scalable clustering method that looks for clusters in subspaces of multidimensional data. Existing methods are typically superlinear in space or execution time. Halite's strengths are that it is fast and scalable, while still giving highly accurate results. Specifically the main contributions of Halite are: 1) Scalability: it is linear or quasi linear in time and space regarding the data size and dimensionality, and the dimensionality of the clusters' subspaces; 2) Usability: it is deterministic, robust to noise, doesn't take the number of clusters as an input parameter, and detects clusters in subspaces generated by original axes or by their linear combinations, including space rotation; 3) Effectiveness: it is accurate, providing results with equal or better quality compared to top related works; and 4) Generality: it includes a soft clustering approach. Experiments on synthetic data ranging from five to 30 axes and up to 1 \rm million points were performed. Halite was in average at least 12 times faster than seven representative works, and always presented highly accurate results. On real data, Halite was at least 11 times faster than others, increasing their accuracy in up to 35 percent. Finally, we report experiments in a real scenario where soft clustering is desirable.
Shape, Correlation, Laplace equations, Convolution, Proposals, Accuracy, Complexity theory, data mining, Local-correlation clustering, moderate-to-high dimensional data
C. Traina Jr., C. Faloutsos, A. J. Traina and R. L. Cordeiro, "Halite: Fast and Scalable Multiresolution Local-Correlation Clustering," in IEEE Transactions on Knowledge & Data Engineering, vol. 25, no. , pp. 387-401, 2013.