Parallel and Distributed Processing Symposium, International (2010)
Atlanta, GA, USA
Apr. 19, 2010 to Apr. 23, 2010
Yongpeng Zhang , Dept. of Computer Science, North Carolina State University, Raleigh, NC 27695-7534
Frank Mueller , Dept. of Computer Science, North Carolina State University, Raleigh, NC 27695-7534
Xiaohui Cui , Oak Ridge National Laboratory, Computational Sciences and Engineering Division, Oak Ridge, TN 37831
Thomas Potok , Oak Ridge National Laboratory, Computational Sciences and Engineering Division, Oak Ridge, TN 37831
Document clustering plays an important role in data mining systems. Recently, a flocking-based document clustering algorithm has been proposed to solve the problem through simulation resembling the flocking behavior of birds in nature. This method is superior to other clustering algorithms, including k-means, in the sense that the outcome is not sensitive to the initial state. One limitation of this approach is that the algorithmic complexity is inherently quadratic in the number of documents. As a result, execution time becomes a bottleneck with large number of documents. In this paper, we assess the benefits of exploiting the computational power of Beowulf-like clusters equipped with contemporary Graphics Processing Units (GPUs) as a means to significantly reduce the runtime of flocking-based document clustering. Our framework scales up to over one million documents processed simultaneously in a sixteen-node moderate GPU cluster. Results are also compared to a four-node cluster with higher-end GPUs. On these clusters, we observe 30X-50X speedups, which demonstrate the potential of GPU clusters to efficiently solve massive data mining problems. Such speedups combined with the scalability potential and accelerator-based parallelization are unique in the domain of document-based data mining, to the best of our knowledge.
Y. Zhang, F. Mueller, T. Potok and X. Cui, "Large-scale multi-dimensional document clustering on GPU clusters," 2010 IEEE International Symposium on Parallel & Distributed Processing (IPDPS), Atlanta, GA, 2010, pp. 1-10.