The Community for Technology Leaders
RSS Icon
Subscribe
Honolulu, HI, USA USA
June 24, 2012 to June 29, 2012
ISBN: 978-1-4673-2892-0
pp: 59-66
ABSTRACT
DBSCAN is a well-known algorithm for density-based clustering because it can identify the groups of arbitrary shapes and deal with noisy datasets. However, with the increasing amount of data, DBSCAN algorithm running on a single machine has to face the scalability problem. In this paper, we propose a Map/Reduce-based DBSCAN algorithm called DBSCAN-MR to solve the scalability problem. In DBSCAN-MR, the input dataset is partitioned into smaller parts and then parallel processed on the Hadoop platform. However, choosing different partition mechanisms will affect the execution efficiency and load balance of each node. Therefore, we propose a method, partition with reduce boundary points (PRBP), to select partition boundaries based on the distribution of data points. Our experimental results show that DBSCAN-MR with the design of PRBP has higher efficiency and scalability than competitors.
INDEX TERMS
Partitioning algorithms, Algorithm design and analysis, Clustering algorithms, Indexes, Scalability, Cloud computing, Data mining, cloud computing, data mining, data clustering, DBSCAN, Map/Reduce, data partition, Hadoop
CITATION
Bi-Ru Dai, I-Chang Lin, "Efficient Map/Reduce-Based DBSCAN Algorithm with Optimized Data Partition", CLOUD, 2012, 2013 IEEE Sixth International Conference on Cloud Computing, 2013 IEEE Sixth International Conference on Cloud Computing 2012, pp. 59-66, doi:10.1109/CLOUD.2012.42
165 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool