The Community for Technology Leaders
Parallel Architectures, Algorithms and Programming, International Symposium on (2011)
Tianjin, China
Dec. 9, 2011 to Dec. 11, 2011
ISBN: 978-0-7695-4575-2
pp: 252-257
ABSTRACT
Many algorithms have been proposed in past decades to efficiently mine frequent sets in transaction database, including the SON Algorithm proposed by Savasere, Omiecinski and Navathe. This paper introduces the SON algorithm, explains why SON is very suitable to be parallelized, and illustrates how to adapt SON to the MapReduce paradigm. Then we propose a parallelized SON algorithm, PSON, and implement it in Hadoop. Our study suggests that PSON can mine frequent item sets from a very large database with good performance. The experimental results show that when performing frequent sets mining, the time cost will increase almost linearly with the size of the datasets and decrease with approximately linear trend with the number of cluster nodes. Consequently, we conclude that PSON works well for solving the frequent set mining problem from massive datasets with a good performance in both scalability and speed-up.
INDEX TERMS
frequent sets mining, parallelized SON algorithm, MapReduce, Hadoop
CITATION
Yihua Huang, Tao Xiao, Chunfeng Yuan, "PSON: A Parallelized SON Algorithm with MapReduce for Mining Frequent Sets", Parallel Architectures, Algorithms and Programming, International Symposium on, vol. 00, no. , pp. 252-257, 2011, doi:10.1109/PAAP.2011.38
249 ms
(Ver 3.3 (11022016))