The Community for Technology Leaders
RSS Icon
Subscribe
Brussels, Belgium Belgium
Dec. 10, 2012 to Dec. 10, 2012
ISBN: 978-1-4673-5164-5
pp: 449-453
ABSTRACT
Mining closed frequent item set(CFI) plays a fundamental role in many real-world data mining applications. However, memory requirement and computational cost have become the bottleneck of CFI mining algorithms, particularly when confronting with large scale datasets, which herewith makes mining closed frequent item set from large scale datasets a significant and challenging issue. To address the above issue, a parallelized AFOPT-close algorithm is proposed and implemented in this paper based on the cloud computing framework MapReduce, which is widely used to cope with large scale data. Furthermore, an efficient parallelized method for checking if a frequent item set is globally closed is also proposed on the MapReduce platform to further improve the mining performance. Experimental results are then provided and analyzed to verify the efficiency and effectiveness of the proposed methods for mining closed frequent item set.
INDEX TERMS
Itemsets, Data mining, Algorithm design and analysis, Redundancy, Clustering algorithms, Scalability, Conferences, Hadoop, closed frequent itemset, MapReduce, data mining, AFOPT-close
CITATION
Su-Qi Wang, Yu-Bin Yang, Yang Gao, Guang-Peng Chen, Yao Zhang, "MapReduce-based Closed Frequent Itemset Mining with Efficient Redundancy Filtering", ICDMW, 2012, 2013 IEEE 13th International Conference on Data Mining Workshops, 2013 IEEE 13th International Conference on Data Mining Workshops 2012, pp. 449-453, doi:10.1109/ICDMW.2012.24
17 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool