The Community for Technology Leaders
International Workshop on Knowledge Discovery and Data Mining (2010)
Phuket, Thailand
Jan. 9, 2010 to Jan. 10, 2010
ISBN: 978-0-7695-3923-2
pp: 478-481
ABSTRACT
Collaborative Filtering(CF) algorithms are widely used in a lot of recommender systems, however, the computational complexity of CF is high thus hinder their use in large scale systems. In this paper, we implement user-based CF algorithm on a cloud computing platform, namely Hadoop, to solve the scalability problem of CF. Experimental results show that a simple method that partition users into groups according to two basic principles, i.e., tidy arrangement of mapper number to overcome the initiation of mapper and partition task equally such that all processors finish task at the same time, can achieve linear speedup.
INDEX TERMS
collaborative filtering, recommender systems, cloud computing, hadoop, Map-Reduce
CITATION
Ming-sheng Shang, Zhi-Dan Zhao, "User-Based Collaborative-Filtering Recommendation Algorithms on Hadoop", International Workshop on Knowledge Discovery and Data Mining, vol. 00, no. , pp. 478-481, 2010, doi:10.1109/WKDD.2010.54
91 ms
(Ver 3.3 (11022016))