2010 Third International Conference on Knowledge Discovery and Data Mining User-Based Collaborative-Filtering Recommendation Algorithms on Hadoop Phuket, Thailand January 09-January 10 ISBN: 978-0-7695-3923-2
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/WKDD.2010.54
Collaborative Filtering(CF) algorithms are widely used in a lot of recommender systems, however, the computational complexity of CF is high thus hinder their use in large scale systems. In this paper, we implement user-based CF algorithm on a cloud computing platform, namely Hadoop, to solve the scalability problem of CF. Experimental results show that a simple method that partition users into groups according to two basic principles, i.e., tidy arrangement of mapper number to overcome the initiation of mapper and partition task equally such that all processors finish task at the same time, can achieve linear speedup.
Index Terms:
collaborative filtering, recommender systems, cloud computing, hadoop, Map-Reduce
Citation:
Zhi-Dan Zhao, Ming-sheng Shang, "User-Based Collaborative-Filtering Recommendation Algorithms on Hadoop," wkdd, pp.478-481, 2010 Third International Conference on Knowledge Discovery and Data Mining, 2010 Usage of this product signifies your acceptance of the Terms of Use. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||