This Article 
 Bibliographic References 
 Add to: 
Probabilistic Memory-Based Collaborative Filtering
January 2004 (vol. 16 no. 1)
pp. 56-69

Abstract—Memory-based collaborative filtering (CF) has been studied extensively in the literature and has proven to be successful in various types of personalized recommender systems. In this paper, we develop a probabilistic framework for memory-based CF (PMCF). While this framework has clear links with classical memory-based CF, it allows us to find principled solutions to known problems of CF-based recommender systems. In particular, we show that a probabilistic active learning method can be used to actively query the user, thereby solving the “new user problem.” Furthermore, the probabilistic framework allows us to reduce the computational cost of memory-based CF by working on a carefully selected subset of user profiles, while retaining high accuracy. We report experimental results based on two real-world data sets, which demonstrate that our proposed PMCF framework allows an accurate and efficient prediction of user preferences.

[1] D. Billsus and M.J. Pazzani, Learning Collaborative Information Filters Proc. 15th Int'l Conf. Machine Learning, pp. 46-54, 1998.
[2] M. Balabanovic and Y. Shoham, Fab: Content-Based, Collaborative Recommendation Comm. ACM, vol. 40, no. 3, pp. 66-72, 1997.
[3] R.J. Mooney and L. Roy, Content-Based Book Recommending Using Learning for Text Categorization Proc. Fifth ACM Conf. Digital Libaries, pp. 195-204, 2000.
[4] M. Pazzani, J. Muramastsu, and D. Billsus, Syskill and Webert: Identifying Interesting Web Sites Proc. 13th Nat'l Conf. Artificial Intelligence, pp. 54-61, 1996.
[5] P. Resnick, N. Iacovou, M. Sushak, P. Bergstrom, and J. Riedl, Grouplens: An Open Architecture for Collaborative Filtering of Netnews Proc. 1994 Computer Supported Collaborative Work Conf., pp. 175-186, 1994.
[6] U. Shardanand and P. Maes, Social Information Filtering Algorithms for Automating,‘Word of Mouth’ Proc. ACM CHI'95 Conf. Human Factors in Computing Systems, vol. 1, pp. 210-217, 1995.
[7] B. Sarwar, G. Karypis, J. Konstan, and J. Riedl, Analysis of Recommendation Algorithms for E-Commerce Proc. ACM E-Commerce Conf., pp. 158-167, 2000.
[8] W. Hill, L. Stead, M. Rosenstein, and G. Furnas, Recommending and Evaluating Choices in a Virtual Community of Use Proc. ACM CHI'95 Conf. Human Factors in Computing Systems, pp. 194-201, 1995.
[9] B.J. Dahlen, J.A. Konstan, J.L. Herlocker, and J. Riedl, Jump-Starting Movielens: User Benefits of Starting a Collaborative Filtering System with Dead Data Technical Report 7, Univ. of Minnesota, 1998.
[10] K. Goldberg, T. Roeder, D. Gupta, and C. Perkins, Eigentaste: A Constant Time Collaborative Filtering Algorithm Information Retrieval J., vol. 4, no. 2, pp. 133-151, 2001.
[11] J.S. Breese, D. Heckerman, and C. Kadie, Empirical Analysis of Predictive Algorithms for Collaborative Filtering Proc. 14th Conf. Uncertainty in Artificial Intelligence, pp. 43-52, 1998.
[12] C. Basu, H. Hirsh, and W.W. Cohen, Recommendation as Classification: Using Social and Content-Based Information in Recommendation Proc. 15th Nat'l Conf. Artificial Intelligence AAAI/IAAI, pp. 714-720, 1998.
[13] T. Zhang and V. S. Iyengar, Recommender Systems Using Linear Classifiers J. Machine Learning Research, vol. 2, pp. 313-334, 2002.
[14] D. Heckerman, D.M. Chickering, C. Meek, R. Rounthwaite, and C. Kadie, Dependency Networks for Inference, Collaborative Filtering, and Data Visualization J. Machine Learning Research, vol. 1, pp. 49-75, 2000.
[15] T. Hofmann and J. Puzicha, Latent Class Models for Collaborative Filtering Proc. Int'l Joint Conf. Artificial Intelligence, pp. 688-693, 1999.
[16] W.S. Lee, Collaborative Learning for Recommender Systems Proc. 18th Int'l Conf. Machine Learning, pp. 314-321, 2001.
[17] B. Sarwar, G. Karypis, J. Konstan, and J. Riedl, Item-Based Collaborative Filtering Recommendation Algorithms Proc. 10th World Wide Web (WWW10) Conf., pp. 285-295, 2001.
[18] W. Lin, S.A. Alvarez, and C. Ruiz, Collaborative Recommendation via Adaptive Association Rule Mining Data Mining and Knowledge Discovery, vol. 6, no. 1, pp. 83-105, Jan. 2002.
[19] D.M. Pennock, E. Horvitz, S. Lawrence, and C.L. Giles, Collaborative Filtering by Personality Diagnosis: A Hybrid Memory- and Model-Based Approach Proc. 16th Conf. Uncertainty in Artificial Intelligence, pp. 473-480, 2000.
[20] N. Good, J.B. Schafer, J. Konstan, A. Borchers, B. Sarwar, J. Herlocker, and J. Riedl, Combining Collaborative Filtering with Personal Agents for Better Recommendations Proc. AAAI-99, pp. 439-446, 1999.
[21] A.M. Rashid, I. Albert, D. Cosley, S.K. Lam, S.M. McNee, J.A. Konstan, and J. Riedl, Getting to Know You: Learning New User Preferences in Recommender Systems Proc. Int'l Conf. Intelligent User Interface (IUI2002), 2002.
[22] J.L. Herlocker, J.A. Konstan, and J. Riedl, Explaining Collaborative Filtering Recommendations Proc. Computer Supported Cooperative Work (CSCW '00) Conf., pp. 241-250, 2000.
[23] C. Boutilier and R.S. Zemel, Online Queries for Collaborative Filtering Proc. Ninth Int'l Workshop Artificial Intelligence and Statistics, 2003.
[24] F. V. Jensen, Bayesian Networks and Decision Graphs, Statistics for Engineering and Information Science, Springer, 2001.
[25] D. Heckerman, J. Breese, and K. Rommelse, Troubleshooting under Uncertainty Technical Report MSR-TR-94-07, Microsoft Research, 1994.
[26] S. Tong, Active Learning: Theory and Applicaitons PhD thesis, Stanford Univ., 2001.
[27] D. Lewis and J. Catlett, Heterogeneous Uncertainty Sampling for Supervised Learning Proc. 11th Int'l Conf. Machine Learning, pp. 148-156, 1994.
[28] T. Cover and J. Thomas, Elements of Information Theory. Wiley, 1991.
[29] G. Fishman, Monte Carlo Concepts, Algorithms and Applications. Springer Verlag, 1996.
[30] B. Scholkopf and A.J. Smola, Learning with Kernels. MIT Press, 2002.
[31] J.L. Herlocker, J.A. Konstan, A. Borchers, and J. Riedl, An Algorithmic Framework for Performing Collaborative Filtering Proc. ACM Conf. Research and Development in Information Retrieval (SIGIR '99), pp. 230-237, 1999.
[32] K. Miyahara and M.J. Pazzani, Collaborative Filtering with the Simple Bayesian Classifier Proc. Sixth Pacific Rim Int'l Conf. Artificial Intelligence PRICAI 2000, pp. 679-689, 2000.
[33] K. Yu, A. Schwaighofer, V. Tresp, W.-Y. Ma, and H. Zhang, Collaborative Ensemble Learning: Combining Collaborative and Content-Based Information Filtering Proc. 19th Conf. Uncertainty in Artificial Intelligence, pp. 616-623, 2003.

Index Terms:
Collaborative filtering, recommender systems, profile density model, active learning, data sampling.
Kai Yu, Anton Schwaighofer, Volker Tresp, Xiaowei Xu, Hans-Peter Kriegel, "Probabilistic Memory-Based Collaborative Filtering," IEEE Transactions on Knowledge and Data Engineering, vol. 16, no. 1, pp. 56-69, Jan. 2004, doi:10.1109/TKDE.2004.1264822
Usage of this product signifies your acceptance of the Terms of Use.