The Community for Technology Leaders
RSS Icon
Issue No.02 - February (2011 vol.23)
pp: 175-189
Kamal Premaratne , University of Miami, Coral Gables
Thanuka L. Wickramarathne , University of Miami, Coral Gables
Dushyantha T. Jayaweera , University of Miami, Coral Gables
Automated Collaborative Filtering (ACF) refers to a group of algorithms used in recommender systems, a research topic that has received considerable attention due to its e-commerce applications. However, existing techniques are rarely capable of dealing with imperfections in user-supplied ratings. When such imperfections (e.g., ambiguities) cannot be avoided, designers resort to simplifying assumptions that impair the system's performance and utility. We have developed a novel technique referred to as CoFiDS—Collaborative Filtering based on Dempster-Shafer belief-theoretic framework—that can represent a wide variety of data imperfections, propagate them throughout the decision-making process without the need to make simplifying assumptions, and exploit contextual information. With its DS-theoretic predictions, the domain expert can either obtain a "hard” decision or can narrow the set of possible predictions to a smaller set. With its capability to handle data imperfections, CoFiDS widens the applicability of ACF to such critical and sensitive domains as medical decision support systems and defense-related applications. We describe the theoretical foundation of the system and report experiments with a benchmark movie data set. We explore some essential aspects of CoFiDS' behavior and show that its performance compares favorably with other ACF systems.
Recommender systems, collaborative filtering, Dempster-Shafer (DS) theory, imperfect data, ambiguous data, user preference modeling, contextual information.
Kamal Premaratne, Thanuka L. Wickramarathne, Dushyantha T. Jayaweera, "CoFiDS: A Belief-Theoretic Approach for Automated Collaborative Filtering", IEEE Transactions on Knowledge & Data Engineering, vol.23, no. 2, pp. 175-189, February 2011, doi:10.1109/TKDE.2010.88
[1] GroupLens Research, "MovieLens Data Sets," Dept. of Computer Science and Eng., Univ. of Minnesota, http://www.grouplens. org/taxonomy/term14 , 2007.
[2] D. Goldberg, D. Nichols, B.M. Oki, and D. Terry, "Using Collaborative Filtering to Weave an Information Tapestry," Comm. ACM, vol. 35, no. 12, pp. 61-70, Dec. 1992.
[3] D. Maltz and K. Ehrlich, "Pointing the Way: Active Collaborative Filtering," Proc. SIGCHI Conf. Human Factors in Computing Systems, pp. 202-209, 1995.
[4] D. Billsus and M.J. Pazzani, "Learning Collaborative Information Filters," Proc. Int'l Conf. Machine Learning (ICML '98), pp. 46-54, 1998.
[5] J.L. Herlocker, "Understanding and Improving Automated Collaborative Filtering Systems," PhD dissertation, Univ. of Minnesota, 2000.
[6] G. Adomavicious and A. Tuzhilin, "Toward the Next Generation of Recommender Systems: A Survey of the State-of-the-Art and Possible Extensions," IEEE Trans. Knowledge and Data Eng., vol. 17, no. 6, pp. 734-749, June 2005.
[7] Y. Koren, "Factorization Meets the Neighborhood," Proc. ACM SIGKDD, pp. 426-434, 2008.
[8] R. Salakhutdinov and A. Minh, "Bayesian Probabilistic Matrix Factorization Using Markov Chain Monte Carlo," Proc. Int'l Conf. Machine Learning (ICML '08), pp. 880-887, 2008.
[9] Y. Koren, R. Bell, and C. Volinsky, "Matrix Factorization Techniques for Recommender Systems," Computer, vol. 42, no. 8, pp. 30-37, Aug. 2009.
[10] G. Linden, B. Smith, and J. York, " Recommendations: Item-to-Item Collaborative Filtering," IEEE Internet Computing, vol. 7, no. 1, pp. 76-80, Jan. 2003.
[11] H.-W. Tung and V.-W. Soo, "A Personalized Restaurant Recommender Agent for Mobile E-Service," Proc. IEEE Int'l Conf. e-Technology, e-Commerce and e-Service (EEE '04), pp. 259-262, 2004.
[12] J. Wang, J. Pouwelse, R.L. Lagendijk, and M.J.T. Reinders, "Distributed Collaborative Filtering for Peer-to-Peer File Sharing Systems," Proc. ACM Symp. Applied Computing (SAC '06), pp. 1026-1030, 2006.
[13] E. Aimeur, F.S.M. Onana, and A. Saleman, "HELP: A Recommender System to Locate Expertise in Organizational Memories," Proc. IEEE/ACS Int'l Conf. Computer Systems and Applications (AICCSA '07), pp. 866-874, May 2007.
[14] J.B. Schafer, J.A. Konstan, and J. Riedl, "E-Commerce Recommender Applications," Data Mining and Knowledge Discovery, vol. 5, nos. 1/2, pp. 115-152, 2001.
[15] B. Sarwar, G. Karypis, J. Konstan, and J. Riedl, "Analysis of Recommendation Algorithms for E-Commerce," Proc. ACM Conf. Electronic Comm., pp. 158-167, 2000.
[16] D.M. Fleder and K. Hosanagar, "Blockbuster Culture's Next Rise or Fall: The Impact of Recommender Systems on Sales Diversity," Management Science, vol. 55, no. 5, pp. 697-712, May 2009.
[17] P. Symeonidis, A. Nanopoulos, A. Papadopoulos, and Y. Manolopoulos, "Collaborative Filtering Process in a Whole New Light," Proc. Int'l Database Eng. and Applications Symp. (IDEAS '06), pp. 29-36, 2006.
[18] M. Kunaver, T. Pozrl, M. Pogacnik, and J. Tasic, "Optimisation of Combined Collaborative Recommender Systems," Int'l J. Electronics and Comm., vol. 61, no. 7, pp. 433-443, July 2007.
[19] K. Yu, A. Schwaighofer, V. Tresp, X. Xu, and H.-P. Kriegel, "Probabilistic Memory-Based Collaborative Filtering," IEEE Trans. Knowledge and Data Eng., vol. 16, no. 1, pp. 56-69, Jan. 2004.
[20] A. Nakamura and N. Abe, "Collaborative Filtering Using Weighted Majority Prediction Algorithms," Proc. Int'l Conf. Machine Learning (ICML '98), pp. 395-403, 1998.
[21] P. Li and S. Yamada, "A Movie Recommender System Based on Inductive Learning," Proc. IEEE Conf. Cybernetics and Intelligent Systems, vol. 1, pp. 318-323, Dec. 2004.
[22] S. Kuwata and N. Ueda, "One-Shot Collaborative Filtering," Proc. IEEE Symp. Computational Intelligence and Data Mining (CIDM '07), pp. 300-307, Mar./Apr. 2007.
[23] P. Melville, R.J. Mooney, and R. Nagarajan, "Content-Boosted Collaborative Filtering for Improved Recommendations," Proc. Nat'l Conf. Artificial Intelligence, pp. 187-192, July 2002.
[24] C. Christakou, L. Lefakis, S. Vrettos, and A. Stafylopatis, "A Movie Recommender System Based on Semi-Supervised Clustering," Proc. Int'l Conf. Computational Intelligence for Modelling, Control and Automation and Int'l Conf. Intelligent Agents, Web Technologies and Internet Commerce, vol. 2, pp. 897-903, Nov. 2005.
[25] J. Salter and N. Antonopoulos, "CinemaScreen Recommender Agent: Combining Collaborative and Content-Based Filtering," IEEE Intelligent Systems, vol. 21, no. 1, pp. 35-41, Jan./Feb. 2006.
[26] J.L. Herlocker, J.A. Konstan, and J. Riedl, "Explaining Collaborative Filtering Recommendations," Proc. ACM Conf. Computer Supported Cooperative Work, pp. 241-250, 2000.
[27] S.Y. Jung, J.-H. Hong, and T.-S. Kim, "A Statistical Model for User Preference," IEEE Trans. Knowledge and Data Eng., vol. 17, no. 6, pp. 834-843, June 2005.
[28] S. Parsons, "Current Approaches to Handling Imperfect Information in Data and Knowledge Bases," Knowledge and Data Eng., vol. 8, no. 3, pp. 353-372, 1996.
[29] F.J. Palella, K.M. Delaney, A.C. Moorman, M.O. Loveless, J. Fuhrer, G.A. Satten, D.J. Aschman, and S.D. Holmberg, "Declining Morbidity and Mortality among Patients with Advanced Human Immunodeficiency Virus Infection. HIV Outpatient Study Investigators," The New England J. Medicine, vol. 338, no. 13, pp. 853-860, Mar. 1998.
[30] AIDSinfo, US Dept. of Health and Human Services, http:/, 2010.
[31] D.T. Jayaweera et al., "Effectiveness and Tolerability of a Once-Daily Amprenavir/Ritonavir-Containing Highly Active Antiretroviral Therapy Regimen in Antiretroviral-Naive Patients at Risk for Non-Adherence: 48-Week Results After 24 Weeks of Directly Observed Therapy," HIV Medicine, vol. 5, no. 5, pp. 364-370, Sept. 2004.
[32] J. Gathe et al., "Efficacy of the Protease Inhibitors Tipranavir Plus Ritonavir in Treatment-Experienced Patients: 24-Week Analysis from the RESIST-1 Trial," Clinical Infectious Diseases, vol. 43, no. 10, pp. 1337-1346, Oct. 2006.
[33] K.K.R.G.K. Hewawasam, K. Premaratne, and M.-L. Shyu, "Rule Mining and Classification in a Situation Assessment Application: A Belief Theoretic Approach for Handling Data Imperfections," IEEE Trans. Systems, Man and Cybernetics, Part B: Cybernetics, vol. 37, no. 6, pp. 1446-1459, Dec. 2007.
[34] F. Delmotte and P. Smets, "Target Identification Based on the Transferable Belief Model Interpretation of Dempster-Shafer Model," IEEE Trans. Systems, Man and Cybernetics, Part A: Systems and Humans, vol. 34, no. 4, pp. 457-471, July 2004.
[35] D.A. Dewasurendra, P.H. Bauer, and K. Premaratne, "Evidence Filtering," IEEE Trans. Signal Processing, vol. 55, no. 12, pp. 5796-5805, Dec. 2007.
[36] U. Shardanand and P. Maes, "Social Information Filtering: Algorithms for Automating "Word of Mouth"," Proc. SIGCHI Conf. Human Factors in Computing Systems, pp. 210-217, 1995.
[37] N. Good, J.B. Schafer, J.A. Konstan, A. Borchers, B. Sarwar, J. Herlocker, and J. Riedl, "Combining Collaborative Filtering with Personal Agents for Better Recommendations," Proc. Nat'l Conf. Artificial Intelligence and Innovative Applications of Artificial Intelligence, pp. 439-446, 1999.
[38] G. Adomavicious, R. Sankaranarayanan, S. Sen, and A. Tuzhilin, "Incorporating Contextual Information in Recommender Systems Using a Multidimensional Approach," ACM Trans. Information Systems, vol. 23, no. 1, pp. 103-145, Jan. 2005.
[39] J. Cho, K. Kwon, and Y. Park, "Collaborative Filtering Using Dual Information Sources," Intelligent Systems, vol. 22, no. 3, pp. 30-38, May/June 2007.
[40] M.G. Vozalis and K.G. Margaritis, "Using SVD and Demographic Data for the Enhancement of Generalized Collaborative Filtering," Information Sciences: An Int'l J., vol. 177, no. 15, pp. 3017-3037, Aug. 2007.
[41] G. Shafer, A Mathematical Theory of Evidence. Princeton Univ. Press, 1976.
[42] P. Vannoorenberghe, "On Aggregating Belief Decision Trees," Information Fusion, vol. 5, no. 3, pp. 179-188, Sept. 2004.
[43] P. Smets, "Practical Uses of Belief Functions," Proc. Conf. Uncertainty in Artificial Intelligence (UAI '99), K.B. Laskey and H. Prade, eds., pp. 612-621, 1999.
[44] H. Chan and A. Darwiche, "A Distance Measure for Bounding Probabilistic Belief Change," Int'l J. Approximate Reasoning, vol. 38, no. 2, pp. 149-174, Feb. 2005.
[45] J.L. Herlocker, J.A. Konstan, A. Borchers, and J. Riedl, "An Algorithmic Framework for Performing Collaborative Filtering," Proc. Int'l ACM SIGIR Conf. Research and Development in Information Retrieval, pp. 230-237, 1999.
[46] I. Bloch, "Some Aspects of Dempster-Shafer Evidence Theory for Classification of Multi-Modality Medical Images Taking Partial Volume Effect into Account," Pattern Recognition Letters, vol. 17, no. 8, pp. 905-919, July 1996.
[47] S. Blackman and R. Popoli, Design and Analysis of Modern Tracking Systems. Artech House, 1999.
[48] J.L. Herlocker, J.A. Konstan, L.G. Terveen, and J.T. Riedl, "Evaluating Collaborative Filtering Recommender Systems," ACM Trans. Information Systems, vol. 22, no. 1, pp. 5-53, Jan. 2004.
[49] A.L. Jousselme, D. Grenier, and E. Bosse, "A New Distance between Two Bodies of Evidence," Information, vol. 2, no. 2, pp. 91-101, June 2001.
[50] I. Pilászy and D. Tikk, "Computational Complexity Reduction for Factorization-Based Collaborative Filtering Algorithms," Proc. Int'l Conf. E-Commerce and Web Technologies (EC-Web '09), pp. 229-239, 2009.
32 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool