The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.05 - May (2014 vol.26)
pp: 1076-1089
Mingsheng Long , Sch. of Software, Tsinghua Univ., Beijing, China
Jianmin Wang , Sch. of Software, Tsinghua Univ., Beijing, China
Guiguang Ding , Sch. of Software, Tsinghua Univ., Beijing, China
Sinno Jialin Pan , Inst. of Infocomm Res., Singapore, Singapore
Philip S. Yu , Dept. of Comput. Sci., Univ. of Illinois at Chicago, Chicago, IL, USA
ABSTRACT
Domain transfer learning, which learns a target classifier using labeled data from a different distribution, has shown promising value in knowledge discovery yet still been a challenging problem. Most previous works designed adaptive classifiers by exploring two learning strategies independently: distribution adaptation and label propagation. In this paper, we propose a novel transfer learning framework, referred to as Adaptation Regularization based Transfer Learning (ARTL), to model them in a unified way based on the structural risk minimization principle and the regularization theory. Specifically, ARTL learns the adaptive classifier by simultaneously optimizing the structural risk functional, the joint distribution matching between domains, and the manifold consistency underlying marginal distribution. Based on the framework, we propose two novel methods using Regularized Least Squares (RLS) and Support Vector Machines (SVMs), respectively, and use the Representer theorem in reproducing kernel Hilbert space to derive corresponding solutions. Comprehensive experiments verify that ARTL can significantly outperform state-of-the-art learning methods on several public text and image datasets.
INDEX TERMS
support vector machines, Hilbert spaces, learning (artificial intelligence), least squares approximations, minimisation, pattern classification,kernel Hilbert space, target classifier, labeled data, adaptive classifier, distribution adaptation, label propagation, adaptation regularization based transfer learning, ARTL, structural risk minimization principle, regularization theory, structural risk functional, joint distribution matching, regularized least square, support vector machines, RLS, SVM, representer theorem,Manifolds, Kernel, Joints, Standards, Risk management, Probability distribution, Feature extraction,textual and multimedia data, Classifier design and evaluation, Design Methodology, Pattern Recognition, Computing Methodologies, Knowledge acquisition, Learning, Artificial Intelligence, Information Technology and Systems, Database Management, Database Applications, Mining methods and algorithms, Modeling structured,generalization error, Transfer learning, adaptation regularization, distribution adaptation, manifold regularization
CITATION
Mingsheng Long, Jianmin Wang, Guiguang Ding, Sinno Jialin Pan, Philip S. Yu, "Adaptation Regularization: A General Framework for Transfer Learning", IEEE Transactions on Knowledge & Data Engineering, vol.26, no. 5, pp. 1076-1089, May 2014, doi:10.1109/TKDE.2013.111
57 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool