Issue No. 04 - April (2012 vol. 34)
Dong Xu , Sch. of Comput. Eng., Nanyang Technol. Univ., Singapore, Singapore
Feiping Nie , Dept. of Comput. Sci. & Eng., Univ. of Texas at Arlington, Arlington, TX, USA
Yi Yang , Coll. of Comput. Sci., Zhejiang Univ., Hangzhou, China
Jiebo Luo , Kodak Res. Labs., Eastman Kodak Co., Rochester, NY, USA
Yueting Zhuang , Coll. of Comput. Sci., Zhejiang Univ., Hangzhou, China
Yunhe Pan , Coll. of Comput. Sci., Zhejiang Univ., Hangzhou, China
We present a new framework for multimedia content analysis and retrieval which consists of two independent algorithms. First, we propose a new semi-supervised algorithm called ranking with Local Regression and Global Alignment (LRGA) to learn a robust Laplacian matrix for data ranking. In LRGA, for each data point, a local linear regression model is used to predict the ranking scores of its neighboring points. A unified objective function is then proposed to globally align the local models from all the data points so that an optimal ranking score can be assigned to each data point. Second, we propose a semi-supervised long-term Relevance Feedback (RF) algorithm to refine the multimedia data representation. The proposed long-term RF algorithm utilizes both the multimedia data distribution in multimedia feature space and the history RF information provided by users. A trace ratio optimization problem is then formulated and solved by an efficient algorithm. The algorithms have been applied to several content-based multimedia retrieval applications, including cross-media retrieval, image retrieval, and 3D motion/pose data retrieval. Comprehensive experiments on four data sets have demonstrated its advantages in precision, robustness, scalability, and computational efficiency.
relevance feedback, content-based retrieval, data structures, image retrieval, Laplace equations, learning (artificial intelligence), matrix algebra, multimedia computing, regression analysis, pose data retrieval, semisupervised ranking, multimedia content analysis, multimedia content retrieval, semisupervised algorithm, local regression, global alignment, learning, Laplacian matrix, data ranking, local linear regression model, ranking score prediction, unified objective function, semisupervised long-term relevance feedback algorithm, multimedia data representation, multimedia data distribution, multimedia feature space, trace ratio optimization problem, content-based multimedia retrieval applications, cross-media retrieval, image retrieval, 3D motion data retrieval, Multimedia communication, Radio frequency, Algorithm design and analysis, Multimedia databases, Image retrieval, Data models, Manifolds, 3D motion data retrieval., Content-based multimedia retrieval, semi-supervised learning, ranking algorithm, relevance feedback, cross-media retrieval, image retrieval
Dong Xu, Feiping Nie, Yi Yang, Jiebo Luo, Yueting Zhuang and Yunhe Pan, "A Multimedia Retrieval Framework Based on Semi-Supervised Ranking and Relevance Feedback," in IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 34, no. , pp. 723-742, 2012.