The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.02 - February (2008 vol.20)
pp: 189-201
ABSTRACT
One of the fundamental problems in Content-Based Image Retrieval (CBIR) has been the gap been low level visual features and high level semantic concepts. To narrow down this gap, relevance feedback is introduced into image retrieval. With the user provided information, a classifier can be learned to discriminate between positive and negative examples. However, in real world applications, the number of user feedbacks is usually too small comparing to the dimensionality of the image space. Thus, a situation of overfitting may occur. In order to cope with the high dimensionality, we propose a novel supervised method for dimensionality reduction called Maximum Margin Projection (MMP). MMP aims to maximize the margin between positive and negative examples at each local neighborhood. Different from traditional dimensionality reduction algorithms such as Principal Component Analysis (PCA) and Linear Discriminant Analysis (LDA) which effectively see only the global Euclidean structure, MMP is designed for discovering the local manifold structure. Therefore, MMP is likely to be more suitable for image retrieval where nearest neighbor search is usually involved. After projecting the images into a lower dimensional subspace, the relevant images get closer to the query image, thus the retrieval performance can be enhanced. The experimental results on a large image database demonstrates the effectiveness and efficiency of our proposed algorithm.
INDEX TERMS
Image databases, Image/video retrieval, Information Search and Retrieval
CITATION
Xiaofei He, Deng Cai, Jiawei Han, "Learning a Maximum Margin Subspace for Image Retrieval", IEEE Transactions on Knowledge & Data Engineering, vol.20, no. 2, pp. 189-201, February 2008, doi:10.1109/TKDE.2007.190692
REFERENCES
[1] M. Belkin and P. Niyogi, “Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering,” Advances in Neural Information Processing Systems 14, pp. 585-591, MIT Press, 2001.
[2] M. Belkin, P. Niyogi, and V. Sindhwani, “Manifold Regularization: A Geometric Framework for Learning from Examples,” J.Machine Learning Research, 2006.
[3] Y. Bengio, J.-F. Paiement, P. Vincent, O. Delalleau, N.L. Roux, and M. Ouimet, “Out-of-Sample Extensions for LLE, Isomap, MDS, Eigenmaps, and Spectral Clustering,” Advances in Neural Information Processing Systems 16, 2003.
[4] J. Bi, Y. Chen, and J.Z. Wang, “A Sparse Support Vector Machine Approach to Region-Based Image Categorization,” Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR '04), 2004.
[5] D. Cai, X. He, K. Zhou, J. Han, and H. Bao, “Locality Sensitive Discriminant Analysis,” Proc. 20th Int'l Joint Conf. Artificial Intelligence (IJCAI '07), Jan. 2007.
[6] C.-C. Chang and C.-J. Lin, LIBSVM: A Library for Support Vector Machines, http://www.csie.ntu.edu.tw/~cjlinlibsvm, 2001.
[7] E. Chang, K. Goh, G. Sychay, and G. Wu, “Cbsa: Content-Based Soft Annotation for Multimodal Image Retrieval Using Bayes Point Machines,” IEEE Trans. Circuits and Systems for Video Technology, vol. 13, no. 1, pp. 26-38, Jan. 2003.
[8] H.-T. Chen, H.-W. Chang, and T.-L. Liu, “Local Discriminant Embedding and Its Variants,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition (CVPR '05), 2005.
[9] Y. Chen, X.S. Zhou, and T.S. Huang, “One-Class SVM for Learning in Image Retrieval,” Proc. IEEE Int'l Conf. Image Processing (ICIP '01), pp. 34-37, 2001.
[10] F.R.K. Chung, “Spectral Graph Theory,” Proc. CBMS Regional Conf. Series in Math., vol. 92, 1997.
[11] T.H. Cormen, C.E. Leiserson, R.L. Rivest, and C. Stein, Introduction to Algorithms, second ed. MIT Press, 2001.
[12] I.J. Cox, T.P. Minka, T.V. Papathomas, and P.N. Yianilos, “The Bayesian Image Retrieval System, Pichunter: Theory, Implementation, and Psychophysical Experiments,” IEEE Trans. Image Processing, vol. 9, pp. 20-37, 2000.
[13] N. Cristianini, J. Shawe-Taylor, A. Elisseeff, and J. Kandola, “On Kernel-Target Alignment,” Advances in Neural Information Processing Systems 14, 2001.
[14] R.O. Duda, P.E. Hart, and D.G. Stork, Pattern Classification, second ed. Wiley-Interscience, 2000.
[15] K.-S. Goh, E.Y. Chang, and W.-C. Lai, “Multimodal Concept-Dependent Active Learning for Image Retrieval,” Proc. 12th Ann. ACM Int'l Conf. Multimedia (Multimedia '04), Oct. 2004.
[16] A. Grama, G. Karypis, V. Kumar, and A. Gupta, An Introduction to Parallel Computing: Design and Analysis of Algorithms, second ed. Addison Wesley, 2003.
[17] T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer-Verlag, 2001.
[18] J. He, M. Li, H.-J. Zhang, H. Tong, and C. Zhang, “Manifold-Ranking-Based Image Retrieval,” Proc. 12th Ann. ACM Int'l Conf. Multimedia (Multimedia '04), Oct. 2004.
[19] X. He, “Incremental Semi-Supervised Subspace Learning for Image Retrieval,” Proc. 12th Ann. ACM Int'l Conf. Multimedia (Multimedia '04), Oct. 2004.
[20] X. He, D. Cai, and W. Min, “Statistical and Computational Analysis of LPP,” Proc. 22nd Int'l Conf. Machine Learning (ICML '05), 2005.
[21] X. He, D. Cai, S. Yan, and H.-J. Zhang, “Neighborhood Preserving Embedding,” Proc. 11th Int'l Conf. Computer Vision (ICCV '05), 2005.
[22] X. He and P. Niyogi, “Locality Preserving Projections,” Advances in Neural Information Processing Systems 16, MIT Press, 2003.
[23] X. He, S. Yan, Y. Hu, P. Niyogi, and H.-J. Zhang, “Face Recognition Using Laplacianfaces,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 3, pp. 328-340, Mar. 2005.
[24] S.C. Hoi, M.R. Lyu, and R. Jin, “A Unified Log-Based Relevance Feedback Scheme for Image Retrieval,” IEEE Trans. Knowledge and Data Eng., vol. 18, no. 4, pp. 509-524, Apr. 2006.
[25] S.C.H. Hoi, M.R. Lyu, and E.Y. Chang, “Learning the Unified Kernel Machines for Classification,” Proc. 12th ACM SIGKDD Int'l Conf. KNowledge Discovery and Data Mining, pp. 187-196, 2006.
[26] D.P. Huijsmans and N. Sebe, “How to Complete Performance Graphs in Content-Based Image Retrieval: Add Generality and Normalize Scope,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 2, pp. 245-251, Feb. 2005.
[27] Y.-Y. Lin, T.-L. Liu, and H.-T. Chen, “Semantic Manifold Learning for Image Retrieval,” Proc. 13th Ann. ACM Int'l Conf. Multimedia (Multimedia '05), Nov. 2005.
[28] W.-Y. Ma and B.S. Manjunath, “Netra: A Toolbox for Navigating Large Image Databases,” Multimedia Systems, vol. 7, no. 3, May 1999.
[29] A.Y. Ng, M. Jordan, and Y. Weiss, “On Spectral Clustering: Analysis and an Algorithm,” Advances in Neural Information Processing Systems 14, pp. 849-856, MIT Press, 2001.
[30] S. Roweis and L. Saul, “Nonlinear Dimensionality Reduction by Locally Linear Embedding,” Science, vol. 290, no. 500, pp. 2323-2326, 2000.
[31] Y. Rui, T.S. Huang, M. Ortega, and S. Mehrotra, “Relevance Feedback: A Power Tool for Interactive Content-Based Image Retrieval,” IEEE Trans. Circuits and Systems for Video Technology, vol. 8, no. 5, 1998.
[32] J. Shi and J. Malik, “Normalized Cuts and Image Segmentation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 888-905, Aug. 2000.
[33] V. Sindhwani, P. Niyogi, and M. Belkin, “Beyond the Point Cloud: From Transductive to Semi-Supervised Learning,” Proc. 22nd Int'l Conf. Machine Learning (ICML '05), 2005.
[34] A.W. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain, “Content-Based Image Retrieval at the End of the Early Years,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 12, pp. 1349-1380, Dec. 2000.
[35] J. Smith and S.-F. Chang, “Visualseek: A Fully Automated Content-Based Image Query System,” Proc. Fourth Ann. ACM Int'l Conf. Multimedia (Multimedia '96), 1996.
[36] Z. Su, S. Li, and H.-J. Zhang, “Extraction of Feature Subspace for Content-Based Retrieval Using Relevance Feedback,” Proc. Ninth Ann. ACM Int'l Conf. Multimedia (Multimedia '01), 2001.
[37] D.L. Swets and J. Weng, “Using Discriminant Eigenfeatures for Image Retrieval,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 8, pp. 831-836, Aug. 1996.
[38] J. Tenenbaum, V. de Silva, and J. Langford, “A Global Geometric Framework for Nonlinear Dimensionality Reduction,” Science, vol. 290, no. 500, pp. 2319-2323, 2000.
[39] K. Tieu and P. Viola, “Boosting Image Retrieval,” Proc. Eighth Ann. ACM Int'l Conf. Multimedia (Multimedia '00), June 2000.
[40] S. Tong and E. Chang, “Support Vector Machine Active Learning for Image Retrieval,” Proc. Ninth Ann. ACM Int'l Conf. Multimedia (Multimedia '01), pp. 107-118, 2001.
[41] V.N. Vapnik, Statistical Learning Theory. John Wiley & Sons, 1998.
[42] G. Wu, E.Y. Chang, and N. Panda, “Formulating Context-Dependent Similarity Functions,” Proc. 13th Ann. ACM Int'l Conf. Multimedia (Multimedia '05), Nov. 2005.
[43] H. Yu, M. Li, H.-J. Zhang, and J. Feng, “Color Texture Moments for Content-Based Image Retrieval,” Proc. IEEE Int'l Conf. Image Processing (ICIP '02), pp. 24-28, 2002.
[44] Z. Zhang and H. Zha, “Principal Manifolds and Nonlinear Dimension Reduction via Local Tangent Space Alignment,” SIAM J. Scientific Computing, vol. 26, no. 1, 2004.
18 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool