Subscribe

Issue No.02 - February (2008 vol.20)

pp: 189-201

ABSTRACT

One of the fundamental problems in Content-Based Image Retrieval (CBIR) has been the gap been low level visual features and high level semantic concepts. To narrow down this gap, relevance feedback is introduced into image retrieval. With the user provided information, a classifier can be learned to discriminate between positive and negative examples. However, in real world applications, the number of user feedbacks is usually too small comparing to the dimensionality of the image space. Thus, a situation of overfitting may occur. In order to cope with the high dimensionality, we propose a novel supervised method for dimensionality reduction called Maximum Margin Projection (MMP). MMP aims to maximize the margin between positive and negative examples at each local neighborhood. Different from traditional dimensionality reduction algorithms such as Principal Component Analysis (PCA) and Linear Discriminant Analysis (LDA) which effectively see only the global Euclidean structure, MMP is designed for discovering the local manifold structure. Therefore, MMP is likely to be more suitable for image retrieval where nearest neighbor search is usually involved. After projecting the images into a lower dimensional subspace, the relevant images get closer to the query image, thus the retrieval performance can be enhanced. The experimental results on a large image database demonstrates the effectiveness and efficiency of our proposed algorithm.

INDEX TERMS

Image databases, Image/video retrieval, Information Search and Retrieval

CITATION

Xiaofei He, Deng Cai, Jiawei Han, "Learning a Maximum Margin Subspace for Image Retrieval",

*IEEE Transactions on Knowledge & Data Engineering*, vol.20, no. 2, pp. 189-201, February 2008, doi:10.1109/TKDE.2007.190692REFERENCES

- [1] M. Belkin and P. Niyogi, “Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering,”
Advances in Neural Information Processing Systems 14, pp. 585-591, MIT Press, 2001.- [2] M. Belkin, P. Niyogi, and V. Sindhwani, “Manifold Regularization: A Geometric Framework for Learning from Examples,”
J.Machine Learning Research, 2006.- [3] Y. Bengio, J.-F. Paiement, P. Vincent, O. Delalleau, N.L. Roux, and M. Ouimet, “Out-of-Sample Extensions for LLE, Isomap, MDS, Eigenmaps, and Spectral Clustering,”
Advances in Neural Information Processing Systems 16, 2003.- [4] J. Bi, Y. Chen, and J.Z. Wang, “A Sparse Support Vector Machine Approach to Region-Based Image Categorization,”
Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR '04), 2004.- [5] D. Cai, X. He, K. Zhou, J. Han, and H. Bao, “Locality Sensitive Discriminant Analysis,”
Proc. 20th Int'l Joint Conf. Artificial Intelligence (IJCAI '07), Jan. 2007.- [6] C.-C. Chang and C.-J. Lin,
LIBSVM: A Library for Support Vector Machines, http://www.csie.ntu.edu.tw/~cjlinlibsvm, 2001.- [8] H.-T. Chen, H.-W. Chang, and T.-L. Liu, “Local Discriminant Embedding and Its Variants,”
Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition (CVPR '05), 2005.- [10] F.R.K. Chung, “Spectral Graph Theory,”
Proc. CBMS Regional Conf. Series in Math., vol. 92, 1997.- [11] T.H. Cormen, C.E. Leiserson, R.L. Rivest, and C. Stein,
Introduction to Algorithms, second ed. MIT Press, 2001.- [13] N. Cristianini, J. Shawe-Taylor, A. Elisseeff, and J. Kandola, “On Kernel-Target Alignment,”
Advances in Neural Information Processing Systems 14, 2001.- [14] R.O. Duda, P.E. Hart, and D.G. Stork,
Pattern Classification, second ed. Wiley-Interscience, 2000.- [15] K.-S. Goh, E.Y. Chang, and W.-C. Lai, “Multimodal Concept-Dependent Active Learning for Image Retrieval,”
Proc. 12th Ann. ACM Int'l Conf. Multimedia (Multimedia '04), Oct. 2004.- [16] A. Grama, G. Karypis, V. Kumar, and A. Gupta,
An Introduction to Parallel Computing: Design and Analysis of Algorithms, second ed. Addison Wesley, 2003.- [17] T. Hastie, R. Tibshirani, and J. Friedman,
The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer-Verlag, 2001.- [18] J. He, M. Li, H.-J. Zhang, H. Tong, and C. Zhang, “Manifold-Ranking-Based Image Retrieval,”
Proc. 12th Ann. ACM Int'l Conf. Multimedia (Multimedia '04), Oct. 2004.- [19] X. He, “Incremental Semi-Supervised Subspace Learning for Image Retrieval,”
Proc. 12th Ann. ACM Int'l Conf. Multimedia (Multimedia '04), Oct. 2004.- [20] X. He, D. Cai, and W. Min, “Statistical and Computational Analysis of LPP,”
Proc. 22nd Int'l Conf. Machine Learning (ICML '05), 2005.- [21] X. He, D. Cai, S. Yan, and H.-J. Zhang, “Neighborhood Preserving Embedding,”
Proc. 11th Int'l Conf. Computer Vision (ICCV '05), 2005.- [22] X. He and P. Niyogi, “Locality Preserving Projections,”
Advances in Neural Information Processing Systems 16, MIT Press, 2003.- [25] S.C.H. Hoi, M.R. Lyu, and E.Y. Chang, “Learning the Unified Kernel Machines for Classification,”
Proc. 12th ACM SIGKDD Int'l Conf. KNowledge Discovery and Data Mining, pp. 187-196, 2006.- [27] Y.-Y. Lin, T.-L. Liu, and H.-T. Chen, “Semantic Manifold Learning for Image Retrieval,”
Proc. 13th Ann. ACM Int'l Conf. Multimedia (Multimedia '05), Nov. 2005.- [29] A.Y. Ng, M. Jordan, and Y. Weiss, “On Spectral Clustering: Analysis and an Algorithm,”
Advances in Neural Information Processing Systems 14, pp. 849-856, MIT Press, 2001.- [33] V. Sindhwani, P. Niyogi, and M. Belkin, “Beyond the Point Cloud: From Transductive to Semi-Supervised Learning,”
Proc. 22nd Int'l Conf. Machine Learning (ICML '05), 2005.- [35] J. Smith and S.-F. Chang, “Visualseek: A Fully Automated Content-Based Image Query System,”
Proc. Fourth Ann. ACM Int'l Conf. Multimedia (Multimedia '96), 1996.- [36] Z. Su, S. Li, and H.-J. Zhang, “Extraction of Feature Subspace for Content-Based Retrieval Using Relevance Feedback,”
Proc. Ninth Ann. ACM Int'l Conf. Multimedia (Multimedia '01), 2001.- [39] K. Tieu and P. Viola, “Boosting Image Retrieval,”
Proc. Eighth Ann. ACM Int'l Conf. Multimedia (Multimedia '00), June 2000.- [40] S. Tong and E. Chang, “Support Vector Machine Active Learning for Image Retrieval,”
Proc. Ninth Ann. ACM Int'l Conf. Multimedia (Multimedia '01), pp. 107-118, 2001.- [41] V.N. Vapnik,
Statistical Learning Theory. John Wiley & Sons, 1998.- [42] G. Wu, E.Y. Chang, and N. Panda, “Formulating Context-Dependent Similarity Functions,”
Proc. 13th Ann. ACM Int'l Conf. Multimedia (Multimedia '05), Nov. 2005.- [43] H. Yu, M. Li, H.-J. Zhang, and J. Feng, “Color Texture Moments for Content-Based Image Retrieval,”
Proc. IEEE Int'l Conf. Image Processing (ICIP '02), pp. 24-28, 2002.- [44] Z. Zhang and H. Zha, “Principal Manifolds and Nonlinear Dimension Reduction via Local Tangent Space Alignment,”
SIAM J. Scientific Computing, vol. 26, no. 1, 2004. |