Issue No. 03 - March (2013 vol. 35)
Rong Jin , Dept. of Comput. Sci. & Eng., Michigan State Univ., East Lansing, MI, USA
A. K. Jain , Dept. of Comput. Sci. & Eng., Michigan State Univ., East Lansing, MI, USA
Lei Wu , Dept. of Comput. Sci., Univ. of Pittsburgh, Pittsburgh, PA, USA
Many social image search engines are based on keyword/tag matching. This is because tag-based image retrieval (TBIR) is not only efficient but also effective. The performance of TBIR is highly dependent on the availability and quality of manual tags. Recent studies have shown that manual tags are often unreliable and inconsistent. In addition, since many users tend to choose general and ambiguous tags in order to minimize their efforts in choosing appropriate words, tags that are specific to the visual content of images tend to be missing or noisy, leading to a limited performance of TBIR. To address this challenge, we study the problem of tag completion, where the goal is to automatically fill in the missing tags as well as correct noisy tags for given images. We represent the image-tag relation by a tag matrix, and search for the optimal tag matrix consistent with both the observed tags and the visual similarity. We propose a new algorithm for solving this optimization problem. Extensive empirical studies show that the proposed algorithm is significantly more effective than the state-of-the-art algorithms. Our studies also verify that the proposed algorithm is computationally efficient and scales well to large databases.
Visualization, Optimization, Image retrieval, Noise measurement, Vectors, Feature extraction, Correlation, metric learning, Tag completion, matrix completion, tag-based image retrieval, image annotation, image retrieval
Rong Jin, A. K. Jain, Lei Wu, "Tag Completion for Image Retrieval", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 35, no. , pp. 716-727, March 2013, doi:10.1109/TPAMI.2012.124