This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Tag Completion for Image Retrieval
March 2013 (vol. 35 no. 3)
pp. 716-727
Lei Wu, Dept. of Comput. Sci., Univ. of Pittsburgh, Pittsburgh, PA, USA
Rong Jin, Dept. of Comput. Sci. & Eng., Michigan State Univ., East Lansing, MI, USA
A. K. Jain, Dept. of Comput. Sci. & Eng., Michigan State Univ., East Lansing, MI, USA
Many social image search engines are based on keyword/tag matching. This is because tag-based image retrieval (TBIR) is not only efficient but also effective. The performance of TBIR is highly dependent on the availability and quality of manual tags. Recent studies have shown that manual tags are often unreliable and inconsistent. In addition, since many users tend to choose general and ambiguous tags in order to minimize their efforts in choosing appropriate words, tags that are specific to the visual content of images tend to be missing or noisy, leading to a limited performance of TBIR. To address this challenge, we study the problem of tag completion, where the goal is to automatically fill in the missing tags as well as correct noisy tags for given images. We represent the image-tag relation by a tag matrix, and search for the optimal tag matrix consistent with both the observed tags and the visual similarity. We propose a new algorithm for solving this optimization problem. Extensive empirical studies show that the proposed algorithm is significantly more effective than the state-of-the-art algorithms. Our studies also verify that the proposed algorithm is computationally efficient and scales well to large databases.
Index Terms:
Visualization,Optimization,Image retrieval,Noise measurement,Vectors,Feature extraction,Correlation,metric learning,Tag completion,matrix completion,tag-based image retrieval,image annotation,image retrieval
Citation:
Lei Wu, Rong Jin, A. K. Jain, "Tag Completion for Image Retrieval," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 3, pp. 716-727, March 2013, doi:10.1109/TPAMI.2012.124
Usage of this product signifies your acceptance of the Terms of Use.