This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
iLike: Bridging the Semantic Gap in Vertical Image Search by Integrating Text and Visual Features
Oct. 2013 (vol. 25 no. 10)
pp. 2257-2270
Yuxin Chen, ETH Zurich, Zurich
Hariprasad Sampathkumar, The University of Kansas, Lawrence
Bo Luo, The University of Kansas, Lawrence
Xue-wen Chen, Wayne State University, Detroit
With the development of Internet and Web 2.0, large-volume multimedia contents have been made available online. It is highly desired to provide easy accessibility to such contents, i.e., efficient and precise retrieval of images that satisfies users' needs. Toward this goal, content-based image retrieval (CBIR) has been intensively studied in the research community, while text-based search is better adopted in the industry. Both approaches have inherent disadvantages and limitations. Therefore, unlike the great success of text search, web image search engines are still premature. In this paper, we present iLike, a vertical image search engine that integrates both textual and visual features to improve retrieval performance. We bridge the semantic gap by capturing the meaning of each text term in the visual feature space, and reweight visual features according to their significance to the query terms. We also bridge the user intention gap because we are able to infer the "visual meanings" behind the textual queries. Last but not least, we provide a visual thesaurus, which is generated from the statistical similarity between the visual space representation of textual terms. Experimental results show that our approach improves both precision and recall, compared with content-based or text-based image retrieval techniques. More importantly, search results from iLike is more consistent with users' perception of the query terms.
Index Terms:
Visualization,Feature extraction,Semantics,Image retrieval,Tagging,Image color analysis,Search engines,specialized search,Visualization,Feature extraction,Semantics,Image retrieval,Tagging,Image color analysis,Search engines,vertical search engine,CBIR
Citation:
Yuxin Chen, Hariprasad Sampathkumar, Bo Luo, Xue-wen Chen, "iLike: Bridging the Semantic Gap in Vertical Image Search by Integrating Text and Visual Features," IEEE Transactions on Knowledge and Data Engineering, vol. 25, no. 10, pp. 2257-2270, Oct. 2013, doi:10.1109/TKDE.2012.192
Usage of this product signifies your acceptance of the Terms of Use.