Issue No. 10 - Oct. (2013 vol. 25)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TKDE.2012.192
Yuxin Chen , ETH Zurich, Zurich
Hariprasad Sampathkumar , The University of Kansas, Lawrence
Bo Luo , The University of Kansas, Lawrence
Xue-wen Chen , Wayne State University, Detroit
With the development of Internet and Web 2.0, large-volume multimedia contents have been made available online. It is highly desired to provide easy accessibility to such contents, i.e., efficient and precise retrieval of images that satisfies users' needs. Toward this goal, content-based image retrieval (CBIR) has been intensively studied in the research community, while text-based search is better adopted in the industry. Both approaches have inherent disadvantages and limitations. Therefore, unlike the great success of text search, web image search engines are still premature. In this paper, we present iLike, a vertical image search engine that integrates both textual and visual features to improve retrieval performance. We bridge the semantic gap by capturing the meaning of each text term in the visual feature space, and reweight visual features according to their significance to the query terms. We also bridge the user intention gap because we are able to infer the "visual meanings" behind the textual queries. Last but not least, we provide a visual thesaurus, which is generated from the statistical similarity between the visual space representation of textual terms. Experimental results show that our approach improves both precision and recall, compared with content-based or text-based image retrieval techniques. More importantly, search results from iLike is more consistent with users' perception of the query terms.
Visualization, Feature extraction, Semantics, Image retrieval, Tagging, Image color analysis, Search engines, specialized search, Visualization, Feature extraction, Semantics, Image retrieval, Tagging, Image color analysis, Search engines, vertical search engine, CBIR
B. Luo, X. Chen, H. Sampathkumar and Y. Chen, "iLike: Bridging the Semantic Gap in Vertical Image Search by Integrating Text and Visual Features," in IEEE Transactions on Knowledge & Data Engineering, vol. 25, no. , pp. 2257-2270, 2013.