loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
2006 IEEE International Conference on Multimedia and Expo
Semantic Multimedia Retrieval using Lexical Query Expansion and Model-Based Reranking
Toronto, ON, Canada
July 09-July 12
ISBN: 1-4244-0366-7
Alexander Haubold, Department of Computer Science, Columbia University, New York, NY 10027. ahaubold@cs.columbia.edu
Apostol Natsev, IBM Thomas J. Watson Research Center, Hawthorne, NY 10532. natsev@us.ibm.com
Milind Naphade, IBM Thomas J. Watson Research Center, Hawthorne, NY 10532. naphade@us.ibm.com
We present methods for improving text search retrieval of visual multimedia content by applying a set of visual models of semantic concepts from a lexicon of concepts deemed relevant for the collection. Text search is performed via queries of words or fully qualified sentences, and results are returned in the form of ranked video clips. Our approach involves a query expansion stage, in which query terms are compared to the visual concepts for which we independently build classifier models. We leverage a synonym dictionary and WordNet similarities during expansion. Results over each query are aggregated across the expanded terms and ranked. We validate our approach on the TRECVID 2005 broadcast news data with 39 concepts specifically designed for this genre of video. We observe that concept models improve search results by nearly 50% after model-based re-ranking of text-only search. We also observe that purely model-based retrieval significantly outperforms text-based retrieval on non-named entity queries.
Citation:
Alexander Haubold, Apostol Natsev, Milind Naphade, "Semantic Multimedia Retrieval using Lexical Query Expansion and Model-Based Reranking," icme, pp.1761-1764, 2006 IEEE International Conference on Multimedia and Expo, 2006
Usage of this product signifies your acceptance of the Terms of Use.