2006 IEEE International Conference on Multimedia and Expo Semantic Multimedia Retrieval using Lexical Query Expansion and Model-Based Reranking Toronto, ON, Canada July 09-July 12 ISBN: 1-4244-0366-7
We present methods for improving text search retrieval of visual multimedia content by applying a set of visual models of semantic concepts from a lexicon of concepts deemed relevant for the collection. Text search is performed via queries of words or fully qualified sentences, and results are returned in the form of ranked video clips. Our approach involves a query expansion stage, in which query terms are compared to the visual concepts for which we independently build classifier models. We leverage a synonym dictionary and WordNet similarities during expansion. Results over each query are aggregated across the expanded terms and ranked. We validate our approach on the TRECVID 2005 broadcast news data with 39 concepts specifically designed for this genre of video. We observe that concept models improve search results by nearly 50% after model-based re-ranking of text-only search. We also observe that purely model-based retrieval significantly outperforms text-based retrieval on non-named entity queries.
Citation:
Alexander Haubold, Apostol Natsev, Milind Naphade, "Semantic Multimedia Retrieval using Lexical Query Expansion and Model-Based Reranking," icme, pp.1761-1764, 2006 IEEE International Conference on Multimedia and Expo, 2006 Usage of this product signifies your acceptance of the Terms of Use. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||