Issue No. 06 - June (2009 vol. 31)
Marin Ferecatu , Institut Telecom, Telecom Paristech, Paris
Donald Geman , The Johns Hopkins University, Baltimore
Traditional image retrieval techniques usually require a first image to start a query. However, for large unstructured databases, it is not clear how to choose this query (the "page zero" problem). We propose a new statistical framework based on relevance feedback to locate an instance of a semantic category in an unstructured image database with no semantic annotation. A search session is initiated from a random sample of images. At each retrieval round the user is asked to select one image from among a set of displayed images - the one that is closest in his opinion to the target class. The matching is then "mental". Performance is measured by the number of iterations necessary to display an image which satisfies the user, at which point standard techniques can be employed to display other instances. Our core contribution is a Bayesian formulation which scales to large databases. The two key components are a response model which accounts for the user's subjective perception of similarity and a display algorithm which seeks to maximize the flow of information. Experiments with real users and two databases of 20,000 and 60,000 images demonstrate the efficiency of the search process.
Relevance Feedback, Image Retrieval, Page Zero Problem, Bayesian System, Statistical Learning, Mental Matching
Marin Ferecatu, Donald Geman, "A Statistical Framework for Image Category Search from a Mental Picture", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 31, no. , pp. 1087-1101, June 2009, doi:10.1109/TPAMI.2008.259