Building Reliable and Reusable Test Collections for Image Retrieval: The Wikipedia Task at ImageCLEF
Issue No. 03 - July-Sept. (2012 vol. 19)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/MMUL.2012.17
Theodora Tsikrika , University of Applied Sciences Western Switzerland
Jana Kludas , University of Geneva, Switzerland
Adrian Popescu , CEA, LIST, France
The ImageCLEF Wikipedia image retrieval task aimed to support ad-hoc image retrieval evaluation using large-scale collections of Wikipedia images and their user-generated annotations.
User-generated content, Internet, Electronic publishing, Image retrieval, Error analysis, Multimedia communication, Wikipedia, Performance evaluation, Large scale systems, Collaboration, incomplete judgments, multimedia, image retrieval evaluation, test collections, topic development, ground truth creation, benchmarks, ImageCLEF, ranking stability, measurement error
J. Kludas, T. Tsikrika and A. Popescu, "Building Reliable and Reusable Test Collections for Image Retrieval: The Wikipedia Task at ImageCLEF," in IEEE MultiMedia, vol. 19, no. , pp. 24-33, 2012.