This Article 
 Bibliographic References 
 Add to: 
April-June 2011 (vol. 18 no. 2)
pp. 2-3
John R. Smith, IBM Research

Evaluations, benchmarks, and challenges are essential for scientific advancement of multimedia. A great challenge is still needed to capture imagination of the broader community and mark our progress in the multimedia field.

1. P. Over et al., "Multimedia Retrieval Benchmarks," IEEE MultiMedia, vol. 11, No. 2, 2004.
2. M. Naphade et al., "Large-Scale Concept Ontology for Multimedia," IEEE MultiMedia, vol. 13, no. 3, 2006, pp. 86-91.
3. C.G.M. Snoek et al., "VideOlympics: Real-Time Evaluation of Multimedia Retrieval Systems," IEEE MultiMedia, vol. 15, no. 1, 2008, pp. 86-91.
4. C.G.M. Snoek and M. Slaney, "Academia Meets Industry at the Multimedia Grand Challenge," IEEE MultiMedia, vol. 18, no. 1, 2011.
5. J.R. Smith, "The Not So Newlywed Game," IEEE MultiMedia, vol. 17, no. 3, 2010.

Index Terms:
multimedia, content-based retrieval, benchmarks, evaluation, multimedia, EIC's message, IEEE MultiMedia
John R. Smith, "A Great Challenge," IEEE Multimedia, vol. 18, no. 2, pp. 2-3, April-June 2011, doi:10.1109/MMUL.2011.24
Usage of this product signifies your acceptance of the Terms of Use.