This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
VideOlympics: Real-Time Evaluation of Multimedia Retrieval Systems
January-March 2008 (vol. 15 no. 1)
pp. 86-91
Cees G.M. Snoek, University of Amsterdam
Marcel Worring, University of Amsterdam
Ork de Rooij, University of Amsterdam
Koen E.A. van de Sande, University of Amsterdam
Rong Yan, IBM T.J. Watson Research Center
Alexander G. Hauptmann, Carnegie Mellon University
Video search is an experience for the senses. As a result, traditional information retrieval metrics can't fully measure the quality of a video search system. To provide a more interactive assessment of today's video search engines, the authors have organized the VideOlympics as a real-time evaluation showcase where systems compete to answer specific video searches in front of a live audience. At VideOlympics, seeing and hearing is believing.

1. A. Smeaton, P. Over, and W. Kraaij, "Evaluation Campaigns and Trecvid," Proc. ACM Int'l Workshop Multimedia Information Retrieval, ACM Press, 2006, pp. 321-330.
1. E.M. Voorhees and D.K. Harman, TREC: Experiment and Evaluation in Information Retrieval, The MIT Press, 2005.
0. E.M. Voorhees and D.K. Harman, TREC: Experiment and Evaluation in Information Retrieval, The MIT Press, 2005.
2. A. Smeaton, P. Over, and W. Kraaij, "Evaluation Campaigns and Trecvid," Proc. ACM Int'l Workshop Multimedia Information Retrieval, ACM Press, 2006, pp. 321-330.
0. A. Smeaton, P. Over, and W. Kraaij, "Evaluation Campaigns and Trecvid," Proc. ACM Int'l Workshop Multimedia Information Retrieval, ACM Press, 2006, pp. 321-330.
3. A. Hauptmann and M. Christel, "Successful Approaches in the TREC Video Retrieval Evaluations," Proc. ACM Multimedia, ACM Press, 2004, pp. 668-675.
0. A. Hauptmann and M. Christel, "Successful Approaches in the TREC Video Retrieval Evaluations," Proc. ACM Multimedia, ACM Press, 2004, pp. 668-675.
4. C.G.M. Snoek et al., "A Learned Lexicon-Driven Paradigm for Interactive Video Retrieval," IEEE Trans. Multimedia, vol. 9, no. 2, 2007, pp. 280-292.
0. C.G.M. Snoek et al., "A Learned Lexicon-Driven Paradigm for Interactive Video Retrieval," IEEE Trans. Multimedia, vol. 9, no. 2, 2007, pp. 280-292.
5. T.-S Chua, "Towards the Next Plateau-Innovative Multimedia Research Beyond Trecvid," Proc. ACM Multimedia, ACM Press, 2007, p. 1054.
0. T.-S Chua, "Towards the Next Plateau-Innovative Multimedia Research Beyond Trecvid," Proc. ACM Multimedia, ACM Press, 2007, p. 1054.

Index Terms:
video search, multimedia retrieval systems, VideOlympics
Citation:
Cees G.M. Snoek, Marcel Worring, Ork de Rooij, Koen E.A. van de Sande, Rong Yan, Alexander G. Hauptmann, "VideOlympics: Real-Time Evaluation of Multimedia Retrieval Systems," IEEE Multimedia, vol. 15, no. 1, pp. 86-91, Jan.-March 2008, doi:10.1109/MMUL.2008.21
Usage of this product signifies your acceptance of the Terms of Use.