This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
MediaTable: Interactive Categorization of Multimedia Collections
September/October 2010 (vol. 30 no. 5)
pp. 42-51
Ork de Rooij, University of Amsterdam
Jarke J. van Wijk, Eindhoven University of Technology
Marcel Worring, University of Amsterdam
Many multimedia collections include only metadata such as date created and file size and remain largely unannotated. So, browsing them is cumbersome. Automatic content-analysis techniques yield metadata in the form of high-level content-based descriptors. However, these techniques' accuracy is insufficient to automate collection categorization. A human is essential to validate and organize automated techniques' results. MediaTable helps users efficiently categorize an image or video collection. A tabular interface gives an overview of multimedia items and associated metadata, and a bucket list lets users quickly categorize materials. MediaTable uses familiar interface techniques for sorting, filtering, selection, and visualization. Evaluations with expert and nonexpert users indicate that MediaTable supports efficient categorization and provides valuable insight into the collection.

1. A.G. Hauptmann et al., "Extreme Video Retrieval: Joint Maximization of Human and Computer Performance," Proc. 14th Ann. ACM Int'l Conf. Multimedia, ACM Press, 2006, pp. 385–394.
2. M.G. Christel and R. Yan, "Merging Storyboard Strategies and Automatic Retrieval for Improving Interactive Video Search," Proc. 6th ACM Int'l Conf. Image and Video Retrieval, ACM Press, 2007, pp. 486–493.
3. E. Zavesky, S.-F. Chang, and C.-C. Yang, "Visual Islands: Intuitive Browsing of Visual Search Results," Proc. 2008 Int'l Conf. Content-Based Image and Video Retrieval (CIVR 08), ACM Press, 2008, pp. 617–626.
4. J. Yang et al., "Semantic Image Browser: Bridging Information Visualization with Automated Intelligent Image Analysis," Proc. 2006 IEEE Symp. Visual Analytics Science and Technology (VAST 06), IEEE Press, 2006, pp. 191–198.
5. R. Yan, A. Natsev, and M. Campbell, "An Efficient Manual Image Annotation Approach Based on Tagging and Browsing," Proc. Workshop Multimedia Information Retrieval on the Many Faces of Multimedia Semantics (MS 07), ACM Press, 2007, pp. 13–20.
6. B.B. Bederson, "PhotoMesa: A Zoomable Image Browser Using Quantum Treemaps and Bubblemaps," Proc. 14th Ann. ACM Symp. User Interface Software and Technology (UIST 08), ACM Press, 2001, pp. 71–80.
7. J. Bertin, Semiology of Graphics, Univ. of Wisconsin Press, 1983.
8. S. Kandel et al., "PhotoSpread: A Spreadsheet for Managing Photos," Proc. SIGCHI Conf. Human Factors in Computing Systems (CHI 08), ACM Press, 2007, pp. 1749–1758.
9. R. Rao and S.K. Card, "The Table Lens: Merging Graphical and Symbolic Representations in an Interactive Focus + Context Visualization for Tabular Information," Proc. SIGCHI Conf. Human Factors in Computing Systems (CHI 94), ACM Press, 1994, pp. 318–322.
10. M. Spenke, C. Beilken, and T. Berlage, "Focus: The Interactive Table for Product Comparison and Selection," Proc. 9th Ann. Symp. User Interface Software and Technology (UIST 96), ACM Press, 1996, pp. 41–50.
11. R. Rao and S.K. Card, "The Table Lens: Merging Graphical and Symbolic Representations in an Interactive Focus + Context Visualization for Tabular Information," Proc. SIGCHI Conf. Human Factors in Computing Systems (CHI 94), ACM Press, 1994, pp. 318–322.
12. J. Yang et al., "Semantic Image Browser: Bridging Information Visualization with Automated Intelligent Image Analysis," Proc. 2006 IEEE Symp. Visual Analytics Science and Technology (VAST 06), IEEE Press, 2006, pp. 191–198.
13. C.G.M. Snoek et al., "VideOlympics: Real-Time Evaluation of Multimedia Retrieval Systems," IEEE MultiMedia, vol. 15, no. 1, 2008, pp. 86–91.
1. R. Datta et al., "Image Retrieval: Ideas, Influences, and Trends of the New Age," ACM Computing Surveys, vol. 40, no. 2, 2008, pp. 1–60.
2. A.W.M. Smeulders et al., "Content-Based Image Retrieval at the End of the Early Years," IEEE Trans. Pattern Analysis and Machine Intelligence, Dec. 2000, pp. 1349–1380.
3. C.G.M. Snoek and M. Worring, "Concept-Based Video Retrieval," Foundations and Trends in Information Retrieval, vol. 4, no. 2, 2009, pp. 215–322.

Index Terms:
interactive multimedia retrieval, image and video search systems, multimedia collection categorization, table-based browsing, computer graphics, graphics and multimedia
Citation:
Ork de Rooij, Jarke J. van Wijk, Marcel Worring, "MediaTable: Interactive Categorization of Multimedia Collections," IEEE Computer Graphics and Applications, vol. 30, no. 5, pp. 42-51, Sept.-Oct. 2010, doi:10.1109/MCG.2010.66
Usage of this product signifies your acceptance of the Terms of Use.