The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.05 - September/October (2010 vol.30)
pp: 52-60
Nancy A. Chinchor , ChinchorEclectic
James J. Thomas , Pacific Northwest National Laboratory
Pak Chung Wong , Pacific Northwest National Laboratory
Michael G. Christel , Carnegie Mellon University
William Ribarsky , University of North Carolina at Charlotte
ABSTRACT
To deal with the extent and variety of digital media, researchers are combining multimedia analysis and visual analytics to form the new field of multimedia analytics. This article gives some historical background, discusses surveys of related research, describes initial multimedia analytics research, and reports on benchmark datasets.
INDEX TERMS
multimedia analysis, visual analytics, multimedia analytics, information retrieval, Informedia, NIST TRECVID, image processing, visualization, computer graphics, graphics and multimedia
CITATION
Nancy A. Chinchor, James J. Thomas, Pak Chung Wong, Michael G. Christel, William Ribarsky, "Multimedia Analysis + Visual Analytics = Multimedia Analytics", IEEE Computer Graphics and Applications, vol.30, no. 5, pp. 52-60, September/October 2010, doi:10.1109/MCG.2010.92
REFERENCES
1. ACM Siggraph Computer Graphics (special issue on visualization in scientific computing), vol. 21, no. 8, 1987.
2. Proc. IEEE 1995 Symp. Information Visualization (IV 95), IEEE CS Press, 1995.
3. J.A. Wise et al., "Visualizing the Nonvisual: Spatial Analysis and Interaction with Information from Text Documents," Proc. 1995 IEEE Symp. Information Visualization (IV 95), IEEE CS Press, 1995, pp. 51–58.
4. E. Hetzler and A. Turner, "Analysis Experiences Using Information Visualization," IEEE Computer Graphics and Applications, vol. 24, no. 5, 2004, pp. 22–26.
5. J.J. Thomas and K.A. Cook eds., , Illuminating the Path: The Research and Development Agenda for Visual Analytics, IEEE CS Press, 2005.
6. P. Aigrain, H. Zhang, and D. Petkovic, "Content-Based Representation and Retrieval of Visual Media: A State-of-the-Art Review," Multimedia Tools and Applications, vol. 3, no. 3, 1996, pp. 179–202.
7. Y. Rui, T.S. Huang, and S.-F. Chang, "Image Retrieval: Current Techniques, Promising Directions, and Open Issues," J. Visual Communication and Image Representation, vol. 10, no. 1, 1999, pp. 39–62.
8. A. Smeulders et al., "Content-Based Image Retrieval at the End of the Early Years," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 12, 2000, pp. 1349–1380.
9. C.G.M. Snoek et al., "MediaMill: Exploring News Video Archives Based on Learned Semantics," Proc. 13th ACM Int'l Conf. Multimedia (MM 05), ACM Press, 2005, pp. 225–226.
10. M.S. Lew et al., "Content-Based Multimedia Information Retrieval: State of the Art and Challenges," ACM Trans. Multimedia Computing, Communications, and Applications, vol. 2, no. 1, 2006, pp. 1–19.
11. R. Datta et al., "Image Retrieval: Ideas, Influences, and Trends of the New Age," ACM Computing Surveys, vol. 40, no. 2, 2008, article 5.
12. R. Lienhart, "Reliable Transition Detection in Videos: A Survey and Practitioner's Guide," Int'l J. Image and Graphics, vol. 1, no. 3, 2001, pp. 469–486.
13. M.-H. Yang, D.J. Kriegman, and N. Ahuja, "Detecting Faces in Images: A Survey," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 1, 2002, pp. 34–58.
14. J. Tangelder and R.C. Veltkamp, "A Survey of Content Based 3D Shape Retrieval Methods," Proc. Int'l Conf. Shape Modeling and Applications, IEEE Press, 2004, pp. 157–166.
15. C.G.M. Snoek and A.W.M. Smeulders, "Visual-Concept Search Solved?" Computer, vol. 43, no. 6, 2010, pp. 76–78.
16. K. Grauman, "Efficiently Searching for Similar Images," Comm. ACM, vol. 53, no. 6, 2010; pp. 84–94; http://portal.acm.orgcitation.cfm?id=1743546.1743570 .
17. J. Kielman, J. Thomas, and R. May, "Foundations and Frontiers in Visual Analytics," J. Information Visualization, vol. 8, no. 4, 2009, pp. 239–246.
18. M.G. Christel, Automated Metadata in Multimedia Information Systems: Creation, Refinement, Use in Surrogates, and Evaluation, Morgan and Claypool, 2009; doi: 10.2200/S00167ED1V01Y200812ICR002.
19. M. Chen et al., "Exploiting Multi-level Parallelism for Low-Latency Activity Recognition in Streaming Video," Proc. 1st Ann. ACM SIGMM Conf. Multimedia Systems (MMSys 10), ACM Press, 2010, pp. 1–12; http://doi.acm.org/10.11451730836.1730838 .
20. N. Chinchor and W. Pike, "The Science of Analytic Reporting," J. Information Visualization, vol. 8, no. 4, 2009, pp. 286–293.
667 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool