| | This Article | |
| |
| |
| | Share | |
| |
| |
| | Bibliographic References | |
| |
| |
| | Add to: | |
| |
 Digg
 Furl
 Spurl
 Blink
 Simpy
 Google
 Del.icio.us
 Y!MyWeb
| |
| | Search | |
| |
| |
| | |
Visual Signatures in Video Visualization
September-October 2006 (vol. 12 no. 5)
pp. 1093-1100
Video visualization is a computation process that extracts meaningful information from original video data sets and conveys the extracted information to users in appropriate visual representations. This paper presents a broad treatment of the subject, following a typical research pipeline involving concept formulation, system development, a path-finding user study, and a field trial with real application data. In particular, we have conducted a fundamental study on the visualization of motion events in videos. We have, for the first time, deployed flow visualization techniques in video visualization. We have compared the effectiveness of different abstract visual representations of videos. We have conducted a user study to examine whether users are able to learn to recognize visual signatures of motions, and to assist in the evaluation of different visualization techniques. We have applied our understanding and the developed techniques to a set of application video clips. Our study has demonstrated that video visualization is both technically feasible and cost-effective. It has provided the first set of evidence confirming that ordinary users can be accustomed to the visual features depicted in video visualizations, and can learn to recognize visual signatures of a variety of motion events.
[1] 1093 E. P. Bennett and L. McMillan, Proscenium: a framework for spatiotemporal video editing. In Proc. ACM Multimedia, pages 177–184, Berkeley, CA, 2003.[2] R. P. Botchen, M. Chen, D. Weiskopf, and T. Ertl, GPU-assisted multifield video volume visualization. In Proc. International Workshop on Volume Graphics, pages 47–54, 135, 2006.[3] P. Cavanagh, A. Labianca, and I. M. Thornton, Attention-based visual routines: Sprites. Cognition, 80: 47–60, 2001.[4] R. Chellappa, Special section on video surveillance (editorial preface). IEEE Transactions on Pattern Analysis and Machine Intelligence, 22 (8): 745–746, 2000.[5] R. Cutler, C. Shekhar, B. Burns, R. Chellappa, R. Bolles, and L. Davis, Monitoring human and vehicle activities using airborne video. In Proc. 28th Applied Imagery Pattern Recognition Workshop (AIPR), Washington, DC, 1999.[6] G. W. Daniel and M. Chen, Video visualization. In Proc. IEEE Visualization, pages 409–416, 2003.[7] D. Dovey, Vector plots for irregular grids. In Proc. IEEE Visualization, pages 248–253, 1995.[8] T. E. E. Durucan, Improved linear dependence and vector model for illumination invariant change detection. In Proc. SPIE, volume 4303, San Jose, CA, 2001.[9] S. Fels, E. Lee, and K. Mase, Techniques for interactive video cubism. In Proc. 8th ACM International Conference on Multimedia (Posters), pages 368–370, 2000.[10] R. B. Fisher, The PETS04 surveillance ground-truth data sets. In Proc. 6th IEEE International Workshop on Performance Evaluation of Tracking and Surveillance, pages 1–5, 2004.[11] S. Guthe, S. Gumhold, and W. Straßer, Interactive visualization of volumetric vector fields using texture based particles. In Proc. WSCG Conference Proceedings, pages 33–41, 2002.[12] A. Hertzmann and K. Perlin, Painterly rendering for video and interaction. In Proc. 1st International Symposium on Non-Photorealistic Animation and Rendering, pages 7–12, June 2000.[13] V. Interrante and C. Grosch, Visualizing 3D flow. IEEE Computer Graphics and Applications, 18 (4): 49–53, 1998.[14] R. V. Klassen and S. J. Harrington, Shadowed hedgehogs: A technique for visualizing 2D slices of 3D vector fields. In Proc. IEEE Visualization, pages 148–153, 1991.[15] A. W. Klein, P. J. Sloan, R. A. Colburn, A. Finkelstein, and M. F. Cohen, Video cubism. Technical Report MSR-TR-2001-45, Microsoft Research, October 2001.[16] R. S. Laramee, H. Hauser, H. Doleisch, B. Vrolijk, F. H. Post, and D. Weiskopf, The state of the art in flow visualization: Dense and texture-based techniques. Computer Graphics Forum, 23 (2): 143–161, 2004.[17] A. Mack and I. Rock, Inattentional Blindness, MIT Press, Cambridge MA, 1998.[18] N. V. Patel and I. K. Sethi, Video shot detection and characterization for video databases. Pattern Recognition, Special Issue on Multimedia, 30 (4): 583–592, 1997.[19] M. I. Posner, C. R. R. Snyder, and B. J. Davidson, Attention and the detection of signals. Journal of Experimental Psychology: General, 109: 160–174, 1980.[20] F. H. Post, B. Vrolijk, H. Hauser, R. S. Laramee, and H. Doleisch, The state of the art in flow visualization: Feature extraction and tracking. Computer Graphics Forum, 22 (4): 775–792, 2003.[21] Z. W. Pylyshyn and R. W. Storm, Tracking multiple independent targets: Evidence for a parallel tracking mechanism. Spatial Vision, 3: 179–197, 1988.[22] J. E. Raymond, K. L. Shapiro, and et al. Temporary suppression of visual processing in an RSVP task: An attentional blink. Journal of Experimental Psychology, HPP, 18 (3): 849–860, 1992.[23] D. J. Simons and R. A. Rensink, Change blindness: past, present, and future. Trends in Cognitive Sciences, 9 (1): 16–20, 2005.[24] C. G. M. Snock and M. Worring, Multimodal video indexing: a review of the state-of-the-art. Multimedia Tools and Applications, 2003.[25] J. J. Thomas and K. A. Cook, editors. Illuminating the Path: The Research and Development Agenda for Visual Analytics, IEEE Press, 2005.[26] D. Weiskopf and G. Erlebacher, Overview of flow visualization. In C. D. Hansen and C. R. Johnson, editors, The Visualization Handbook, pages 261–278. Elsevier, Amsterdam, 2005.
Index Terms:
Video visualization, volume visualization, flow visualization, human factors, user study, visual signatures, video processing, optical flow, GPU rendering.
Citation:
Min Chen, Ralf Botchen, Rudy Hashim, Daniel Weiskopf, Thomas Ertl, Ian Thornton, "Visual Signatures in Video Visualization," IEEE Transactions on Visualization and Computer Graphics, vol. 12, no. 5, pp. 1093-1100, Sept. 2006, doi:10.1109/TVCG.2006.194
