| | This Article | |
| |
| |
| | Share | |
| |
| |
| | Bibliographic References | |
| |
| |
| | Add to: | |
| |
 Digg
 Furl
 Spurl
 Blink
 Simpy
 Google
 Del.icio.us
 Y!MyWeb
| |
| | Search | |
| |
| |
| | |
Provenance and Annotation for Visual Exploration Systems
November/December 2006 (vol. 12 no. 6)
pp. 1500-1510
Abstract—Exploring data using visualization systems has been shown to be an extremely powerful technique. However, one of the challenges with such systems is an inability to completely support the knowledge discovery process. More than simply looking at data, users will make a semipermanent record of their visualizations by printing out a hard copy. Subsequently, users will mark and annotate these static representations, either for dissemination purposes or to augment their personal memory of what was witnessed. In this paper, we present a model for recording the history of user explorations in visualization environments, augmented with the capability for users to annotate their explorations. A prototype system is used to demonstrate how this provenance information can be recalled and shared. The prototype system generates interactive visualizations of the provenance data using a spatio-temporal technique. Beyond the technical details of our model and prototype, results from a controlled experiment that explores how different history mechanisms impact problem solving in visualization environments are presented.
[1] G. Ahanger and T. Little, “A Survey of Technologies for Parsing and Indexing Digital Video,” J. Visual Comm. and Image Representation, vol. 7, no. 1, pp. 28-43, 1996.
[2] E.Z. Ayers and J.T. Stasko, “Using Graphic History in Browsing the World Wide Web,” Proc. Fourth Int'l World Wide Web Conf., pp.290-294, 1996.
[3] D. Bargeron and T. Moscovich, “Reflowing Digital Ink Annotations,” Proc. Conf. Human Factors in Computing Systems (CHI '03), pp. 385-393, 2003.
[4] T. Berladge, “A Selective Undo Mechanism for Graphical User Interfaces Based on Command Objects,” Trans. Computer Human Interaction, pp. 269-294, 1994.
[5] D. Bhagwat, L. Chiticariu, W.-C. Tan, and G. Vijayvargiya, “An Annotation Management System for Relational Databases,” Proc. Int'l Conf. Very Large Data Bases (VLDB '04), pp. 900-911, 2004.
[6] N.O. Bouvin, “Unifying Strategies for Web Augmentation,” Proc. 10th ACM Conf. Hypertext and Hypermedia: Returning to Our Diverse Roots (HYPERTEXT '99), pp. 91-100, 1999.
[7] K. Brodlie, J. Woodand, H. Wright, “Scientific Visualization— Some Novel Approaches to Learning,” SIGCSE Bull., vol. 28, no. 1, pp. 28-32, 1996.
[8] P. Buneman, S. Khanna, K. Tajima, and W.-C. Tan, “Archiving Scientific Data,” ACM Trans. Database Systems, vol. 29, no. 1, pp. 2-42, 2004.
[9] P. Buneman, S. Khanna, K. Tajima, and W.-C. Tan, “Archiving Scientific Data,” Proc. ACM SIGMOD Int'l Conf. Management of Data, pp. 1-12, June 2002.
[10] P. Buneman, S. Khanna, K. Tajima, and W.-C. Tan, “Why and Where: A Characterization of Data Provenance,” Proc. Int'l Conf. Database Theory (ICDT), pp. 316-330, 2001.
[11] V. Bush, “As We May Think,” Atlantic Monthly, vol. 76, no. 1, pp.101-108, 1945.
[12] T. Can, Y. Wang, Y.F. Wang, and J. Su, “A Distributed Protein Visualization Application,” Proc. Third Int'l Conf. Bioinformatics, 2001.
[13] S. Card and J. MacKinlay, “The Structure of the Information Visualization Design Space,” Proc. IEEE Symp. Information Visualization (InfoVis '97), pp. 92-99, 1997.
[14] Readings in Information Visualization: Using Vision to Think, S.K. Card, J.D. Mackinlay, and B. Shneiderman, eds. Morgan Kaufmann, 1999.
[15] A. Chabert, E. Grossman, L. Jackson, S. Pietrowicz, and C. Seguin, “Java Object Sharing in Habanero,” Comm. ACM, vol. 41, no. 6, pp.69-76, 1998.
[16] E. Chi, “A Taxonomy of Visualization Techniques Using the Data State Reference Model,” Proc. Symp. Information Visualization (InfoVis '00), pp. 69-75, Oct. 2000.
[17] L. Chiticariu, W.-C. Tan, and G. Vijayvargiya, “DBNotes: A Post-It System for Relational Databases Based on Provenance,” Proc. ACM SIGMOD Int'l Conf. Management of Data (SIGMOD '05),” pp.942-944, 2005.
[18] E.F. Churchill, J. Trevor, S. Bly, L. Nelson, and D. Cubranic, “Anchored Conversations: Chatting in the Context of a Document,” Proc. SIGCHI Conf. Human Factors in Computing Systems (CHI '00), pp. 454-461, 2000.
[19] S.B. Cousins, M. Baldonado, and A. Paepcke, “A Systems View of Annotations,” Technical Report P9910022, Xerox PARC, 2000.
[20] I. Denisovich, “Software Support for Annotation of Visualized Data Using Hand-Drawn Marks,” Proc. Int'l. Conf. Information Visualization, pp. 807-813, 2005.
[21] M. Derthick and S. Roth, “Data Exploration across Temporal Contexts,” Proc. Conf. Intelligent User Interfaces, pp. 60-67, 2000.
[22] A. Dix, R. Mancini, “Specifying History and Backtrack Mechanisms,” Formal Methods in Human-Computer Interaction, pp. 1-24, 1997.
[23] P. Doemel, “WebMap—A Graphical Hypertext Navigation Tool,” Proc. Second Int'l World Wide Web Conf., pp. 785-789, 1994.
[24] A.N. Dragunov, T.G. Dietterich, K. Johnsrude, M. McLaughlin, L. Li, and J.L. Herlocker, “Tasktracer: A Desktop Environment to Support Multi-Tasking Knowledge Workers,” Proc. 10th Int'l Conf. Intelligent User Interfaces (IUI '05), pp. 75-82, 2005.
[25] S.E. Ellis and D.P. Groth, “A Collaborative Annotation System for Data Visualization,” Proc. Working Conf. Advanced Visual Interfaces (AVI '04), pp. 411-414, 2004.
[26] U.M. Fayyad, G. Piatetsky-Shapiro, and P. Smyth, “From Data Mining to Knowledge Discovery: An Overview,” Advances in Knowledge Discovery and Data Mining, pp. 1–34, 1996.
[27] W. Fitzgerald, R. Firby, M. Hanneman, “Multimodal Event Parsing for Intelligent User Interfaces,” Proc. Int'l Conf. Intelligent User Interfaces, pp. 53-60, 2003.
[28] D. Foulser, “Iris Explorer: A Framework for Investigation,” SIGGRAPH Computer Graphics, vol. 29, no. 2, pp. 13-16, 1995.
[29] D. Franklin, J. Budzik, K. Hammond, “Plan-Based Interfaces: Keeping Track of User Tasks and Acting to Cooperate,” Proc. 2003 Int'l Conf. Intelligent User Interfaces, pp. 79-86, 2002.
[30] R. Furuta, F.M. ShipmanIII, C.C. Marshall, D. Brenner, H.-W. Hsieh, “Hypertext Paths and the World-Wide Web: Experiences with Walden's Paths,” Proc. Eighth ACM Conf. on Hypertext (HYPERTEXT '97), pp. 167-176, 1997.
[31] M. Gertz, K.-U. Sattler, F. Gorin, M. Hogarth, and J. Stone, Annotating Scientific Images: A Concept-Based Approach,” Proc. 14th Int'l Conf. Scientific and Statistical Database Management, pp.59-68, 2002.
[32] Y. Gil, E. Deelman, J. Blythe, C. Kesselman, and H. Tangmunarunkit, “Artificial Intelligence and Grids: Workflow Planning and Beyond,” IEEE Intelligent Systems, vol. 19, no. 1, pp. 26-33, 2004.
[33] D.P. Groth, “Information Provenance and the Knowledge Rediscovery Problem,” Proc. Eighth Int'l Conf. Information Visualization, pp.345-351, 2004.
[34] R. Heiland and M. Baker, “VisBench: A Framework for Remote Data Visualization and Analysis,” Proc. Int'l Conf. Computational Science, pp.718-727, 2001.
[35] R.R. Hightower, L.T. Ring, J.I. Helfman, B.B. Bederson, and J.D. Hollan, “Graphical Multiscale Web Histories: A Study of Padprints,” Proc. Ninth ACM Conf. Hypertext and Hypermedia: Links, Objects, Time and Space—Sructure in Hypermedia Systems (HYPERTEXT '98), pp.58-65, 1998.
[36] R.R. Hightower, L.T. Ring, J.I. Helfman, B.B. Bederson, and J.D. Hollan, “PadPrints: Graphical Multiscale Web Histories,” Proc. 11th Ann. ACM Symp. User Interface Software and Technology (UIST '98), pp.121-122, 1998.
[37] T.J. Jankun-Kelly, K.-L. Ma, M. Gertz, “A Model for the Visualization Exploration Process,” Proc. IEEE Conf. Visualization, pp. 323-330, 2002.
[38] A. Komlodi, “Search History for User Support in Information-Seeking Interfaces,” PhD thesis, Univ. of Maryland, 2002.
[39] D. Kurlander and S. Feiner, “A History-Based Macro by Example System,” Proc. Fifth Ann. ACM Symp. User Interface Software and Technology, pp. 99-106, 1992.
[40] J. Lee, G. Grinstein, “An Architecture for Retaining and Analyzing Visual Explorations of Databases,” Proc. IEEE Visualization Conf., pp. 101-109, 1995.
[41] N. Lowe, M. Tory, S. Potts, A. Datta, T. Moller, “A Parallel Coordinates Style Interface for Exploratory Volume Visualization,” IEEE Trans. Visualization and Computer Graphics, vol. 11, no. 1, pp. 71-80, 2005.
[42] G. Marchioni, Information Seeking in Electronic Environments. Cambridge Univ. Press, 1995.
[43] C.C. Marshall, “Annotation: From Paper Books to the Digital Library,” Texas AM Univ., Center for the Study of Digital Libraries, 1997.
[44] C.C. Marshall, “Toward an Ecology of Hypertext Annotation,” Proc. Ninth ACM Conf. Hypertext and Hypermedia: Links, Objects, Time and Space—Structure in Hypermedia Systems (HYPERTEXT'98), pp. 40-49, 1998.
[45] C.C. Marshall and A.B. Brush, “From Personal to Shared Annotations,” Proc. Conf. Human Factors in Computing Systems (CHI '02), pp.812-813, 2002.
[46] B.W. Murphy and D.P. Groth, “Augmenting Internet Browser History with Contextual Visual Representations,” Proc. Human-Computer Interaction Int'l Conf. (HCI), 2005.
[47] J.D. Myers, A.R. Chappell, M. Elder, A. Geist, and J. Schwidder, “Re-integrating the Research Record” Computing in Science and Eng., pp.44-50, May/June 2003.
[48] C. North and B. Shneiderman, “Snap-Together Visualization: A User Interface for Coordinating Visualizations via Relational Schemata,” Advanced Visual Interfaces, pp. 128-135, 2000.
[49] T.A. Phelps and R. Wilensky, “Multivalent Documents,” Comm. ACM, vol. 43, no. 6, pp. 82-90, 2000.
[50] P. Pirolli and S. Card, “Information Foraging in Information Access Environments,” Proc. SIGCHI Conf. Human Factors in Computing Systems (CHI '95), pp. 51-58, 1995.
[51] C. Plaisant, A. Rose, G. Rubloff, R. Salter, and B. Shneiderman, “The Design of History Mechanisms and Their Use in Collaborative Educational Simulations,” Technical Report Number 4027, Univ. of Maryland HCI Laboratory, 1999.
[52] G. Ramos and R. Balakrishnan, “Fluid Interaction Techniques for the Control and Annotation of Digital Video,” Proc. 16th Ann. ACM Symp. User Interface Software and Technology (UIST '03), pp.105-114, 2003.
[53] M. Roscheisen, C. Mogensen, and T. Winograd, “Interaction Design for Shared World-Wide Web Annotations“ Human Factors in Computing Systems, CHI 95 Conf. Companion: Mosaic of Creativity, pp. 328-329, 1995.
[54] A. El Saddik, S. Shirmohammadi, N. Georganas, and R. Steinmetz, “JASMINE: Java Application Sharing in Multiuser INteractive Environments,” Proc. Seventh Int'l Workshop Interactive Distributed Multimedia Systems and Telecomm. Services, pp. 214-226, 2000.
[55] M. Scaife and Y. Rogers, “External Cognition: How Do Graphical Representations Work?” Int'l J. Human-Computer Studies, vol. 45, pp. 185-213, 1996.
[56] B. Shneiderman, “The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations,” Proc. IEEE Symp. Visual Languages (VL '96), pp. 336-343, 1996.
[57] W.-C. Tan, “Containment of Relational Queries with Annotation Propagation,” Proc. Ninth Int'l Workshop Database Programming Languages, pp. 37-43, 2003.
[58] M. Tory and T. Moller, “Rethinking Visualization: A High-Level Taxonomy,” Proc. IEEE Symp. Information Visualization (InfoVis'04), pp.151-158, 2004.
[59] E.R. Tufte, The Visual Display of Quantitative Information. Graphics Press, 1997.
[60] C. Upson, T. FaulhaberJr., D. Kamins, D. Laidlaw, D. Schlegel, J. Vroom, R. Gurwitz, and A. van Dam, “The Application Visualization System: A Computational Environment for Scientific Visualization,” IEEE Computer Graphics and Applications, vol. 9, no. 4, pp. 30-42, 1989.
[61] A. Wexelblat, “History-Rich Tools for Social Navigation,” Proc. Conf. Summary Human Factors in Computing Systems (CHI '98), pp.359-360, 1998.
[62] A. Wexelblat and P. Maes, “Footprints: History-Rich Tools for Information Foraging,” Proc. SIGCHI Conf. Human Factors in Computing Systems (CHI '99), pp. 270-277, 1999.
[63] J. Wood, H. Wright, and K. Brodie, “Computer Supported Collaborative Visualization,” Visualization and Modeling, pp. 13-25, 1995.
[64] H. Wright, K. Brodlie, and M. Brown, “The Dataflow Visualization Pipeline as a Problem Solving Environment,” Virtual Environments and Scientific Visualization '96, M. Göbel, J. David, P. Slavik, and J.J. van Wijk, eds., pp. 267-276. Vienna: Springer-Verlag, 1996.
Index Terms:
Visualization, interaction model, provenance, annotation.
Citation:
Dennis P. Groth, Kristy Streefkerk, "Provenance and Annotation for Visual Exploration Systems," IEEE Transactions on Visualization and Computer Graphics, vol. 12, no. 6, pp. 1500-1510, Nov./Dec. 2006, doi:10.1109/TVCG.2006.101
