Issue No.03 - July-September (2009 vol.2)
pp: 174-188
Oliver Brdiczka , Palo Alto Research Center (PARC), Palo Alto
Jürgen Steimle , Technische Universität Darmstadt, Darmstadt
This paper presents CoScribe, a concept and prototype system for the combined work with printed and digital documents, which supports a large variety of knowledge work settings. It integrates novel pen-and-paper-based interaction techniques that enable users to collaboratively annotate, link and tag both printed and digital documents. CoScribe provides for a very seamless integration of paper with the digital world, as the same digital pen and the same interactions can be used on paper and displays. As our second contribution, we present empirical results of three field studies on learning at universities. These motivated the design of CoScribe and were abstracted to a generic framework for the design of intuitive pen-and-paper user interfaces. The resulting interaction design comprising collaboration support and multiuser visualizations has been implemented and evaluated in user studies. The results indicate that CoScribe imposes only minimal overhead on traditional annotation processes and provides for a more efficient structuring and retrieval of documents.
Collaborative learning, computer-supported cooperative work, paper interfaces, digital pen, input devices and strategies, hypertext navigation.
Oliver Brdiczka, Jürgen Steimle, "CoScribe: Integrating Paper and Digital Documents for Collaborative Knowledge Work", IEEE Transactions on Learning Technologies, vol.2, no. 3, pp. 174-188, July-September 2009, doi:10.1109/TLT.2009.27
[1] A. Adler, A. Gujar, B.L. Harrison, K. O'Hara, and A. Sellen, “A Diary Study of Work-Related Reading: Design Implications for Digital Reading Devices,” Proc. ACM Conf. Human Factors in Computing (CHI '98), pp. 241-248, 1998.
[2] R. Anderson, O. Chung, K.M. Davis, P. Davis, C. Prince, V. Razmov, and B. Simon, “Classroom Presenter—A Classroom Interaction System for Active and Collaborative Learning,” Proc. Workshop Impact of Pen-Based Technology on Education (WIPTE), 2006.
[3] T. Arai, D. Aust, and S.E. Hudson, “PaperLink: A Technique for Hyperlinking from Real Paper to Electronic Content,” Proc. ACM Conf. Human Factors in Computing (CHI '97), pp. 327-334, 1997.
[4] M. Beaudouin-Lafon, “Instrumental Interaction: An Interaction Model for Designing Post-WIMP User Interfaces,” Proc. ACM Conf. Human Factors in Computing (CHI '00), pp. 446-453, 2000.
[5] D. Berque, “An Evaluation of a Broad Deployment of DyKnow Software to Support Note Taking and Interaction Using Pen-Based Computers,” J. Computing Sciences in Colleges, vol. 21, pp. 204-216, 2006.
[6] P. Brandl, M. Haller, M. Hurnaus, V. Lugmayr, J. Oberngruber, C. Oster, C. Schaftleitner, and M. Billinghurst, “An Adaptable Rear-Projection Screen Using Digital Pens and Hand Gestures,” Proc. Int'l Conf. Artificial Reality and Telexistence, pp. 49-54, 2007.
[7] R.C. Davis, J.A. Landay, V. Chen, J. Huang, R.B. Lee, F.C. Li, J. Lin, C.B. Morrey, B. Schleimer, M.N. Price, and B.N. Schilit, “NotePals: Lightweight Note Sharing by the Group, for the Group,” Proc. ACM Conf. Human Factors in Computing (CHI '99), pp. 338-345, 1999.
[8] K. Everitt, M.R. Morris, A.B. Brush, and A. Wilson, “DocuDesk: An Interactive Surface for Creating and Rehydrating Many-to-Many Linkages among Paper and Digital Documents,” Proc. IEEE Int'l Workshop Tabletops and Interactive Surfaces '08, pp. 25-28, 2008.
[9] S. Golder and B.A. Huberman, “Usage Patterns of Collaborative Tagging Systems,” J. Information Science, vol. 32, no. 2, pp. 198-208, 2006.
[10] F. Guimbretière, “Paper Augmented Digital Documents,” Proc. ACM Symp. User Interface Software and Technology (UIST '03), pp.51-60, 2003.
[11] J. Hollan, E. Hutchins, and D. Kirsh, “Distributed Cognition: Toward a New Foundation for Human-Computer Interaction Research,” ACM Trans. Human-Computer Interaction, vol. 7, pp.174-196, 2000.
[12] D. Holman, R. Vertegaal, M. Altossar, N. Troje, and D. Johns, “Paper Windows: Interaction Techniques for Digital Paper,” Proc. ACM Conf. Human Factors in Computing (CHI '05), pp. 591-599, 2005.
[13] D.H. Jonassen, K. Beissner, and M. Yacci, Structural Knowledge: Techniques for Representing, Conveying, and Acquiring Structural Knowledge. Lawrence Erlbaum Assoc., 1993.
[14] M. Kam, J. Wang, A. Iles, E. Tse, J. Chiau, D. Glaser, O. Tarshish, and J. Canny, “Livenotes: A System for Cooperative and Augmented Note-Taking in Lectures,” Proc. ACM Conf. Human Factors in Computing (CHI '05), pp. 531-540, 2005.
[15] S.R. Klemmer, J. Graham, G.J. Wolff, and J.A. Landay, “Books with Voices: Paper Transcripts as a Physical Interface to Oral Histories,” Proc. ACM Conf. Human Factors in Computing (CHI '03), pp. 89-96, 2003.
[16] W. Lai, P. Chao, and G. Chen, “The Interactive Multimedia Textbook: Using a Digital Pen to Support Learning for Computer Programming,” Proc. IEEE Int'l Conf. Advanced Learning Technologies (ICALT '07), pp. 742-746, 2007.
[17] T. Lauer, S. Trahasch, and B. Zupancic, “Anchored Discussions of Multimedia Lecture Recordings,” Proc. Frontiers in Education Conf., pp. T2H-12, 2005.
[18] C. Liao, F. Guimbretière, and C.E. Loeckenhoff, “Pen-Top Feedback for Paper-Based Interfaces,” Proc. ACM Symp. User Interface Software and Technology (UIST '06), pp. 201-210, 2006.
[19] C. Liao, F. Guimbretière, and K. Hinckley, “PaperCP: Exploring the Integration of Physical and Digital Affordances for Active Learning,” Proc. INTERACT Conf., pp. 15-28, 2007.
[20] C. Liao et al., “Papiercraft: A Gesture-Based Command System for Interactive Paper,” ACM Trans. Computer-Human Interaction, vol. 14, pp. 1-27, 2008.
[21] W.E. Mackay, G. Pothier, C. Letondal, K. Bøegh, and H.E. Sørensen, “The Missing Link: Augmenting Biology Laboratory Notebooks,” Proc. ACM Symp. User Interface Software and Technology (UIST '02), pp. 41-50, 2002.
[22] C.C. Marshall, “Annotation: From Paper Books to the Digital Library,” Proc. Conf. Digital Libraries, pp. 131-140, 1997.
[23] C.C. Marshall, “Toward an Ecology of Hypertext Annotation,” Proc. Conf. HYPERTEXT, pp. 40-49, 1998.
[24] M. Miura, S. Kunifuji, and Y. Sakamoto, “AirTransNote: An Instant Note Sharing and Reproducing System to Support Students Learning,” Proc. IEEE Int'l Conf. Advanced Learning Technologies (ICALT '07), pp. 175-179, 2007.
[25] B. Nardi and V. O'Day, Information Ecologies: Using Technology with Heart. MIT Press, 1999.
[26] M.C. Norrie, B. Signer, and N. Weibel, “Print-n-Link: Weaving the Paper Web,” Proc. ACM Symp. Document Eng. (DocEng '06), pp. 34-43, 2006.
[27] M.C. Norrie, B. Signer, and N. Weibel, “General Framework for the Rapid Development of Interactive Paper Applications,” Proc. Workshop Collaborating over Paper and Digital Documents (CoPADD '06), 2006.
[28] K. O'Hara and A. Sellen, “A Comparison of Reading Paper and On-Line Documents,” Proc. ACM Conf. Human Factors in Computing (CHI '97), pp. 335-342, 1997.
[29] M.N. Price, G. Golovchinsky, and B.N. Schilit, “Linking by Inking: Trailblazing in a Paper-Like Hypertext,” Proc. Conf. HYPERTEXT, pp. 30-39, 1998.
[30] P. Robinson, D. Sheppard, R. Watts, R. Hardin, and S. Lay, “Animated Paper Documents,” Proc. Conf. Human-Computer Interaction (HCI '97), pp. 655-658, 1997.
[31] B.N. Schilit, G. Golovchinsky, and M.N. Price, “Beyond Paper: Supporting Active Reading with Free Form Digital Ink Annotations,” Proc. ACM Conf. Human Factors in Computing (CHI '98), pp.249-256, 1998.
[32] A.J. Sellen and R.H. Harper, The Myth of the Paperless Office. MIT Press, 2003.
[33] B. Signer and M.C. Norrie, “PaperPoint: A Paper-Based Presentation and Interactive Paper Prototyping Tool,” Proc. Conf. Tangible and Embedded Interaction (TEI '07), pp. 57-64, 2007.
[34] J. Steimle, I. Gurevych, and M. Mühlhäuser, “Notetaking in University Courses and Its Implications for eLearning Systems,” Proc. Conf. eLearning Fachtagung Informatik (DeLFI '07), pp. 45-56, 2007.
[35] J. Steimle and O. Brdiczka, “Paper-Centric Interaction Concepts for Collaborative Learning,” Proc. Conf. Mensch und Computer, pp.207-216, 2008.
[36] L. Stifelman, B. Arons, and C. Schmandt, “The Audio Notebook: Paper and Pen Interaction with Structured Speech,” Proc. ACM Conf. Human Factors in Computing (CHI '01), pp. 182-189, 2001.
[37] C. Trompler, G. Rößling, H. Bär, and C.M. Choi, “Kooperative Digitale Mitschriften auf Mobilen Computern,” Proc. Conf. eLearning Fachtagung Informatik (DeLFI '03), pp. 37-46, 2003.
[38] N. Weibel, M.C. Norrie, and B. Signer, “A Model for Mapping between Printed and Digital Document Instances,” Proc. ACM Symp. Document Eng. (DocEng '07), 2007.
[39] P. Wellner, “Interacting with Paper on the DigitalDesk,” Comm. ACM, pp. 87-96, 1993.
[40] C. Wu, S.J. Robinson, and A. Mazalek, “Turning a Page on the Digital Annotation of Physical Books,” Proc. Conf. Tangible and Embedded Interaction (TEI '08), pp. 109-116, 2008.
[41] R. Yeh, C. Liao, S. Klemmer, F. Guimbretière, B. Lee, B. Kakradov, J. Stamberger, and A. Paepcke, “ButterflyNet: A Mobile Capture and Access System for Field Biology Research,” Proc. ACM Conf. Human Factors in Computing (CHI '06), pp. 571-580, 2006.
[42] R.B. Yeh, A. Paepcke, and S.R. Klemmer, “Iterative Design and Evaluation of an Event Architecture for Pen-and-Paper Interfaces,” Proc. ACM Symp. User Interface Software and Technology (UIST '08), pp. 111-120, 2008.