This Article 
 Bibliographic References 
 Add to: 
October-December 2008 (vol. 1 no. 4)
pp. 248-259
Kristina Höök, Microsoft Research Ltd. and Stockholm University, Kista
With new technologies such as body sensors, tangible interaction, haptics, interactive cloth, or small computing devices such as mobiles, we can move interaction from the desktop out into the world and onto our bodies. Likewise, with the boom of computer games, domestic digital technology use, and social communication tools, we have to consider designing for non-instrumental goals, beyond task completion. This has been picked up by human-computer interaction researchers in the so-called third wave of HCI. We suggest that learning technologies could use some of the results from the third wave of HCI, placing body and emotion more centrally into the communication and construction of knowledge. Designing for bodily interaction, emotional communication or aesthetics is not trivial. In design work, a designer can only set the stage for certain experience to happen, but in the end, it is the user who co-constructs the experience with or through the interaction. Based on our experiences of designing for bodily and emotional communication, we will posit three postulates that might be helpful in designing for involving interaction: leaving ‘surfaces’ open for users to appropriate, building for users to recognise themselves socially, emotional or bodily through the interface, and avoiding reductionism.

[1] P.M. Aoki and A. Woodruff, “Making Space for Stories: Ambiguity in the Design of Personal Communication Systems,” Proc. SIGCHI Conf. Human Factors in Computing Systems, pp. 181-190, 2005.
[2] K. Bachour, F. Kaplan, and P. Dillenbourg, “Reflect: An Interactive Table for Regulating Face-to-Face Collaborative Learning,” Times of Convergence. Technologies across Learning Contexts, pp. 39-48, Springer, 2008.
[3] S. Benford, D. Rowland, M. Flintham, A. Drozd, R. Hull, J. Reid, J. Morrison, and K. Facer, “Life on the Edge: Supporting Collaboration in Location-Based Experiences,” Proc. SIGCHI Conf. Human Factors in Computing Systems, 2005.
[4] A. Boal, Games For Actors and Non-Actors. Routledge, 1995.
[5] K. Boehner, R. DePaula, P. Dourish, and P. Sengers, “Affect: From Information to Interaction,” Proc. Critical Computing Conf., 2005.
[6] K. Boehner, R. DePaula, P. Dourish, and P. Sengers, “How Emotion Is Made and Measured,” Int'l J. Human-Computer Studies, vol. 65, no. 4, pp. 275-291, 2007.
[7] S. Bødker, “When Second Wave HCI Meets Third Wave Challenges,” Proc. Nordic Conf. Human-Computer Interaction (NordiCHI '08), keynote paper, 2008.
[8] S. Consolvo, D. McDonald, T. Toscos, M. Chen, J. Froehlich, B. Harrison, P. Klasnja, A. LaMarca, L. LeGrand, R. Libby, I. Smith, and J. Landay, “Activity Sensing in the Wild: A Field Trial of UbiFit Garden,” Proc. Conf. Human Factors in Computing Systems (CHI '08), 2008.
[9] A.R. Damasio, Descartes' Error: Emotion, Reason and the Human Brain. Grosset/Putnam, 1994.
[10] R.J. Davidson, D. Pizzagalli, J.B. Nitschke, and N.H. Kalin, “Parsing the Subcomponents of Emotion and Disorders of Emo-tion: Perspectives from Affective Neuroscience,” Handbook of Affective Sciences, R.J. Davidson, K.R. Scherer, and H.H. Goldsmith, eds., Oxford Univ. Press, 2003.
[11] J. Dewey, Art as Experience. Perigee Trade, 1934.
[12] T. Djajadiningrat, B. Matthews, and M. Stienstra, “Easy Doesn't Do It: Skill and Expression in Tangible Aesthetics,” Personal and Ubiquitous Computing, special issue on movement-based design, vol. 11, no. 8, pp. 657-676, 2007.
[13] E. Grosz, Volatile Bodies: Toward a Corporeal Feminism. Indiana Univ. Press, 1994
[14] J. Grudin, “The Computer Reaches Out: The Historical Continuity of Interface Design,” Proc. Conf. Human Factors in Computing Systems (CHI '90), pp. 261-268, 1990
[15] D. Haraway, “A Cyborg Manifesto: Science, Technology, and Socialist-Feminism in the Late Twentieth Century,” Simians, Cyborgs, and Women: The Reinvention of Nature, pp.149-181, Routledge, 1991.
[16] R. Harper, D. Randall, N. Smyth, C. Evans, L. Heledd, and R. Moore, “Thanks for the Memory,” Proc. IFIP Int'l Conf. Human-Computer Interaction (INTERACT '07), 2007.
[17] M. Hassenzahl, “User Experience (UX): Towards an Experiential Perspective on Product Quality,” Proc. Interaction Homme-Machine Francophone (IHM), keynote presentation, 2008.
[18] L.-E. Holmquist, “Mobile 2.0,” Interactions, vol. 14, no. 2, 2007.
[19] C. Hummels, K.C. Overbeeke, and S. Klooster, “Move to Get Moved: A Search for Methods, Tools, and Knowledge to Design for Expressive and Rich Movement-Based Interaction,” Personal and Ubiquitous Computing, vol. 11, no. 8, pp. 677-690, Springer-Verlag, 2007.
[20] E. Hutchins, Cognition in the Wild. MIT Press, 1995.
[21] K. Höök, “Designing Familiar Open Surfaces,” Proc. Nordic Conf. Human-Computer Interaction (NordiCHI '06), pp. 242-251, 2006.
[22] K. Höök, “Affective Loop Experiences—What Are They?” Proc. Persuasive Technology Conf., 2008.
[23] K. Höök, A. Ståhl, P. Sundström, and J. Laaksolahti, “Interactional Empowerment,” Proc. ACM SIGCHI Conf. Computer-Human Interaction (CHI '08), 2008.
[24] K. Isbister and K. Höök, “On Being Supple: In Search of Rigor without Rigidity in Meeting New Design and Evaluation Challenges for HCI Practitioners,” Proc. Conf. Human Factors in Computing Systems (CHI '09), 2009.
[25] H. Ishii, C. Wisneski, J. Orbanes, B. Chun, and J. Paradiso, “PingPongPlus: Design of an Athletic-Tangible Interface for Computer-Supported Cooperative Play,” Proc. SIGCHI Conf. Human Factors in Computing Systems, pp. 394-401, 1999.
[26] J. Jonsson, M. Montola, A. Waern, and M. Ericsson, “Prosopopeia: Experiences from a Pervasive Larp,” Proc. 2006 ACM SIGCHI Int'l Conf. Advances in Computer Entertainment Technology (ACE '06), 2006.
[27] J.J. Kaye, “I Just Clicked To Say I Love You: Rich Evaluations of Minimal Communication,” Proc. Conf. Human Factors in Computing Systems (CHI '06), extended abstract, 2006.
[28] J. Katz, How Emotions Work. Univ. of Chicago Press, 1998.
[29] B. Kort, R. Reilly, and R.W. Picard, “An Affective Model of Interplay between Emotions and Learning: Reengineering Edu-cational Pedagogy-Building a Learning Companion,” Proc. Int'l Conf. Advanced Learning Technologies (ICALT '01), 2001.
[30] J. Lave and E. Wenger, Situated Learning: Legitimate Periperal Participation. Cambridge Univ. Press, 1990.
[31] G.O. Longo, “Body and Technology: Continuity or Discontinuity?” Mediating the Human Body: Technology, Communication, and Fashion, L. Fortunati, J.E. Katz, and R. Riccini, eds., Lawrence Erlbaum & Assoc., 2003.
[32] C. Lutz, “Emotion, Thought, and Estrangement: Emotion as a Cultural Category,” Cultural Anthropology, vol. 1, no. 3, pp. 287-309, 1986.
[33] C. Lutz, Unnatural Emotions: Everyday Sentiments on an Micronesian Atoll and Their Challenge to Western Theory. Univ. of Chicago Press, 1988.
[34] M. Marshall, “Do Tangible Interfaces Enhance Learning?” Proc. First Int'l Conf. Tangible and Embedded Interaction (TEI '07), 2007.
[35] P. Marshall, S. Price, and Y. Rogers, “Conceptualising Tangibles to Support Learning,” Proc. 2003 Conf. Interaction Design and Children, 2003.
[36] J. McCarthy and P. Wright, Technology as Experience. The MIT Press, 2004.
[37] M. Merleau-Ponty, Phenomenology of Perception, C. Smith (translator). Routledge & Kegan Paul, 1962.
[38] J. Moen, “KinAesthetic Movement Interaction. Designing for the Pleasure of Motion,” Proc. Conf. Human-Computer Interaction (HCI'06), unpublished doctoral thesis, 2006.
[39] S. Mota and R.W. Picard, “Automated Posture Analysis for Detecting Learner's Interest Level,” Proc. Conf. Computer Vision and Pattern Recognition Workshop, vol. 5, p. 49, 2003.
[40] D.A. Norman, Emotional Design: Why We Love (or Hate) Everyday Things. Basic Books, 2004.
[41] R. Picard, Affective Computing. MIT Press, 1997.
[42] J.A. Russell, “Circumplex Model of Affect,” J. Personality and Social Psychology, vol. 39, no. 6, pp. 1161-1178, 1980.
[43] T. Schiphorst, “Really, Really Small: The Palpability of the Invisible,” Proc. Sixth ACM SIGCHI Conf. Creativity and Cognition (C&C '07), 2007.
[44] H. Schnädelbach, S.R. Egglestone, S. Reeves, S. Benford, B. Walker, and M. Wright, “Performing Thrill: Designing Telemetry Systems and Spectator Interfaces for Amusement Rides,” Proc. Conf. Human Factors in Computing Systems (CHI '08), 2008.
[45] P. Sengers, K. Boehner, S. Warner, and T. Jenkins, “Evaluating Affector: Co-Interpreting What ‘Works’,” Proc. Conf. Human Factors in Computing Systems Workshop Innovative Approaches to Evaluating Affective Systems (CHI '05), 2005.
[46] M. Sheets-Johnstone, “Emotion and Movement: A Beginning Empirical-Phenomenological Analysis of Their Relationship,” J.Consciousness Studies, vol. 6, nos. 11-12, pp. 259-277, 1999.
[47] R. Strong and W.W. Gaver, “Feather, Scent, and Shaker: Supporting Simple Intimacy,” Proc. Conf. Computer Supported Cooperative Work (CSCW '96), 1996.
[48] A. Ståhl, K. Hoök, M. Svensson, A. Taylor, and M. Combetto, “Experiencing the Affective Diary,” J. Personal and Ubiquitous Computing, 2008.
[49] L.A. Suchman, “From Interactions to Integrations,” Proc. Conf. Human-Computer Interaction (INTERACT '97), S. Howard, J.Hammond, and G. Lindegaard, eds., 1997.
[50] P. Sundström, A. Ståhl, and K. Höök, “In Situ Informants Exploring an Emotional Mobile Messaging System in Their Everyday Practice,” Int'l J. Human-Computer Studies, special issue on evaluating affective interfaces, vol. 65, no. 4, pp. 388-403, Apr. 2007.
[51] K. Tu, H. Thornburg, E. Campana, D. Birchfield, M. Fulmer, and A. Spanais, “Interaction and Reflection via 3D Path Shape Qualities in a Mediated Constructive Learning Environment,” Proc. Int'l Workshop Educational Multimedia and Multimedia Education (EMME '07), 2007.
[52] P.C. Wright and M. Blythe, “User Experience Research as an InterDiscipline: Towards a UX Manifesto,” Towards a UX Manifesto—Proc. Cost294-Affiliated Workshop (BHCI '07), E. Law, A. Vermeeren, M. Hassenzahl, and M. Blythe, eds., pp. 65-70, 2007.
[53] O. Zuckerman, S. Arida, and M. Resnick, “Extending Tangible Interfaces for Education: Digital Montessori-Inspired Manipu-latives,” Proc. Conf. Human Factors in Computing Systems (SIGCHI '05), 2005.
[54] G. Zufferey, P. Jermann, and P. Dillenbourg, “A Tabletop Learning Environment for Logistics Assistants: Activating Teachers,” Proc. Cover Human Computer Interaction (IASTED-HCI '08), pp. 37-42, 2008.

Index Terms:
Learning Technologies, User-centered design
Kristina Höök, "Knowing, Communication and Experiencing through Body and Emotion," IEEE Transactions on Learning Technologies, vol. 1, no. 4, pp. 248-259, Oct.-Dec. 2008, doi:10.1109/TLT.2009.3
Usage of this product signifies your acceptance of the Terms of Use.