The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.02 - April-June (2012 vol.3)
pp: 224-236
M. M. T. Rodrigo , Dept. of Inf. Syst. & Comput. Sci., Ateneo de Manila Univ., Quezon, Philippines
ABSTRACT
We study the affective states exhibited by students using an intelligent tutoring system for Scatterplots with and without an interactive software agent, Scooter the Tutor. Scooter the Tutor had been previously shown to lead to improved learning outcomes as compared to the same tutoring system without Scooter. We found that affective states and transitions between affective states were very similar among students in both conditions. With the exception of the "neutral state,” no affective state occurred significantly more in one condition over the other. Boredom, confusion, and engaged concentration persisted in both conditions, representing both "virtuous cycles” and "vicious cycles” that did not appear to differ by condition. These findings imply that - although Scooter is well liked by students and improves student learning outcomes relative to the original tutor - Scooter does not have a large effect on students' affective states or their dynamics.
INDEX TERMS
software agents, human computer interaction, intelligent tutoring systems, interactive systems, student affective state, interactive software agent, student affective dynamics, intelligent tutoring system, Scatterplots, Scooter the Tutor, neutral state, boredom, confusion, engaged concentration, virtuous cycle, vicious cycle, student learning outcome, Motorcycles, Humans, Educational institutions, Software agents, Materials, Artificial intelligence, pedagogical agent., Affective dynamics, gaming the system, intelligent tutoring system, embodied conversational agent
CITATION
M. M. T. Rodrigo, "The Effects of an Interactive Software Agent on Student Affective Dynamics while Using ;an Intelligent Tutoring System", IEEE Transactions on Affective Computing, vol.3, no. 2, pp. 224-236, April-June 2012, doi:10.1109/T-AFFC.2011.41
REFERENCES
[1] J. Cassell, J. Sullivan, S. Prevost, and E.F. Churchhill, Embodied Conversational Agents. The MIT Press, 2000.
[2] C. Conati and X. Zhao, "Building and Evaluating an Intelligent Pedagogical Agent to Improve the Effectiveness of an Educational Game," Proc. Ninth Int'l Conf. Intelligent User Interface, pp. 6-13, 2004.
[3] R.S.J.d. Baker, A.T. Corbett, K.R. Koedinger, S.E. Evenson, I. Roll, A.Z. Wagner, M. Naim, J. Raspat, D.J. Baker, and J. Beck, "Adapting to When Students Game an Intelligent Tutoring System," Proc. Eighth Int'l Conf. Intelligent Tutoring Systems, pp. 392-401, 2006.
[4] B. Woolf, W. Burleson, I. Arroyo, T. Dragon, D. Cooper, and R. Picard, "Affect-Aware Tutors: Recognizing and Responding to Student Affect," Int'l J. Learning Technology, vol. 4, nos. 3/4, pp. 129-163, 2009.
[5] J. Rickel and W.L. Johnson, "Integrating Pedagogical Capabilities in a Virtual Environment Agent," Proc. First Int'l Conf. Autonomous Agents, pp. 30-38, 1997.
[6] W. Burleson, "Affective Larning Companions: Strategies for Empathetic Agents with Real-Time Multimodal Affective Sensing to Foster Meta-Cognitive and Meta-Affective Approaches to Learning, Motivation, and Perseverance," PhD dissertation, Massachusetts Inst. of Tech nology, 2006.
[7] K. Leelawong and G. Biswas, "Designing Learning by Teaching Agents: The Betty's Brain System," Int'l J. Artificial Intelligence in Education, vol. 18, no. 2, pp. 181-208, 2008.
[8] S. McQuiggan, J. Robison, and J. Lester, "Affective Transitions in Narrative-Centered Learning Environments," Proc. Ninth Int'l Conf. Intelligent Tutoring Systems, 2008.
[9] M.M.T. Rodrigo, G. Rebolledo-Mendez, R.S.J.d. Baker, B. du Boulay, J.O. Sugay, S.A.L. Lim, M.B.E. Lahoz, and R. Luckin, "The Effects of Motivational Modeling on Affect in an Intelligent Tutoring System," Proc. Int'l Conf. Computers in Education, T.-W. Chan, G. Biswas, F.-C. Chen, S. Chen, C. Chou, M. Jacobson, , F. Klett Kinshuk, C.-K. Looi, T. Mitrovic, R. Mizoguchi, K. Nakabayashi, P. Reimann, D. Suthers, S. Yang, and J.-C. Yang, eds., pp. 49-56, 2008.
[10] B. Reeves and C. Nass, The Media Equation: How People Treat Computers, Television and New Media Like Real People and Places. CSLI Publications, 2001.
[11] N. Shechtman and L.M. Horowitz, "Media Inequality in Conversation: How People Behave Differently When Interacting with Computers and People," Proc. SIGCHI Conf. Human Factors in Computing Systems, pp. 281-288, 2003.
[12] M.H. Bond and C.K. Venus, "Resistance to Group or Personal Insults in an Igroup or Outgroup Context," Int'l J. Psychology, vol. 26, no. 1, pp. 83-94, 1991.
[13] C. Conati and H. McLaren, "Empirically Building and Evaluating a Probabilistic Model of User Affect," User Modeling and User-Adapted Interaction, vol. 19, no. 3, pp. 267-303, 2009.
[14] A.C. Graesser, S.K. D'Mello, S.D. Craig, A. Witherspoon, J. Sullins, B. McDaniel, and B. Gholson, "The Relationship between Affective States and Dialog Patterns during Interactions with Autotutor," J. Interactive Learning Research, vol. 19, no. 2, pp. 293-312, 2008.
[15] G. Rebolledo-Mendez, B. du Boulay, and R. Luckin, "Motivating the Learner: An Empirical Evaluation," Proc. Eighth Int'l Conf. Intelligent Tutoring Systems, pp. 545-554, 2006.
[16] V.J. Shute, "Focus on Formative Feedback," Rev. Educational Research, vol. 78, no. 1 pp. 153-189, 2008.
[17] J. Cassell and K.R. Thorisson, "The Power of a Nod and a Glance: Envelope versus Emotional Feedback in Animated Conversational Agents," Applied Artificial Intelligence, vol. 13, pp. 519-538, 1999.
[18] C. Conati and M. Manske, "Evaluating Adaptive Feedback in an Educational Computer Game," Proc. Ninth Int'l Conf. Intelligent Virtual Agents, pp. 146-158, 2009.
[19] S. Hidi and V. Anderson, "Situational Interest and Its Impact on Reading and Expository Writing," The Role of Interest in Learning and Development, K.A. Renninger, S. Hidi, and A. Krapp, eds., pp. 215-238, Hillsdale, 1992.
[20] A. Krapp, "Structural and Dynamic Aspects of Interest Development: Theoretical Considerations from an Ontogenetic Perspective," Learning and Instruction, vol. 12, no. 4, pp. 383-409, 2002.
[21] R. Pekrun, T. Goetz, L.M. Daniels, R.H. Stupnisky, and R.P. Perry, "Boredom in Achievement Settings: Exploring Control-Value Antecedents and Performance Outcomes of a Neglected Emotion," J. Educational Psychology, vol. 102, no. 3, pp. 531-549, 2010.
[22] R.W. Larson and M.H. Richards, "Boredom in the Middle School Years: Blaming Schools versus Blaming Students," Am. J. Education, vol. 99, no. 4, pp. 418-443, 1991.
[23] D.W. Perkins, C. Hancock, R. Hobbs, F. Martin, and R. Simmons, Conditions of Learning in Novice Programmers. Educational Technology Center, Office of Educational Research and Improvement, 1985.
[24] R.S.J.d. Baker, S.K. D'Mello, M.M.T. Rodrigo, and A.C. Graesser, "Better to be Frustrated than Bored: The Incidence, Persistence, and Impact of Learners' Cognitive-Affective States during Interactions with Three Different Computer-Based Learning Environments," Int'l J. Human-Computer Studies, vol. 68, no. 4, pp. 223-241, 2010.
[25] S.K. D'Mello and A.C. Graesser, "Dynamics of Cognitive-Affective States during Deep Learning," under review.
[26] S.K. D'Mello, R. Taylor, and A.C. Graesser, "Monitoring Affective Trajectories during Complex Learning," Proc. 29th Ann. Cognitive Science Soc., pp. 203-208, 2007.
[27] B. Kort, R. Reilly, and R.W. Picard, "An Affective Model of Interplay Between Emotions and Learning: Reengineering Educational Pedagogy—Building a Learning Companion," Proc. Int'l Conf. Advanced Learning Technologies, 2001.
[28] R.S.J.d. Baker, A.T. Corbett, K.R. Koedinger, and A.Z. Wagner, "Off-Task Behavior in the Cognitive Tutor Classroom: When Students 'Game the System'," Proc. ACM SIGCHI Conf. Human Factors in Computing Systems, pp. 383-390, 2004.
[29] M. Cocea, A. Hershkovitz, and R.S.J.d. Baker, "The Impact of Off-Task and Gaming Behaviors on Learning: Immediate or Aggregate?" Proc. 14th Int'l Conf. Artificial Intelligence in Education, pp. 507-514, 2009.
[30] M.M.T. Rodrigo, R.S.J.d. Baker, M.C.V. Lagud, S.A.L. Lim, A.F. Macapanpan, S.A.M.S. Pascua, J.Q. Santillano, L.R.S. Sevilla, J.O. Sugay, S. Tep, and N.J.B. Viehland, "Affect and Usage Choices in Simulation Problem-Solving Environments," Proc. 13th Int'l Conf. Artificial Intelligence in Education, R. Luckin, K.R. Koedinger, J. Greer, eds., pp. 145-152. 2007.
[31] R.S. Baker, "Designing Intelligent Tutors That Adapt to When Students Game the System," PhD dissertation, CMU Technical Report CMU-HCII-05-104, Carnegie Mellon Univ., 2005.
[32] K.R. Koedinger, "Toward Evidence for Instructional Design Principles: Examples from Cognitive Tutor Math 6," Proc. North Am. Chapter of the Int'l Group for the Psychology of Math. Education, pp. 21-49, 2002.
[33] R.S.J.d. Baker, A.T. Corbett, I. Roll, and K.R. Koedinger, "Developing a Generalizable Detector of When Students Game the System," J. User Modeling and User-Adapted Interaction, vol. 18, no. 3, pp. 287-314, 2008.
[34] R. Inglehart, "Inglehart-Welzel Cultural Map of the World," http://margaux.grandvinum.se/SebTest/wvs/ articles/folder_ publishedarticle_base_54 , Feb. 2009.
[35] C. Welzel, "A Human Development View on Value Change Trends PowerPoint Presentation," http://margaux.grandvinum. se/SebTest/wvs/ articles/folder_publishedarticle_base_83 , Feb. 2009.
[36] Y. Uchida, V. Norasakkunkit, and S. Kitayama, "Cultural Constructions of Happiness: Theory and Empirical Evidence," J. Happiness Studies, vol. 5, pp. 223-239, 2004.
[37] F. Lynch, Social Acceptance Reconsidered, A.A. Yengoyan and P.Q. Makil, eds. Inst. of Phillipine Culture, 1984.
[38] C. Geertz, "'From the Native's Point of View': On the Nature of Anthropological Understanding," Bull. Am. Academy of Arts and Sciences, vol. 28, no. 1, pp. 26-45, 1974.
[39] Ateneo Center for Educational Development, "Ramon Magsaysay Cubao High School: School Profile Report," available from the Ateneo Center for Educational Development, Ateneo de Manila Univ., Loyola Heights, Quezon City, Philippines, 2009.
[40] T.W. Bickmore and R.W. Picard, "Towards Caring Machines," Proc. Conf. Extended Abstracts on Human Factors in Computing Systems, pp. 1489-1492, 2004.
[41] W.R. Cupach and B.H. Spitzberg, "Trait Versus State: A Comparison of Dispositional and Situational Measures of In-terpersonal Communication Competence," The Western J. Speech Comm., vol. 47, pp. 364-379, 1983.
[42] M.M.T. Rodrigo, R.S.J.d. Baker, S. D'Mello, M.C.T. Gonzalez, M.C.V. Lagud, S.A.L. Lim, A.F. Macapanpan, S.A.M.S. Pascua, J.Q. Santillano, J.O. Sugay, S. Tep, and N.J.B. Viehland, "Comparing Learners' Affect while Using an Intelligent Tutoring System and a Simulation Problem Solving Game," Proc. Ninth Int'l Conf. Intelligent Tutoring Systems, pp. 40-49, 2008.
[43] S.K. D'Mello, R.W. Picard, and A. Graesser, "Toward an Affect-Sensitive AutoTutor," IEEE Intelligent Systems, vol. 22, no. 4, pp. 53-61, July/Aug. 2007.
[44] S.K. D'Mello, S.D. Craig, A.W. Witherspoon, B.T. McDaniel, and A.C. Graesser, "Automatic Detection of Learner's Affect from Conversational Cues," User Modeling and User-Adapted Interaction, vol. 18, nos. 1/2, pp. 45-80, 2008.
[45] A. De Vicente and H. Pain, "Informing the Detection of the Students' Motivational State: an Empirical Study," Proc. Sixth Int'l Conf. Intelligent Tutoring Systems, pp. 933-943, 2002.
[46] S.K. D'Mello and A.C. Graesser, "Automatic Detection of Learners' Emotions from Gross Body Language," Applied Artificial Intelligence, vol. 23, no. 2, pp. 123-150, 2009.
[47] S. Mota and R.W. Picard, "Automated Posture Analysis for Detecting Learner's Interest Level," Proc. Conf. Computer Vision and Pattern Recognition Workshop, 2003.
[48] S.K. D'Mello, S.D. Craig, J. Sullins, and A.C. Graesser, "Predicting Affective States Expressed Through an Emote-Aloud Procedure from AutoTutor's Mixed-Initiative Dialogue," Int'l J. Artificial Intelligence in Education, vol. 16, pp. 3-28, 2006.
[49] D.G. Cooper, I. Arroyo, B.P. Woolf, K. Muldner, W. Burleson, and R. Christopherson, "Sensors Model Student Self-Concept in the Classroom," Proc. Int'l Conf. User Modeling, Adaptation, and Personalization, pp. 30-41, 2009.
[50] A.C. Graesser, B. McDaniel, P. Chipman, A. Witherspoon, S. D'Mello, and B. Gholson, "Detection of Emotions during Learning with AutoTutor," Proc. 28th Ann. Meeting of the Cognitive Science Soc., pp. 285-290, 2006.
[51] J. Schofield, Computers and Classroom Culture. MIT Press, 1995.
[52] H.M. Lahaderne, "Attitudinal and Intellectual Correlates of Attention: A Study of Four Sixth-Grade Classrooms," J. Educational Psychology, vol. 59, no. 5, pp. 320-324, 1968.
[53] N.L. Karweit and R.E. Slavin, "Time-on-Task: Issues of Time, Sampling, and Definition," J. Experimental Psychology, vol. 74, no. 6, pp. 844-851, 1982.
[54] S. Planalp, V.L. DeFrancisco, and D. Rutherford, "Varieties of Cues to Emotion in Naturally Occurring Settings," Cognition and Emotion, vol. 10, no. 2, pp. 137-153, 1996.
[55] C.A. Bartel and R. Saavedra, "The Collective Construction of Work Group Moods," Administrative Science Quarterly, vol. 45, no. 2, pp. 197-231, 2000.
[56] B.A. Lehman, M. Mathews, S.K. D'Mello, and N. Person, "Understanding Students' Affective States during Learning," Proc. Ninth Int'l Conf. Intelligent Tutoring Systems, pp. 50-59, 2008.
[57] M. Csikszentmihalyi, Flow: The Psyochology of Optimal Experience. Harper and Row, 1990.
[58] J. Walonoski and N. Heffernan, "Prevention of Off-Task Gaming Behavior in Intelligent Tutoring Systems," Proc. Eighth Int'l Conf. Intelligent Tutoring Systems, Ikeda, Ashley, and Chan, eds., pp. 722-724, 2006.
[59] I. Roll, V. Aleven, B.M. McLaren, and K.R. Koedinger, "Improving Students' Help-Seeking Skills Using Metacognitive Feedback in an Intelligent Tutoring System," Learning and Instruction, vol. 21, pp. 267-280, 2011.
[60] I. Arroyo, K. Ferguson, J. Johns, T. Dragon, H. Meheranian, D. Fisher, A. Barto, S. Mahadevan, and B.P. Woolf, "Repairing Disengagement with Non-Invasive Interventions," Proc. 13th Int'l Conf. Artificial Intelligence in Education, 2007.
[61] S.K. D'Mello, R. Taylor, K. Davidson, and A. Graesser, "Self versus Teacher Judgments of Learner Emotions during a Tutoring Session with AutoTutor," Proc. Ninth Int'l Conf. Intelligent Tutoring Systems, pp. 9-18, 2008.
6 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool