The Community for Technology Leaders
RSS Icon
Issue No.02 - April-June (2009 vol.2)
pp: 107-120
Barbara Di Eugenio , University of Illinois at Chicago, Chicago
Christopher W. Brown , United States Naval Academy, Annapolis
Stellan Ohlsson , University of Illinois at Chicago, Chicago
David G. Cosejo , University of Illinois at Chicago, Chicago
Lin Chen , University of Illinois at Chicago, Chicago
We developed two versions of a system, called iList, that helps students learn linked lists, an important topic in computer science curricula. The two versions of iList differ on the level of feedback they can provide to the students, specifically in the explanation of syntax and execution errors. The system has been fielded in multiple classrooms in two institutions. Our results indicate that iList is effective, is considered interesting and useful by the students, and its performance is getting closer to the performance of human tutors. Moreover, the system is being developed in the context of a study of human tutoring, which is guiding the evolution of iList with empirical evidence of effective tutoring.
Computer-assisted instruction, computer science education, education, evaluation/methodology, constraint-based modeling, intelligent tutoring systems.
Barbara Di Eugenio, Christopher W. Brown, Stellan Ohlsson, David G. Cosejo, Lin Chen, "Supporting Computer Science Curriculum: Exploring and Learning Linked Lists with iList", IEEE Transactions on Learning Technologies, vol.2, no. 2, pp. 107-120, April-June 2009, doi:10.1109/TLT.2009.21
[1] B. Di Eugenio, D. Fossati, S. Haller, D. Yu, and M. Glass, “Be Brief, and They Shall Learn: Generating Concise Language Feedback for a Computer Tutor,” Int'l J. Artificial Intelligence in Education, vol. 18, no. 4, pp. 317-345, 2008.
[2] X. Lu, B. Di Eugenio, T.C. Kershaw, S. Ohlsson, and A. Corrigan-Halpern, “Expert vs. Non-Expert Tutoring: Dialogue Moves, Interaction Patterns and Multi-Utterance Turns,” Proc. Eighth Int'l Conf. Computational Linguistics and Intelligent Text Processing (CICLing '07), pp. 456-467, 2007.
[3] X. Lu, “Expert Tutoring and Natural Language Feedback in Intelligent Tutoring Systems,” PhD dissertation, Univ. of Illinois at Chicago, 2007.
[4] C. Kersey, B.D. Eugenio, P. Jordan, and S. Katz, “Modeling Knowledge Co-Construction for Peer Learning Interactions,” Proc. Ninth Int'l Conf. Intelligent Tutoring Systems, Student Research Workshop (ITS '08), June 2008.
[5] D. Fossati, B. Di Eugenio, C. Brown, and S. Ohlsson, “Learning Linked Lists: Experiments with the iList System,” Proc. Ninth Int'l Conf. Intelligent Tutoring Systems (ITS '08), pp. 80-89, June 2008.
[6] D. Fossati, “The Role of Positive Feedback in Intelligent Tutoring Systems,” Proc. 46th Ann. Meeting of the Assoc. for Computational Linguistics, Student Research Workshop (ACL '08), June 2008.
[7] S. Ohlsson, B. Di Eugenio, B. Chow, D. Fossati, X. Lu, and T.C. Kershaw, “Beyond the Code-and-Count Analysis of Tutoring Dialogues,” Proc. 13th Int'l Conf. Artificial Intelligence in Education (AIED '07), July 2007.
[8] B.S. Bloom, “The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring,” Educational Researcher, vol. 13, pp. 4-16, 1984.
[9] V.J. Shute and J. Psotka, “Intelligent Tutoring Systems: Past, Present and Future,” Handbook of Research for Educational Communications and Technology, pp.570-600, Macmillan Library Reference, 1996.
[10] J. Beck, M. Stern, and E. Haugsjaa, “Applications of AI in Education,” ACM Crossroads, , 1996.
[11] M. Evens and J. Michael, One-on-One Tutoring by Humans and Machines. Lawrence Erlbaum Assoc., 2006.
[12] K. Van Lehn, C. Lynch, K. Schulze, J.A. Shapiro, R.H. Shelby, L. Taylor, D.J. Treacy, A. Weinstein, and M.C. Wintersgill, “The Andes Physics Tutoring System: Five Years of Evaluations,” Proc. 12th Int'l Conf. Artificial Intelligence in Education, G.I. McCalla and C.K. Looi, eds., 2005.
[13] B. Di Eugenio, D. Fossati, D. Yu, S. Haller, and M. Glass, “Aggregation Improves Learning: Experiments in Natural Language Generation for Intelligent Tutoring Systems,” Proc. 42nd Meeting of the Assoc. for Computational Linguistics (ACL '05), 2005.
[14] A. Mitrović, P. Suraweera, B. Martin, and A. Weerasinghe, “DB-Suite: Experiences with Three Intelligent, Web-Based Database Tutors,” J. Interactive Learning Research, vol. 15, no. 4, pp. 409-432, 2004.
[15] N.K. Person, A.C. Graesser, L. Bautista, E.C. Mathews, andthe Tutoring Research Group “Evaluating Student Learning Gains in Two Versions of AutoTutor,” Artificial Intelligence in Education: AI-E in the Wired and Wireless Future, J.D. Moore, C.L. Redfield, and W.L. Johnson, eds., pp. 286-293, IOS Press, 2001.
[16] S. Ohlsson, “Computational Models of Skill Acquisition,” The Cambridge Handbook of Computational Psychology, R. Sun, ed., pp.359-395, Cambridge Univ. Press, 2008.
[17] S. Ohlsson, “Learning from Performance Errors,” Psychological Rev., vol. 103, pp. 241-262, 1996.
[18] D. Barrow, A. Mitrović, S. Ohlsson, and M. Grimley, “Assessing the Impact of Positive Feedback in Constraint-Based Tutors,” Proc. Ninth Int'l Conf. Intelligent Tutoring Systems (ITS '08), June 2008.
[19] A. Corrigan-Halpern, “Feedback in Complex Learning: Considering the Relationship Between Utility and Processing Demands,” PhD dissertation, Univ. of Illinois at Chicago, 2006.
[20] B.A. Fox, “Cognitive, Interactional Aspects of Correction in Tutoring,” Teaching Knowledge and Intelligent Tutoring, P.Goodyear, ed., pp. 149-172, Ablex, 1989.
[21] B.A. Fox, “Correction in Tutoring,” Proc. 15th Ann. Meeting of the Cognitive Science Soc., pp. 121-126, M. Polson, ed., 1993.
[22] B.A. Fox, The Human Tutorial Dialogue Project: Issues in the Design of Instructional Systems. Lawrence Erlbaum Assoc., 1993.
[23] A.C. Graesser, N. Person, Z. Lu, M. Jeon, and B. McDaniel, “Learning While Holding a Conversation with a Computer,” Technology-Based Education: Bringing Researchers and Practitioners Together, L. PytlikZillig, M. Bodvarsson, and R. Brunin, eds., Information Age Publishing, 2005.
[24] A.T. Corbett and J.R. Anderson, “The Effect of Feedback Control on Learning to Program with the Lisp Tutor,” Proc. 12th Ann. Conf. Cognitive Science Soc., pp. 796-803, 1990.
[25] T.W. Chan, C.J. Lin, and C.Y. Chou, “An Approach to Developing Computational Supports for Reciprocal Tutoring,” Knowledge-Based Systems, vol. 15, pp. 407-412, 2002.
[26] A.N. Kumar, “Model-Based Reasoning for Domain Modeling, Explanation Generation and Animation in an ITS to Help Students Learn C++,” Proc. Workshop Model-Based Systems and Qualitative Reasoning for Intelligent Tutoring Systems (ITS '02), 2002.
[27] E. Sykes and F. Franek, “An Intelligent Tutoring System for Learning to Program in Java,” Proc. IEEE Int'l Conf. Advanced Learning Technologies, 2003.
[28] H.C. Lane and K. VanLehn, “Coached Program Planning: Dialogue-Based Support for Novice Program Design,” Proc. 34th Technical Symp. Computer Science Education (SIGCSE '03), pp. 148-152, 2003.
[29] M. Kalayar, H. Imekatsu, T. Hirashima, and A. Takeuchi, “An Intelligent Tutoring System for Search Algorithms,” Proc. Int'l Conf. Computers in Education (ICCE '01), pp. 1369-1376, 2001.
[30] “Computing Curricula 2001—Computer Science Volume,” Report of the Joint Task Force (IEEE CS, ACM),, 2001.
[31] S. Katz, D. Allbritton, J.M. Aronis, C. Wilson, and M.L. Soffa, “Gender and Race in Predicting Achievement in Computer Science,” IEEE Technology and Soc. Magazine, special issue on women and minorities in information technology, vol. 22, no. 3, pp. 20-27, Fall 2003.
[32] K. Warendorf and C. Tan, “ADIS—An Animated Data Structure Intelligent Tutoring System or Putting an Interactive Tutor on the WWW,” Intelligent Educational Systems on the World Wide Web Workshop, Proc. Eighth World Conf. Artificial Intelligence in Education (AIED) Soc., 1997.
[33] J.M. Wing, “Computational Thinking and Thinking About Computing,” Philosophical Trans. Royal Soc., vol. 366, pp. 3717-3725, July 2008.
[34] C.D. Hundhausen, S.A. Douglas, and J.T. Starko, “A Meta-Study of Algorithm Visualization Effectiveness,” J. Visual Languages and Computing, vol. 13, no. 3, pp. 259-290, 2002.
[35] S.R. Goldman, “Learning in Complex Domains: When and Why Do Multiple Representations Help (Commentary),” Learning and Instruction, vol. 13, pp. 239-244, 2003.
[36] S. Ohlsson, “Constraint-Based Student Modelling,” J. Artificial Intelligence in Education, vol. 3, no. 4, pp. 429-447, 1992.
[37] A.V. Aho, M.S. Lam, R. Sethi, and J.D. Ullman, Compilers: Principles, Techniques, and Tools, second ed. Addison Wesley, 2006.
[38] T.H. Cormen, C.E. Leiserson, R.L. Rivest, and C. Stein, Introduction to Algorithms, second ed. MIT Press/McGraw-Hill, 2000.
[39] P.C. Kyllonen and R.E. Christal, “Reasoning Ability Is (Little More Than) Working-Memory Capacity?!” Intelligence, vol. 14, pp. 389-433, 1990.
[40] A.R. Conway, M.J. Kane, and R.W. Engle, “Working Memory Capacity and Its Relation to General Intelligence,” Trends in Cognitive Sciences, vol. 7, no. 12, pp. 547-552, 2003.
[41] A.R. Conway, M.J. Kane, M.F. Bunting, D.Z. Hambrick, O. Wilhelm, and R.W. Engle, “Working Memory Span Tasks: A Methodological Review and User's Guide,” Psychonomic Bull. & Rev., vol. 12, no. 5, pp. 769-786, 2005.
[42] B. MacWhinney, The CHILDE Project: Tools for Analyzing Talk, third ed. Lawrence Erlbaum Assoc., 2000.
[43] M.R. Lepper, M. Drake, and T.M. O'Donnell-Johnson, “Scaffolding Techniques of Expert Human Tutors,” Scaffolding Student Learning: Instructional Approaches and Issues, K. Hogan and M.Pressley, eds., Brookline Books, pp. 108-144, 1997.
[44] M.T. Chi, S.A. Siler, H. Jeong, T. Yamauchi, and R.G. Hausmann, “Learning from Human Tutoring,” Cognitive Science, vol. 25, pp.471-533, 2001.
17 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool