The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.01 - Jan.-March (2011 vol.4)
pp: 59-73
Jan-Willem Strijbos , Leiden University, Leiden
ABSTRACT
Within the (Computer-Supported) Collaborative Learning (CS)CL research community, there has been an extensive dialogue on theories and perspectives on learning from collaboration, approaches to scaffold (script) the collaborative process, and most recently research methodology. In contrast, the issue of assessment of collaborative learning has received much less attention. This article discusses how assessment of collaborative learning has been addressed, provides a perspective on what could be assessed, and highlights limitations of current approaches. Since assessment of collaborative learning is a demanding experience for teachers and students alike, they require adequate computer-supported and intelligent tools for monitoring and assessment. A roadmap for the role and application of intelligent tools for assessment of (CS)CL is presented.
INDEX TERMS
Assessment, collaborative learning, computers and education, psychology.
CITATION
Jan-Willem Strijbos, "Assessment of (Computer-Supported) Collaborative Learning", IEEE Transactions on Learning Technologies, vol.4, no. 1, pp. 59-73, Jan.-March 2011, doi:10.1109/TLT.2010.37
REFERENCES
[1] R.M. Gillies and A.F. Ashman, “An Historical Overview of the Use of Groups to Promote Socialization and Learning,” Co-Operative Learning: The Social and Intellectual Outcomes of Learning in Groups, R.M. Gillies and A.F. Ashman, eds., pp. 1-18, Routledge, 2003.
[2] G. Stahl, T. Koschmann, and D. Suthers, “Computer-Supported Collaborative Learning: A Historical Perspective,” Cambridge Handbook of the Learning Sciences, R.K. Sawyer, ed., pp. 409-426, Cambridge Univ., 2006.
[3] What We Know about CSCL: And Implementing It in Higher Education, J.W. Strijbos, P.A. Kirschner, and R.L. Martens, eds. Kluwer Academic/Springer, 2004.
[4] N. Frederiksen, “The Real Test Bias: Influences of Testing on Teaching and Learning,” Am. Psychologist, vol. 39, no. 3, pp. 193-202, 1984.
[5] L. Lipponen, K. Hakkarainen, and S. Paavola, “Practices and Orientations of CSCL,” What We Know about CSCL: And Implementing It in Higher Education, J.W. Strijbos, P.A. Kirschner, and R.L. Martens, eds., pp. 31-50, Kluwer Academic/Springer, 2004.
[6] J.W. Strijbos and F. Fischer, “Methodological Challenges for Collaborative Learning Research,” Learning and Instruction, vol. 17, no. 4, pp. 389-394, 2007.
[7] W. Harlen and M. James, “Creating a Positive Impact of Assessment on Learning,” Proc. Ann. Meeting of the Am. Educational Research Assoc. (AERA '96), Apr. 1996.
[8] Optimising New Modes of Assessment: In Search of Qualities and Standards, M. Segers, F. Dochy, and E. Cascallar, eds. Kluwer, 2003.
[9] J. Hattie, Formative and Summative Interpretations of Assessment Information, http://www.education.auckland.ac.nz/webdav/ site/education/shared/hattie/docsformative-and-summative-assessment-(2003).pdf , 2003.
[10] V.J. Shute, “Tensions, Trends, Tools, and Technologies: Time for an Educational Sea Change,” The Future of Assessment: Shaping Teaching and Learning, C.A. Dwyer, ed., pp. 139-187, Erlbaum, 2007.
[11] K.D. Williams and S.J. Karau, “Social Loafing and Social Compensation: The Effects of Expectations of Co-Worker Performance,” J. Personality and Social Psychology, vol. 61, no. 4, pp. 570-581, 1991.
[12] N.L. Kerr and S.E. Bruun, “Dispensability of Member Effort and Group Motivation Losses: Free-Rider Effects,” J. Personality and Social Psychology, vol. 44, no. 1, pp. 78-94, 1983.
[13] R.E. Slavin, “Cooperative Learning in Teams: State of the Art,” Educational Psychologist, vol. 15, no. 2, pp. 93-111, 1980.
[14] D.W. Johnson, “Student-Student Interaction: The Neglected Variable in Education,” Educational Researcher, vol. 10, no. 1, pp. 5-10, 1981.
[15] Cooperative Learning: Theory, Research and Practice, R.E. Slavin, ed., second ed. Allyn & Bacon, 1995.
[16] R.E. Slavin, “Research on Cooperative Learning and Achievement: What We Know, What We Need to Know,” Contemporary Educational Psychology, vol. 21, no. 1, pp. 43-69, 1996.
[17] R.M. Ryan and E.L. Deci, “Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions,” Contemporary Educational Psychology, vol. 25, no. 1, pp. 54-67, 2000.
[18] D.W. Johnson and R.T. Johnson, Learning Together and Alone: Cooperative, Competitive and Individualistic Learning, fourth ed. Allyn & Bacon, 1994.
[19] E.G. Cohen, “Restructuring the Classroom: Conditions for Productive Small Groups,” Rev. Educational Research, vol. 64, no. 1, pp. 1-35, 1994.
[20] Y. Sharan and S. Sharan, Expanding Cooperative Learning through Group Investigation. Teachers College, 1992.
[21] J.W. Strijbos, R.L. Martens, and W.M.G. Jochems, “Designing for Interaction: Six Steps to Designing Computer-Supported Collaborative Learning,” Computers and Education, vol. 42, no. 4, pp. 403-424, 2004.
[22] B. de Wever, T. Schellens, H. van Keer, and M. Valcke, “Structuring Asynchronous Discussion Groups by Introducing Roles: Do Students Act Up to the Assigned Roles?” Small Group Research, vol. 39, no. 6, pp. 770-794, 2008.
[23] B. de Wever, H. van Keer, T. Schellens, and M. Valcke, “Roles as Structuring Tool in Online Discussion Groups: The Differential Impact of Different Roles on Social Knowledge Construction,” Computers in Human Behavior, vol. 26, no. 4, pp. 516-523, 2010.
[24] J.W. Strijbos, R.L. Martens, W.M.G. Jochems, and N.J. Broers, “The Effect of Functional Roles on Group Efficiency: Using Multilevel Modeling and Content Analysis to Investigate Computer-Supported Collaboration in Small Groups,” Small Group Research, vol. 35, no. 2, pp. 195-229, 2004.
[25] J.W. Strijbos, R.L. Martens, W.M.G. Jochems, and N.J. Broers, “The Effect of Functional Roles on Perceived Group Efficiency during Computer-Supported Collaborative Learning: A Matter of Triangulation,” Computers in Human Behavior, vol. 23, no. 1, pp. 353-380, 2007.
[26] E.G. Cohen, R.A. Lotan, P.L. Abram, B.A. Scarloss, and S.E. Schultz, “Can Groups Learn?” Teachers College Record, vol. 104, no. 6, pp. 1045-1068, 2002.
[27] R.M. Gillies, Cooperative Learning: Integrating Theory and Practice. Sage, 2007.
[28] J.A. Ross and C. Rolheiser, “Student Assessment Practices in Co-Operative Learning,” Co-Operative Learning: The Social and Intellectual Outcomes of Learning in Groups, R.M. Gillies and A.F.Ashman, eds., pp. 119-135, Routledge, 2003.
[29] M. Birenbaum, “Multidimensional Assessment of Computer-Supported Knowledge Building,” Proc. Assoc. Advancement of Computing in Education (E-Learn '05), pp. 1203-1208, Oct. 2005.
[30] B. Burnett and A. Roberts, “Online Collaborative Assessment: Unpacking Process and Product,” Assessing Online Learning, P.Comeaux, ed., pp. 55-71, Jossey-Bass, 2005.
[31] D. McConnell, E-learning Groups and Communities. Soc. for Research into Higher Education/Open Univ., 2006.
[32] A. Meier, H. Spada, and N. Rummel, “A Rating Scheme for Assessing the Quality of Computer-Supported Collaboration Process,” Int'l J. Computer-Supported Collaborative Learning, vol. 2, no. 1, pp. 63-86, 2007.
[33] A. Oosterhof, R.M. Conrad, and D.P. Ely, Assessing Learners Online. Pearson, 2008.
[34] K. Swan, J. Shen, and S.R. Hiltz, “Assessment and Collaboration in Online Learning,” J. Asynchronous Learning Networks, vol. 10, no. 1, pp. 45-61, 2006.
[35] S. Kagan, “Group Grades Miss the Mark,” Educational Leadership, vol. 52, no. 8, pp. 68-71, 1995.
[36] N.L. Kerr, “Motivation Losses in Small Groups: A Social Dilemma Analysis,” J. Personality and Social Psychology, vol. 45, no. 4, pp. 819-828, 1983.
[37] G. Salomon and T. Globerson, “When Teams Do Not Function the Way They Ought to,” Int'l J. Educational Research, vol. 13, no. 1, pp. 89-99, 1989.
[38] J.R. Hoffman and S.G. Rogelberg, “All Together Now? College Students' Preferred Project Group Grading Procedures,” Group Dynamics: Theory, Research, and Practice, vol. 5, no. 1, pp. 33-40, 2001.
[39] D. Boud, R. Cohen, and J. Sampson, “Peer Learning and Assessment,” Assessment and Evaluation in Higher Education, vol. 24, no. 4, pp. 413-426, 1999.
[40] R.F. Barfield, “Students' Perceptions of and Satisfaction with Group Grades and the Group Experience in the College Classroom,” Assessment and Evaluation in Higher Education, vol. 28, no. 4, pp. 355-370, 2003.
[41] C.L.Z. Gress, M. Fior, A.F. Hadwin, and P.H. Winne, “Measurement and Assessment in Computer-Supported Collaborative Learning,” Computers in Human Behavior, vol. 26, no. 5, pp. 806-814, 2010.
[42] J. Biggs, “Enhancing Teaching through Constructive Alignment,” Higher Education, vol. 32, no. 3, pp. 347-364, 1996.
[43] J. Macdonald, “Assessing Online Collaborative Learning: Process and Product,” Computers and Education, vol. 40, no. 4, pp. 377-391, 2003.
[44] F.J. Prins, D.M.A. Sluijsmans, P.A. Kirschner, and J.W. Strijbos, “Formative Peer Assessment in a CSCL Environment,” Assessment and Evaluation in Higher Education, vol. 30, no. 4, pp. 417-444, 2005.
[45] E.Y.C. Lee, C.K.K. Chan, and J. van Aalst, “Students Assessing Their Own Collaborative Knowledge Building,” Int'l J. Computer-Supported Collaborative Learning, vol. 1, no. 1, pp. 57-87, 2006.
[46] J. van Aalst and C.K.K. Chan, “Student-Directed Assessment of Knowledge Building Using Electronic Portfolios,” J. Learning Sciences, vol. 16, no. 2, pp. 175-220, 2007.
[47] A. Sfard, “On Two Metaphors for Learning and the Dangers of Choosing Just One,” Educational Researcher, vol. 27, no. 2, pp. 4-13, 1998.
[48] G. Stahl, Group Cognition: Computer Support for Building Collaborative Knowledge. MIT, 2006.
[49] S. Akkerman, P. van den Bossche, W. Admiraal, W. Gijselaers, M. Segers, R.J. Simons, and P. Kirschner, “Reconsidering Group Cognition: From Conceptual Confusion to a Boundary Area between Cognitive and Socio-Cultural Perspectives?” Educational Research Rev., vol. 2, no. 1, pp. 39-63, 2007.
[50] D.W. Johnson and R.T. Johnson, “Cooperation and the Use of Technology,” Handbook of Research on Educational Communications and Technology, J.M. Spector, M.D. Merrill, J.J.G. van Merriënboer, and M.P. Driscoll, eds., third ed., pp. 401-423, Erlbaum, 2008.
[51] M. Alavi, “Computer-Mediated Collaborative Learning: An Empirical Investigation,” MIS Quarterly, vol. 18, no. 2, pp. 159-174, 1994.
[52] A. Weinberger, B. Ertl, F. Fischer, and H. Mandl, “Epistemic and Social Scripts in Computer-Supported Collaborative Learning,” Instructional Science, vol. 33, no. 1, pp. 1-30, 2005.
[53] J.S. Brown, A. Collins, and P. Duguid, “Situated Cognition and the Culture of Learning,” Educational Researcher, vol. 18, no. 1, pp. 32-42, 1989.
[54] J. Lave and E. Wenger, Situated Learning: Legitimate Peripheral Participation. Cambridge Univ., 1991.
[55] M.F. de Laat, “Networked Learning,” PhD dissertation, Utrecht Univ., 2006.
[56] M.F. de Laat, V. Lally, L. Lipponen, and R.J. Simons, “Investigating Patterns of Interaction in Networked Learning and Computer-Supported Collaborative Learning: A Role for Social Network Analysis,” Int'l J. Computer-Supported Collaborative Learning, vol. 2, no. 1, pp. 87-103, 2007.
[57] L. Lipponen, M. Rahikainen, J. Lallimo, and L. Hakkarainen, “Patterns of Participation and Discourse in Elementary Students' Computer Supported Collaborative Learning,” Learning and Instruction, vol. 13, no. 5, pp. 487-509, 2003.
[58] J. Pöysa, J. Lowyck, and P. Häkkinen, “Learning Together ‘There’—Hybrid ‘Place’ as a Conceptual Vantage Point for Understanding Virtual Learning Communities in Higher Education Context,” PsychNology, vol. 3, no. 2, pp. 162-180, 2005.
[59] H. Muukkonen and M. Lakkala, “Exploring Metaskills of Knowledge-Creating Inquiry in Higher Education,” Int'l J. Computer-Supported Collaborative Learning, vol. 4, no. 2, pp. 187-211, 2009.
[60] F.R. Prinsen, J. Terwel, and M. Volman, “The Influence of Learner Characteristics on Degree and Type of Participation in a CSCL Community,” British Educational Technology J., vol. 38, no. 6, pp. 1037-1055, 2007.
[61] M. Scardamalia and C. Bereiter, “Computer Support for Knowledge-Building Communities,” J. Learning Sciences, vol. 3, no. 3, pp. 265-283, 1994.
[62] S. Schrire, “Knowledge Building in Asynchronous Discussion Groups: Beyond Quantitative Analysis,” Computers and Education, vol. 46, no. 1, pp. 49-70, 2006.
[63] G. Salomon, “No Distribution without Individuals' Cognition: A Dynamic Interactional View,” Distributed Cognitions: Psychological and Educational Considerations, G. Salomon, ed., pp. 111-138, Cambridge Univ., 1993.
[64] M.P. Cakir, A. Zemel, and G. Stahl, “The Joint Organization of Interaction within a Multimodal CSCL Medium,” Int'l J. Computer-Supported Collaborative Learning, vol. 4, no. 2, pp. 115-149, 2009.
[65] J.W. Sarmiento and W. Shumar, “Boundaries and Roles: Positioning and Social Location in the Virtual Math Teams (VMT) Online Community,” Computers in Human Behavior, vol. 16, no. 4, pp. 524-532, 2010.
[66] N. Zhou, “Question Co-Construction in VMT Chats,” Studying Virtual Math Teams, G. Stahl, ed., pp. 141-159, Springer, 2009.
[67] N.M. Webb, “Collaborative Group versus Individual Assessment in Mathematics: Processes and Outcomes,” Educational Assessment, vol. 1, no. 2, pp. 131-152, 1993.
[68] A. Weinberger, K. Stegmann, and F. Fischer, “Knowledge Convergence in Collaborative Learning: Concepts and Assessment,” Learning and Instruction, vol. 17, no. 4, pp. 416-426, 2007.
[69] F. Fischer and H. Mandl, “Knowledge Convergence in Computer-Supported Collaborative Learning: The Role of External Representation Tools,” J. Learning Sciences, vol. 14, no. 3, pp. 405-441, 2005.
[70] H. Jeong and M.T.H. Chi, “Knowledge Convergence and Collaborative Learning,” Instructional Science, vol. 35, no. 4, pp. 287-315, 2007.
[71] J. Roschelle, “Learning by Collaborating: Convergent Conceptual Change,” J. Learning Sciences, vol. 2, no. 3, pp. 235-276, 1992.
[72] M. Webster, Merriam-Webster Online Dictionary, http:/www.merriam-webster.com, 2010.
[73] G. Hatano and K. Inagaki, “Sharing Cognition through Collective Comprehension Activity,” Perspectives on Socially Shared Cognition, L.B. Resnick, J.M. Levine, and S. D. Teasley, eds., pp. 331-348, Am. Psychological Assoc., 1991.
[74] N. Miyake, “Conceptual Change through Collaboration,” International Handbook of Conceptual Change, S. Vosniadou, ed., pp. 453-478, Routledge, 2008.
[75] N. Miyake, “Computer Supported Collaborative Learning,” The Sage Handbook of E-Learning Research, R. Andrews and C.Haythornthwaite, eds., pp. 248-265, Sage, 2007.
[76] B. Barron, “When Smart Groups Fail,” J. Learning Sciences, vol. 12, no. 3, pp. 307-359, 2003.
[77] K. Kreijns, “Sociable CSCL Environments: Social Affordances, Sociability and Social Presence,” PhD dissertation, Open Univ. of the Netherlands, 2004.
[78] S. Volet, M. Summers, and J. Thurman, “High-Level Co-Regulation in Collaborative Learning: How Does It Emerge and How Is It Sustained?” Learning and Instruction, vol. 19, no. 2, pp. 128-143, 2009.
[79] K. Kumpulainen and M. Mutanen, “The Situated Dynamics of Peer Group Interaction: An Introduction to an Analytic Framework,” Learning and Instruction, vol. 9, no. 5, pp. 449-473, 1999.
[80] A.K. Tolmie, K.J. Topping, D. Christie, C. Donaldson, C. Howe, E. Jessiman, K. Livingston, and A. Thurston, “Social Effects of Collaborative Learning in Primary Schools,” Learning and Instruction, vol. 20, no. 3, pp. 177-191, 2010.
[81] K. Kreijns, P.A. Kirschner, and W.M.G. Jochems, “Identifying the Pitfalls for Social Interaction in Computer-Supported Collaborative Learning: A Review of the Research,” Computers in Human Behavior, vol. 19, no. 3, pp. 335-353, 2003.
[82] M. Boekaerts and A. Minnaert, “Affective and Motivational Outcomes of Working in Collaborative Groups,” Educational Psychology, vol. 26, no. 2, pp. 187-208, 2006.
[83] C. Crook, “Motivation and the Ecology of Collaborative Learning,” Rethinking Collaborative Learning, R. Joiner, K. Littleton, D.Faulkner, and D. Miell, eds., pp. 161-178, Free Assoc. Books, 2000.
[84] D. Hijzen, M. Boekaerts, and P. Vedder, “Exploring the Links between Students' Engagement in Cooperative Learning, Their Goal Preferences and Appraisals of Instruction Conditions in the Classroom,” Learning and Instruction, vol. 17, no. 6, pp. 673-687, 2007.
[85] S. Järvelä, H. Järvenoja, and M. Veermans, “Understanding the Dynamics of Motivation in Socially Shared Learning,” Int'l J. Educational Research, vol. 47, no. 2, pp. 122-135, 2008.
[86] S. Järvelä, S. Volet, and H. Järvenoja, “Research on Motivation in Collaborative Learning: Moving Beyond the Cognitive-Situative Divide and Combining Individual and Social Processes,” Educational Psychologist, vol. 45, no. 1, pp. 15-27, 2010.
[87] M. Boekaerts and M. Niemivirta, “Self-Regulated Learning: Finding a Balance between Learning Goals and Ego Protective Goals,” Handbook of Self-Regulation, M. Boekaerts, P.R. Pintrich, and M. Zeidner, eds., pp. 417-450, Academic Press, 2000.
[88] R.M. Ryan and E.L. Deci, “Self-Determination Theory and the Facilitation of Intrinsic Motivation, Social Development, and Well-Being,” Am. Psychologist, vol. 55, no. 1, pp. 68-78, 2000.
[89] A. Krapp, “Basic Needs and the Development of Interest and Intrinsic Motivational Orientations,” Learning and Instruction, vol. 15, no. 5, pp. 381-395, 2005.
[90] D.W. Johnson and R.T. Johnson, “Student Motivation in Co-Operative Groups: Social Interdependence Theory,” Co-Operative Learning: The Social and Intellectual Outcomes of Learning in Groups, R.M. Gillies and A.F. Ashman, eds., pp. 136-176, Routledge, 2003.
[91] P. Dillenbourg, S. Järvelä, and F. Fischer, “The Evolution of Research on Computer-Supported Collaborative Leaning: From Design to Orchestration,” Technology-Enhanced Learning: Principles and Products, N. Balacheff, S. Ludvigsen, T. de Jong, A. Lazonder, and S. Barnes, eds., pp. 3-20, Spinger, 2009.
[92] S. Järvelä, T.R. Hurme, and H. Järvenoja, “Self-Regulation and Motivation in Computer-Supported Learning Environments,” Learning Across Sites: New Tools, Infrastructures and Practices, S.Ludvigsen, A. Lund, I. Rasmussen, and R. Säljö, eds., pp. 330-345, Routledge, 2010.
[93] J.W. Strijbos, P.A. Kirschner, and R.L. Martens, “What We Know about CSCL: And What We Do Not (But Need to Know) about CSCL,” What We Know about CSCL: And Implementing It in Higher Education, J.W. Strijbos, P.A. Kirschner, and R.L. Martens, eds., pp. 245-259, Kluwer/Springer, 2004.
[94] D.A. Kolb, Experiential Learning: Experience as the Source of Learning and Development. Prentice-Hall, 1984.
[95] D.A. Kolb, A.C. Baker, and P.J. Jensen, “Conversation as Experiential Learning,” Conversational Learning: An Experiential Approach to Knowledge Creation, A.C. Baker, P.J. Jensen, and D.A.Kolb, eds., pp. 51-66, Quorum Books, 2002.
[96] R. Ellis and P. Goodyear, Students' Experiences of E-Learning in Higher Education: The Ecology of Sustainable Innovation. Routledge, 2010.
[97] J.W. Strijbos, “Samenwerkend Leren: Over het Sociaal Constructivisme en de Ecologische Benadering (Collaborative Learning: On Social-Constructivism and the Ecological Approach),” unpublished master's thesis, Radboud Univ., 1999.
[98] J.W. Strijbos, “The Effect of Roles on Computer-Supported Collaborative Learning,” PhD dissertation, Open Univ. of the Netherlands, 2004.
[99] J.W. Strijbos and R.L. Martens, “Group-Based Learning: Dynamic Interaction in Groups,” European Perspectives on Computer-Supported Collaborative Learning, P. Dillenbourg, A. Eurelings, and K.Hakkarainen, eds., pp. 569-576, Maastricht Univ., 2001.
[100] J.W. Strijbos, R.L. Martens, and W.M.G. Jochems, “Designing for Participation: The Impact of Functional Roles on CSCL in Distance Education,” Proc. EARLI Biennial Conf., Aug. 2005.
[101] P.A. Kirschner, “Can We Support CSCL? Educational, Social and Technological Affordances,” Three Worlds of CSCL: Can We Support CSCL, P.A. Kirschner, ed., pp. 7-47, Open Univ. of the Netherlands, 2002.
[102] G.E Hall and H.L. Jones, Competency-Based Education: A Process for the Improvement of Education. Prentice-Hall, 1976.
[103] U. Bronfenbrenner, The Ecology of Human Development: Experiments by Nature and Design. Harvard Univ. Press, 1979.
[104] A. Camuffo and F. Gerli, “An Integrated Competency-Based Approach to Management Education: An Italian MBA Case Study,” Int'l J. Training and Development, vol. 8, no. 4, pp. 240-257, 2004.
[105] R.H. Seidman and M.J. Bradley, “A Collaborative and Competency-Based Three-Year Bachelor's Degree: Empirical Results,” Proc. Ann. Meeting of the Am. Educational Research Assoc. (AERA '02), Apr. 2004.
[106] J.J.G. van Merriënboer, M.R. van der Klink, and M. Hendriks, Competenties: Van Complicaties tot Compromis. Een Studie in Opdracht van de Onderwijsraad (Competencies: From Complications towards a Compromise—A Study for the National Educational Council). Onderwijsraad, 2002.
[107] T.H. Bastiaens and R. Martens, “Conditions for Web-Based Learning with Real Events,” Instructional and Cognitive Impacts of Web-Based Education, B. Abbey, ed., pp. 1-32, Idea Group, 2000.
[108] A. Stoof, R.L. Martens, J.J.G. van Merriënboer, and T.J. Bastiaens, “The Boundary Approach of Competence: A Constructivist Aid for Understanding and Using the Concept of Competence,” Human Resource Development Rev., vol. 1, no. 3, pp. 345-365, 2002.
[109] K. Hakkarainen, L. Lipponen, S. Järvelä, and M. Niemivirta, “The Interaction of Motivational Orientation and Knowledge Seeking Inquiry in Computer-Supported Collaborative Learning,” J. Educational Computing Research, vol. 21, no. 3, pp. 263-281, 1999.
[110] N. Saab, W. van Joolingen, and B.H.A.M. van Hout-Wolters, “The Relation of Learners' Motivation with the Process of Collaborative Scientific Discovery Learning,” Educational Studies, vol. 35, no. 2, pp. 205-222, 2009.
[111] T. Hatch and H. Gardner, “Finding Cognition in the Classroom: An Expanded View of Human Intelligence,” Distributed Cognitions: Psychological and Educational Considerations, G. Salomon, ed., pp. 164-187, Cambridge Univ., 1993.
[112] K.W. Fischer and N. Granott, “Beyond One-Dimensional Change: Parallel Concurrent, Socially Distributed Processes in Learning and Development,” Human Development, vol. 38, no. 6, pp. 302-314, 1995.
[113] U. Cress and J. Kimmerle, “A Systemic and Cognitive View on Knowledge Building with Wikis,” Int'l J. Computer-Supported Collaborative Learning, vol. 3, no. 2, pp. 105-122, 2008.
[114] I. Kollar, F. Fischer, and J.D. Slotta, “Internal and External Collaboration Scripts in Web-Based Science Learning at Schools,” Proc. Conf. Computer Support for Collaborative Learning: Learning (CSCL '05), pp. 331-340, 2005.
[115] S. Carmien, I. Kollar, G. Fischer, and F. Fischer, “The Interplay of Internal and External Scripts: A Distributed Cognition Perspective,” Scripting Computer-Supported Collaborative Learning: Cognitive, Computational and Educational Perspectives, F. Fischer, I. Kollar, H. Mandl, and J.M. Haake, eds., pp. 303-316, Springer, 2007.
[116] D. Suthers, N. Dwyer, R. Medina, and R. Vatrapu, “A Framework for Conceptualizing, Representing, and Analyzing Distributed Interaction,” Int'l J. Computer-Supported Collaborative Learning, vol. 5, no. 1, pp. 5-42, 2010.
[117] A. Zemel, F. Xhafa, and M. Cakir, “What's in the Mix? Combining Coding and Conversation Analysis to Investigate Chat-Based Problem Solving,” Learning and Instruction, vol. 17, no. 4, pp. 405-415, 2007.
[118] H. Arrow, K.B. Henry, M.S. Poole, S. Wheelan, and R. Moreland, “Traces, Trajectories, and Timing,” Theories of Small Groups: Interdisciplinary Perspectives, M.S. Poole and A.B. Hollingshead, eds., pp. 313-367, Sage, 2005.
[119] P. Reimann, “Time is Precious: Variable- and Event-Centered Approaches to Process Analysis in CSCL Research,” Int'l J. Computer-Supported Collaborative Learning, vol. 4, no. 3, pp. 239-257, 2009.
[120] J.W. Sarmiento-Klapper, “The Sequential Co-Construction of the Joint Problem Space,” Studying Virtual Math Teams, G. Stahl, ed., pp. 83-98, Springer, 2009.
[121] S. Nelson-Le Gall, “Children's Instrumental Help Seeking: Its Role in the Social Acquisition and Construction of Knowledge,” Interaction in Cooperative Groups: The Theoretical Anatomy of Group Learning, R. Hertz-Lazarowitz and N. Miller, eds., pp. 49-68, Cambrige Univ., 1992.
[122] I. Jahnke, “Dynamics of Social Roles in a Knowledge Management Community,” Computers in Human Behavior, vol. 26, no. 4, pp. 533-546, 2010.
[123] D.M.A. Sluijsmans and J.W. Strijbos, “Flexible Peer Assessment Formats to Acknowledge Individual Contributions during (Web-Based) Collaborative Learning,” E-Collaborative Knowledge Construction: Learning from Computer-Supported and Virtual Environments, B. Ertl, ed., pp. 139-161, IGI Global, 2010.
[124] J.W. Strijbos, T.A. Ochoa, D.M.A. Sluijsmans, M.S.R. Segers, and H.H. Tillema, “Fostering Interactivity through Formative Peer Assessment in (Web-Based) Collaborative Learning Environments,” Cognitive and Emotional Processes in Web-Based Education: Integrating Human Factors and Personalization, C. Mourlas, N.Tsianos, and P. Germanakos, eds., pp. 375-395, IGI Global, 2009.
[125] K. Belfer and R. Wakkary, “Team Assessment Guidelines: A Case Study of Collaborative Learning in Design,” Assessing Online Learning, P. Comeaux, ed., pp. 34-54, Jossey-Bass, 2005.
[126] C. Phielix, F.J. Prins, and P.A. Kirschner, “Awareness of Group Performance in a CSCL Environment: Effects of Peer Feedback and Reflection,” Computers in Human Behavior, vol. 26, no. 2, pp. 151-161, 2010.
[127] N.A.E. van Gennip, M.S.R. Segers, and H.H. Tillema, “Peer Assessment as a Collaborative Learning Activity: The role of Interpersonal Variables and Conceptions,” Learning and Instruction, vol. 20, no. 4, pp. 280-290, 2010.
[128] A. Dimitracopoulou, “Designing Collaborative Learning Systems: Current Trends & Future Research Agenda,” Proc. Conf. Computer Support for Collaborative Learning: Learning (CSCL '05), pp. 115-124, 2005.
[129] V.S. Kumar, C.L.Z. Gress, A.F. Hadwin, and P.H. Winne, “Assessing Process in CSCL: An Ontological Approach,” Computers in Human Behavior, vol. 26, no. 5, pp. 825-834, 2010.
[130] S. Isotani, A. Inaba, M. Ikeda, and P. Mizoguchi, “An Ontology Engineering Approach to the Realization of Theory-Driven Group Formation,” Int'l J. Computer-Supported Collaborative Learning, vol. 4, no. 4, pp. 445-478, 2009.
[131] D. Persico, F. Pozzi, and L. Sarti, “Design Patterns for Monitoring and Evaluating CSCL Processes,” Computers in Human Behavior, vol. 25, no. 5, pp. 1020-1027, 2009.
[132] E.D. Villasclaras-Fernández, D. Hernández-Leo, J.I. Ascensio-Pérez, and Y. Dimiriadis, “Incorporating Assessment in a Pattern-Based Design Process for CSCL Scripts,” Computers in Human Behavior, vol. 25, no. 5, pp. 1028-1039, 2009.
[133] The Teacher's Role in Implementing Cooperative Learning in the Classroom, R.M. Gillies, A.F. Ashman, and J. Terwel, eds. Springer, 2008.
[134] K. Lund, “Human Support in CSCL: What, for Whom, and by Whom?” What We Know about CSCL: And Implementing It in Higher Education, J.W. Strijbos, P.A. Kirschner, and R.L. Martens, eds., pp. 167-198, Kluwer/Springer, 2004.
[135] M.B. Oortwijn, M. Boekaerts, P. Vedder, and J.W. Strijbos, “Helping Behaviour during Cooperative Learning and Learning Gains: The Role of the Teacher and of Pupils' Prior Knowledge and Ethnic Background,” Learning and Instruction, vol. 18, no. 2, pp. 146-159, 2008.
[136] G. Crisp, The E-Assessment Handbook. Continuum, 2007.
[137] G. Salomon, “It's Not Just the Tool, but the Educational Rationale that Counts,” Proc. ED-Media 2000, http://www.aace.org/conf/edmedia/00salomon-keynote.htm , 2000.
[138] Y.J. Chyng, C. Steinfeld, and B. Pfaff, “Supporting Awareness among Virtual Teams in a Web-Based Collaborative System: The TeamSCOPE System,” ACM SIGGROUP Bull., vol. 21, no. 3, pp. 28-34, 2000.
[139] A. Jeong, “A Guide to Analyzing Message Response Sequences and Group Interaction Patterns in Computer-Mediated Communication,” Distance Education, vol. 26, no. 3, pp. 367-383, 2005.
[140] I. Kollar, F. Fischer, and F.W. Hesse, “Collaboration Scripts—A Conceptual Analysis,” Educational Psychology Rev., vol. 18, no. 2, pp. 159-185, 2006.
[141] M. Baker and K. Lund, “Promoting Reflective Interactions in a CSCL Environment,” J. Computer Assisted Learning, vol. 13, no. 3, pp. 174-193, 1997.
[142] A. Soller, “Supporting Social Interaction in an Intelligent Collaborative Learning System,” Int'l J. Artificial Intelligence in Education, vol. 12, no. 1, pp. 40-62, 2001.
[143] P. Jermann, A. Soller, and A. Lesgold, “Computer Software Support for CSCL,” What We Know about CSCL: And Implementing It in Higher Education, J.W. Strijbos, P.A. Kirschner, and R.L.Martens, eds., pp. 141-166, Kluwer/Springer, 2004.
[144] N. Avouris, G. Fiotakis, G. Kahrimanis, M. Margaritis, and V. Komis, “Beyond Logging of Fingertip Actions: Analysis of Collaborative Learning Using Multiple Sources of Data,” J. Interactive Learning Research, vol. 18, no. 2, pp. 231-250, 2007.
[145] G. Dyke, K. Lund, and J.J. Girardot, “Tatiana: An Environment to Support the CSCL Analysis Process,” Proc. Conf. Computer Supported Collaborative Learning (CSCL '09), pp. 58-67, 2009.
[146] A. Martínez, Y. Dimitraidis, B. Rubia, E. Gómez, and P. de la Fuente, “Combining Qualitative Evaluation and Social Network Analysis for the Study of Classroom Social Interactions,” Computers and Education, vol. 41, no. 4, pp. 353-368, 2003.
[147] U. Cress, “The Need for Considering Multilevel Analysis in CSCL Research—An Appeal for the Use of More Advanced Statistical Methods,” Int'l J. Computer-Supported Collaborative Learning, vol. 3, no. 1, pp. 69-84, 2008.
[148] B. de Wever, H. van Keer, T. Schellens, and M. Valcke, “Applying Multilevel Modelling to Content Analysis Data: Methodological Issues in the Study of Role Assignment in Asynchronous Discussion Groups,” Learning and Instruction, vol. 17, no. 4, pp. 436-447, 2007.
[149] T. Schümmer, J.W. Strijbos, and T. Berkel, “Measuring Group Interaction during CSCL,” Proc. Conf. Computer Supported Collaborative Learning: Learning (CSCL '05), pp. 567-576, 2005.
[150] D. Chan, “Data Analysis and Modeling Longitudinal Processes,” Group and Organization Management, vol. 28, no. 3, pp. 341-365, 2003.
[151] M.M. Chiu, “Flowing towards Correct Contributions during Group Problem Solving: A Statistical Discourse Analysis,” J. Learning Sciences, vol. 17, no. 3, pp. 415-463, 2008.
[152] G. Erkens and J. Janssen, “Automatic Coding of Dialogue Acts in Collaboration Protocols,” Int'l J. Computer-Supported Collaborative Learning, vol. 3, no. 4, pp. 447-470, 2008.
[153] C. Rosé, Y.-C. Wang, Y. Cui, J. Arguello, K. Stegmann, A. Weinberger, and F. Fischer, “Analyzing Collaborative Learning Processes Automatically: Exploiting the Advances of Computational Linguistics in Computer-Supported Collaborative Learning,” Int'l J. Computer-Supported Collaborative Learning, vol. 3, no. 3, pp. 237-271, 2008.
[154] F.W. Hesse, “Being Told to Do Something or Just Being Aware of Something? An Alternative Approach to Scripting of CSCL,” Scripting Computer-Supported Collaborative Learning: Cognitive, Computational and Educational Perspectives, F. Fischer, I. Kollar, H.Mandl, and J.M. Haake, eds., pp. 91-98, Springer, 2007.
[155] J.M. Caroll, D.C. Neale, P.L. Isenhour, M.B. Rosson, and D.S. McCrickard, “Notification and Awareness: Synchronizing Task-Oriented Collaborative Activity,” Int'l J. Human Computer Studies, vol. 58, no. 5, pp. 605-632, 2003.
[156] P. Dourish and V. Bellotti, “Awareness and Coordination in Shared Workspaces,” Proc. ACM Conf. Computer-Supported Cooperative Work (CSCW), pp. 107-144, 1992.
[157] J. Buder and D. Bodemer, “Supporting Controversial CSCL Discussions with Augmented Group Awareness Tools,” Int'l J. Computer-Supported Collaborative Learning, vol. 3, no. 2, pp. 123-139, 2008.
[158] P. Jermann, “Computer Support for Interaction Regulation in Collaborative Problem-Solving,” PhD dissertation, Univ. of Genéve, 2004.
[159] J. Janssen, “Using Visualizations to Support Collaboration and Coordination during Computer-Supported Collaborative Learning,” PhD dissertation, Utrecht Univ., 2008.
[160] T. Engelmann, J. Dehler, D. Bodemer, and J. Buder, “Knowledge Awareness in CSCL: A Psychological Perspective,” Computers in Human Behavior, vol. 25, no. 4, pp. 949-960, 2009.
[161] J. Kimmerle and U. Cress, “Group Awareness and Self-Presentation in Computer-Supported Information Exchange,” Int'l J. Computer-Supported Collaborative Learning, vol. 3, no. 1, pp. 85-97, 2008.
[162] L. Hemphill and S.D. Teasley, “Overherd: Designing Information Visualizations to Make Sense of Students' Online Discussions,” Proc. Int'l Conf. the Learning Sciences (ICLS '10), pp. 302-303, 2010.
20 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool