The Community for Technology Leaders
RSS Icon
Issue No.01 - First Quarter (2013 vol.6)
pp: 25-37
R. Gluga , Sch. of Inf. Technol., Univ. of Sydney, Sydney, NSW, Australia
J. Kay , Sch. of Inf. Technol., Univ. of Sydney, Sydney, NSW, Australia
T. Lever , Fac. of Eng. & Inf. Technol., Univ. of Sydney, Sydney, NSW, Australia
It is important, but very challenging, to design degree programs, so that the sequence of learning activities, topics, and assessments over three to five years give an effective progression in learning of generic skills, discipline-specific learning goals and accreditation competencies. Our CUSP (Course and Unit of Study Portal) system tackles this challenge, by helping subject teachers define the curriculum of their subject, linking it to Faculty and institutional goals. The same information is available to students, enabling them to see how each subject relates to those goals. It then gives additional big-picture views of the degree for the academics responsible for the whole degree, including the ability to easily assess if a degree meets accreditation requirements. CUSP achieves this by exploiting a lightweight semantic mapping approach that gives a highly flexible and scalable way to map learning goals from multiple internal and external accrediting sources across the degree. We report its validation as used in a live university environment, across three diverse faculties, with 277 degrees and 7,810 subject sessions over a period of three years. Data from this evaluation indicates steady improvement in the documentation of the relationships between subjects, assessments, learning outcomes, and program level goals. This is driven by the reporting tools and visualizations provided by CUSP, which enable program designers and lecturers to identify parts of the curriculum that are unclear. This improved documentation of the curriculum enables more accurate and immediate quality reviews. Key contributions of this work are: a validated new approach for curriculum design that helps address the complexity of ensuring learners progressively develop generic skills; and a validated lightweight semantic mapping approach that can flexibly support visualizing the curriculum against multiple sets of learning goal frameworks.
Education courses, Accreditation, Computer science education, Education, Electronic learning,learner model, Education courses, Accreditation, Computer science education, Education, Electronic learning, Curriculum mapping, Education courses, Accreditation, Computer science education, Education, Electronic learning, graduate attributes, Education courses, Accreditation, Computer science education, Education, Electronic learning, accreditation competencies, Education courses, Accreditation, Computer science education, Education, Electronic learning
R. Gluga, J. Kay, T. Lever, "Foundations for Modeling University Curricula in Terms of Multiple Learning Goal Sets", IEEE Transactions on Learning Technologies, vol.6, no. 1, pp. 25-37, First Quarter 2013, doi:10.1109/TLT.2012.17
[1] S. Barrie, "A Research-Based Approach to Generic Graduate Attributes Policy," Higher Education Research & Development, vol. 23, no. 3, pp. 261-275, 2004.
[2] S.C. Barrie, "A Conceptual Framework for the Teaching and Learning of Generic Graduate Attributes," Studies in Higher Education, vol. 32, no. 4, pp. 439-458, 2007.
[3] M. Kavanagh and L. Drennan, "What Skills and Attributes does an Accounting Graduate Need? Evidence from Student Perceptions and Employer Expectations," Accounting & Finance, vol. 48, no. 2, pp. 279-300, 2008.
[4] R. Bridgstock, "The Graduate Attributes We've Overlooked: Enhancing Graduate Employability through Career Management Skills," Higher Education Research & Development, vol. 28, no. 1, pp. 31-44, 2009.
[5] D. Bath, C. Smith, S. Stein, and R. Swann, "Beyond Mapping and Embedding Graduate Attributes: Bringing Together Quality Assurance and Action Learning to Create a Validated and Living Curriculum," Higher Education Research & Development, vol. 23, no. 3, pp. 313-328, 2004.
[6] T. Lever, D. Auld, and R. Gluga, "Representing and Valuing Non-Engineering Contributions to Engineering Graduate Outcomes in Engineering Combined Degrees," Proc. 22nd Ann. Conf. Australasian Assoc. for Eng. Education, 2011.
[7] V. Psych, J. Bourdeau, and R. Mizoguchi, "Ontology Development at the Conceptual Level for Theory-Aware ITS Authoring Systems," Proc. Conf. Artificial Intelligence in Education, pp. 491-493, en, 2003.
[8] "Engineering and IT Graduate Outcomes Table," Univ. of Sydney, Faculty of Eng., competency, 2012.
[9] "Stage 1 Competency Standard for Professional Engineering," Engineers Australia, default/files/shado/EducationProgram , 2011.
[10] "Software Engineering 2004 Curriculum Guidelines for Undergraduate Degree Programs in Software Engineering," Assoc. for Computing Machinery, IEEE CS, , 2004.
[11] "Engineering and ICT Learning and Teaching Academic Standards Statement," Australian Learning and Teaching Council, , Dec. 2010.
[12] "A Tuning-AHELO Conceptual Framework of Expected/Desired Learning Outcomes in Engineering," Organisation for Economic Co-Operation and Development, oecd/46/3443160507.pdf , June 2009.
[13] "12 CDIO Standards," Worldwide CDIO Initiative, http://www. 12-cdio-standards, 2012.
[14] "Graduate Attributes Policy," The Univ. of Sydney, policy.htm, 2011.
[15] C. Ewan, "Disciplines Setting Standards: The Learning and Teaching Academic Standards (LTAS) Project," Proc. Australian Quality Forum Quality in Uncertain Time, au/files/publications auqf_proceedings_2010.pdf#page=11, 2010.
[16] "Engineering and ICT: Learning and Teaching Academic Standards Statement," Australian Learning and Teaching Council, , 2010.
[17] "Assessment of Higher Education Learning Outcomes (AHELO)," Australian Council for Educational Research (ACER),, 2012.
[18] E. Crawley, J. Malmqvist, and S. Östlund, Rethinking Engineering Education: The CDIO Approach, vol. 133. Springer Verlag, 2007.
[19] E. Crawley, J. Malmqvist, W. Lucas, and D. Brodeur, "The CDIO Syllabus v2.0. An Updated Statement of Goals for Eng. Education," Proc. Seventh Int'l CDIO Conf., 2011.
[20] P. Avitabile, J. McKelliget, and T. Van Zandt, "Interweaving Numerical Processing Techniques in Multisemester Projects," Proc. Am. Soc. for Eng. Education Ann. Conf. (ASEE), 2005.
[21] S. Barrie, C. Smith, C. Hughes, and K. Thomson, "The National Graduate Attributes Project: Key Issues to Consider in the Renewal of Learning and Teaching Experiences to Foster Graduate Attributes," Australian Learning & Teaching Council, 2009.
[22] "Accreditation Management System - Education Programs at the Level of Professional Engineer," Engineers Australia Accreditation Board, accreditation-management-system-professional-engineers , 2008.
[23] "Developing a Framework for Teaching and Learning Standards in Australian Higher Education and the Role of TEQSA," Teaching Education Quality & Standards Agency (TEQSA), Policy/teqsa/Pagesdefault.aspx, 2011.
[24] M. Mulder, T. Weigel, K. Collins, and B. Bibb, "The Concept of Competence in the Development of Vocational Education and Training in Selected EU Member States: A Critical Analysis," J. Vocational Education and Training, vol. 59, no. 1, pp. 67-78, 2007.
[25] S. McKenney, N. Nieveen, and J. van den Akker, "Computer Support for Curriculum Developers: CASCADE," Educational Technology Research and Development, vol. 50, no. 4, pp. 25-35, 2002.
[26] R. Koper, "Modeling Units of Study from a Pedagogical Perspective: The Pedagogical Meta-Model Behind EML," Proc. Ocean Thermal Energy Conversion (OTEC), , 2001.
[27] F. Van Assche, "Linking Learning Resources to Curricula by Using Competencies," Proc. First Int'l Workshop LO Discovery & Exchange, CEUR-WS/Vol-311paper11.pdf, 2007.
[28] G. Paquette, I. Rosca, S. Mihaila, and A. Masmoudi, "TELOS, a Service-Oriented Framework to Support Learning and Knowledge Management," E-Learning Networked Environments and Architectures: A Knowledge Processing Perspective, p. 434, Springer, http://halshs.archives-ouvertes.frhal-00190038 , 2007.
[29] M. Kalz, J. van Bruggen, E. Rusman, B. Giesbers, and R. Koper, "Positioning of Learners in Learning Networks with Content, Metadata and Ontologies," Interactive Learning Environments, vol. 15, no. 2, pp. 191-200, 2007.
[30] I. Bittencourt, S. Isotani, E. Costa, and R. Mizoguchi, "Research Directions on Semantic Web and Education," J. Scientia-Interdisciplinary Studies in Computer Science, vol. 19, no. 1, pp. 59-66, 2008.
[31] M. Winter, C. Brooks, and J. Greer, "Towards Best Practices for Semantic Web Student Modelling," Proc. 12th Int'l Conf. Artificial Intelligence in Education Aied (ICAIED), pp. 694-701, 2005.
[32] R. Calvo, N. Carroll, and R. Ellis, "Curriculum Central: A Portal for the Academic Enterprise," Int'l J. Continuing Eng. Education and Life Long Learning, vol. 17, no. 1, pp. 43-56, 2007.
[33] S. Bull and P. Gardner, "Highlighting Learning Across a Degree within an Independent Open Learner Model," Proc. Conf. Artificial Intelligence in Education: Building Learning Systems That Care: From Knowledge Representation to Affective Modelling (AIED), vol. 200, pp. 275-282, 2009.
[34] R. Raitman, N. Augar, and W. Zhou, "Employing Wikis for Online Collaboration in the E-Learning Environment: Case Study," Proc. Third Int'l Conf. Information Technology and Applications (ICITA '05), vol. 2, pp. 142-146, 2005.
[35] L. Lockyer and J. Patterson, "Integrating Social Networking Technologies in Education: A Case Study of a Formal Learning Environment," Proc. IEEE Eight Int'l Conf. Advanced Learning Technologies (ICALT '08), pp. 529-533, 2008.
[36] T. Tan and T. Liu, "The Mobile-Based Interactive Learning Environment (Mobile) and a Case Study for Assisting Elementary School English Learning," Proc. IEEE Int'l Conf. Advanced Learning Technologies, pp. 530-534, 2004.
[37] A. Ausserhofer, "Web Based Teaching and Learning: A Panacea?" IEEE Comm. Magazine, vol. 37, no. 3, pp. 92-96, Mar. 1999.
[38] R. Gluga, J. Kay, and T. Lever, "Modeling Long Term Learning of Generic Skills," Intelligent Tutoring Systems, V. Aleven, J. Kay, and J. Mostow, eds., vol. 6094, pp. 85-94, Springer, 2010.
[39] B.S. Bloom, Handbook on Formative and Summative Evaluation of Student Learning. McGraw-Hill, 1971.
[40] S. Morra, C. Gobbo, Z. Marini, and R. Sheese, Cognitive Development: Neo-Piagetian Perspectives. Psychology, 2007.
[41] W. Robley, S. Whittle, and D. Murdoch-Eaton, "Mapping Generic Skills Curricula: A Recommended Methodology," J. Further and Higher Education, vol. 29, no. 3, pp. 221-231, 2005.
[42] J. Sumsion and J. Goodfellow, "Identifying Generic Skills through Curriculum Mapping: A Critical Evaluation," Higher Education Research & Development, vol. 23, no. 3, pp. 329-346, 2004.
[43] J. Van den Akker, "Curriculum Perspectives: An Introduction," Curriculum Landscapes and Trends, J. Van den Akker, W. Kuiper, and U. Hameyer, eds., pp. 1-10, Kluwer Academic, 2003.
[44] J. Biggs, "Enhancing Teaching through Constructive Alignment," Higher Education, vol. 32, no. 3, pp. 347-364, 1996.
[45] J. Biggs and C. Tang, Teaching for Quality Learning at University, third ed. McGraw-Hill/Soc. for Research into Higher Education & Open Univ. Press, 2007.
[46] B. Oliver, S. Ferns, B. Whelan, and L. Lilly, "Mapping the Curriculum for Quality Enhancement: Refining a Tool and Processes for the Purpose of Curriculum Renewal," Proc. Quality in Uncertain Times, p. 80, 2010.
[47] D. Woodhouse, "When Will Australians Get a Proper Perspective and a Proper Standard?" Australian Financial Rev. Higher Education Conference - From Revolution to Higher Achievement - Driving Reform through Innovative Policy and Finance, when_will_australians_get_a_proper_ perspective_and_a_proper_standard.pdf , 2010.
[48] C. Kiu and C. Lee, "Ontology Mapping and Merging through OntoDNA for Learning Object Reusability," J. Educational Technology and Soc., vol. 9, no. 3, p. 27, 2006.
[49] T. Pedersen, S. Patwardhan, and J. Michelizzi, "WordNet::Similarity: Measuring the Relatedness of Concepts," Proc. Demonstration Papers at HLT-NAACL, pp. 38-41, 2004.
[50] D. Gasevic, A. Zouaq, C. Torniai, J. Jovanovic, and M. Hatala, "An Approach to Folksonomy-Based Ontology Maintenance for Learning Environments," IEEE Trans. Learning Technologies, vol. 4, no. 4, pp. 301-314, Oct.-Dec. 2011.
[51] S. Barrie, "Understanding What We Mean by the Generic Attributes of Graduates," Higher Education, vol. 51, no. 2, pp. 215-241, 2006.
[52] S. Barrie, C. Hughes, and C. Smith, "The National Graduate Attributes Project: Integration and Assessment of Graduate Attributes in Curriculum," The Univ. of Sydney, 2009.
159 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool