The Community for Technology Leaders
RSS Icon
Issue No.03 - Third Quarter (2012 vol.5)
pp: 275-289
M. Hatala , Sch. of Interactive Arts & Technol., Simon Fraser Univ., Surrey, BC, Canada
D. Gašević , Sch. of Comput. & Inf. Syst., Athabasca Univ., Athabasca, AB, Canada
M. Siadaty , Sch. of Interactive Arts & Technol., Simon Fraser Univ., Surrey, BC, Canada
J. Jovanovic , Fac. of Organizational Sci., Univ. of Belgrade, Belgrade, Serbia
C. Torniai , Oregon Dev. Group, Oregon Health & Sci. Univ., Portland, OR, USA
Recent research in Technology-Enhanced Learning (TEL) demonstrated several important benefits that semantic technologies can bring to the TEL domain. An underlying assumption for most of these research efforts is the existence of a domain ontology. The second unspoken assumption follows that educators will build domain ontologies for their courses. However, ontologies are hard to build, especially for not-tech-savvy users. Tools for ontology extraction from text aim to overcome this problem. We have conducted an empirical study with educators, both from Information Technology (IT) and non-IT domains, where they used current ontology extraction tools to build domain ontologies for their courses from their existing course material. Based on the obtained study results we have drawn conclusions about the existing ontology extraction tools and provided recommendations for their future development so that they can be beneficial for the TEL domain.
Ontologies, Electronic learning, Educational institutions, Semantic Web, Measurement, Semantics, Usability,evaluation/methodology, Ontologies, Electronic learning, Educational institutions, Semantic Web, Measurement, Semantics, Usability, general, Knowledge representation formalisms and methods, ontologies
M. Hatala, D. Gašević, M. Siadaty, J. Jovanovic, C. Torniai, "Ontology Extraction Tools: An Empirical Study with Educators", IEEE Transactions on Learning Technologies, vol.5, no. 3, pp. 275-289, Third Quarter 2012, doi:10.1109/TLT.2012.9
[1] V. Devedzic, Semantic Web and Education. Springer, 2006.
[2] Semantic Web Technologies for E-Learning, D. Dicheva, R. Mizoguchi, and J. Greer, eds. IOS Press, 2009.
[3] Proc. Linked Learning '11: The First Int'l Workshop E-Learning Approaches for the Linked Data Age, Co-Located with the Eighth Extended Semantic Web Conf., S. Dietze, M. d'Aquin, D. Gašević, M. Sicilia, eds., Publications/CEUR-WSVol-717, 2011.
[4] D. Allemang and J. Hendler, Semantic Web for the Working Ontologist: Effective Modeling in RDFS and OWL. Morgan Kaufmann, 2008.
[5] Z. Jeremic, J. Jovanovic, and D. Gašević, "Personal Learning Environments on Social Semantic Web," Semantic Web J., accepted, default/filesswj183.pdf, 2012.
[6] A. Naeve, M. Lytras, W. Nejdl, N. Balacheff, and J. Hardin, "Special Issue on Advances of the Semantic Web for e-Learning: Expanding Learning Frontiers," British J. Educational Technology, vol. 37, no. 3, pp. 321-330, 2006.
[7] P. Dolog and W. Nejdl, "Semantic Web Technologies for the Adaptive Web," The Adaptive Web, pp. 697-719, Springer, 2007.
[8] D. Gašević, J. Jovanovic, and V. Devedzic, "Ontology-Based Annotation of Learning Object Content," Interactive Learning Environments, vol. 15, no. 1, pp. 1-26, 2007.
[9] J. Jovanovic, D. Gašević, and V. Devedzic, "TANGRAM for Personalized Learning Using Semantic Web Technologies," J. Emerging Technologies in Web Intelligence, vol. 1, no. 1, pp. 6-21, 2009.
[10] J. Jovanovic et al., "Using Semantic Web Technologies for the Analysis of Learning Content," IEEE Internet Computing, vol. 11, no. 5, pp. 45-53, Sept./Oct. 2007.
[11] J. Jovanovic, C. Knight, D. Gašević, and G. Richards, "Ontologies for Effective Use of Context in e-Learning Settings," Educational Technology & Soc., vol. 10, no. 3, pp. 47-59, 2007.
[12] L. Ali, M. Hatala, D. Gašević, and J. Jovanovic, "A Qualitative Evaluation of Evolution of a Learning Analytics Tool," Computers & Education, vol. 58, no.1, pp. 470-489, 2012.
[13] Z. Jeremic, J. Jovanovic, and D. Gašević, "An Environment for Project-Based Collaborative Learning of Software Design Patterns," Int'l J. Eng. Education, vol. 27, no. 1, pp. 41-51, 2011.
[14] P. Cimiano, J. Völker, and R. Studer, "Ontologies on Demand? - A Description of the State-of-the-Art, Applications, Challenges and Trends for Ontology Learning from Text Information," Wissenschaft und Praxis, vol. 57, nos. 6/7, pp. 315-320, 2006.
[15] A. Zouaq, D. Gašević, and M. Hatala, "Towards Open Ontology Learning and Filtering," Information Systems, vol. 36, no. 7, pp. 1064-1081, 2011.
[16] J. Park, W. Cho, and S. Rho, "Evaluating Ontology Extraction Tools Using a Comprehensive Evaluation Framework," Data & Knowledge Eng., vol. 69, pp. 1043-1061, 2010.
[17] K. Siorpaes and E. Simperl, "Human Intelligence in the Process of Semantic Content Creation," World Wide Web, vol. 13, nos. 1/2, pp. 33-59, 2010.
[18] L.J. Stojanovic, S. Staab, and R. Studer, "eLearning in the Semantic Web," Proc. World Conf. WWW and the Internet, pp. 325-334, 2003.
[19] P. Mohan and C. Brooks, "Engineering a Future for Web-Based Learning Objects," Proc. Int'l Conf. Web Eng., pp. 120-123, 2003.
[20] J. Brase and W. Nejdl, "Ontologies and Metadata for eLearning," Handbook on Ontologies, S. Staab and R. Studer eds., pp. 555-574, Springer, 2004.
[21] V. Dimitrova, R. Denaux, G. Hart, C. Dolbear, I. Holt, and A. Cohn, "Involving Domain Experts in Authoring OWL Ontologies," Proc. Seventh Int'l Semantic Web Conf., pp. 1-16, 2008.
[22] A. Zouaq and R. Nkambou, "Evaluating the Generation of Domain Ontologies in the Knowledge Puzzle Project," IEEE Trans. Knowledge and Data Eng., vol. 21, no. 11, pp. 1559-1572, Nov. 2009.
[23] A. Gomez-Perez and D. Manzano-Macho, "An Overview of Methods and Tools for Ontology Learning from Texts," The Knowledge Eng. Rev., vol. 19, no. 3, pp. 187-212, 2004.
[24] R. Denaux, C. Dolbear, G. Hart, V. Dimitrova, and A.G. Cohn, "Supporting Domain Experts to Construct Conceptual Ontologies: A Holistic Approach," J. Web Semantics, vol. 9, no. 2, pp. 113-127, 2011.
[25] A. Zouaq and R. Nkambou, "A Survey of Domain Ontology Engineering: Methods and Tools," Advances in Intelligent Tutoring Systems, Nkambou, Bourdeau, and Mizoguchi, eds., pp. 103-119, Springer, 2010.
[26] M. Hepp, K. Siorpaes, and D. Bachlechner, "Harvesting Wiki Consensus: Using Wikipedia Entries as Vocabulary for Knowledge Management," IEEE Internet Computing, vol. 11, no. 5, pp. 54-65, Sept./Oct. 2007.
[27] P. Cimiano and J. Voelker, "Text2onto-A Framework for Ontology Learning and Data-Driven Change Discovery," Proc. 10th Int'l Conf. Applications of Natural Language to Information Systems, pp. 227-238, 2005.
[28] B. Fortuna, M. Grobelnik, and D. Mladenic, OntoGen: Semi-Automatic Ontology Editor. HCI Int'l, July 2007.
[29] D.J. Mayhew, The Usability Engineering Lifecycle: A Practitioner's Handbook for User Interface Design. Morgan Kaufmann, 1999.
[30] M. Shamsfard, A.A. Barforoush, "The State of the Art in Ontology Learning: A Framework for Comparison," The Knowledge Eng. Rev., vol. 18, no. 4, pp. 293-316, 2003.
[31] M. Renner and E.T. Taylor-Powell, "Analyzing Qualitative Data. University of Winsconsin: Programme Development and Evaluation," g3658-12.pdf, 2003.
[32] U.H. Graneheim and B. Lundman, "Qualitative Content Analysis in Nursing Research: Concepts, Procedures and Measures to Achieve Trustworthiness," Nurse Education Today, vol. 24, pp. 105-112, 2004.
[33] N. Blaikie, Analysing Quantitative Data. Sage Publications, 2003.
[34] J. Carifio and R. Perla, "Resolving the 50-Year Debate Around Using and Misusing Likert Scales," Medical Education, vol. 42, no. 12, pp. 1150-1152, 2008.
[35] J. Carifio and R. Perla, "Ten Common Misunderstandings, Misconceptions, Persistent Myths and Urban Legends about Likert Scales and Likert Response Formats and Their Antidotes," J. Social Sciences, vol. 3, no. 3, pp. 106-116, 2007.
[36] J. Carifio, "Measuring Vocational Preferences: Ranking Versus Categorical Rating Procedures," Career Education Quarterly, vol. 3, no. 1, pp. 34-66, 1978.
[37] D. Gašević, A. Zouaq, C. Torniai, J. Jovanovic, and M. Hatala, "An Approach to Folksonomy-Based Ontology Maintenance for Learning Environments," IEEE Trans. Learning Technology, vol. 4, no. 4, pp. 301-314, Oct.-Dec. 2011.
[38] M. Siadaty, J. Jovanovic, K. Pata, T. Holocher-Ertl, D. Gašević, and N. Milikic, "A Semantic Web-Enabled Tool for Self-Regulated Learning in the Workplace," Proc. 11th IEEE Int'l Conf. Advanced Learning Technologies, pp. 66-70, 2011.
[39] H. Zhang, Y.F. Li, and H.B. Kuan Tan, "Measuring Design Complexity of Semantic Web Ontologies," J. Systems and Software, vol. 83, no. 5, pp. 803-814, 2010.
[40] M.E. Manso, M. Genero, and M. Piattini, "No-Redundant Metrics for UML Class Diagram Structural Complexity," Proc. 15th Int'l Conf. Advanced Information Systems Eng., pp. 127-142, 2003.
[41] E. Bagheri and D. Gašević, "Assessing the Maintainability of Software Product Line Feature Models Using Structural Metrics," Software Quality Control, vol. 19, no. 3, pp. 579-612, Sept. 2011.
[42] V. Basili, F. Shull, and F. Lanubile, "Building Knowledge through Families of Experiments," IEEE Trans. Software Eng., vol. 25, no. 4, pp. 435-437, July/Aug. 1999.
[43] P. Buitelaar, D. Olejnik, and M. Sintek, "OntoLT: A protégé Plug-in for Ontology Extraction from Text," Proc. Int'l Semantic Web Conf., pp. 31-44, 2003.
[44] A. Gal and G. Modica, "OntoBuilder: Fully Automatic Extraction and Consolidation of Ontologies from Web Sources," Proc. 20th Int'l Conf. Data Eng., 2004.
[45] T. Morita, N. Fukuta, N. Izumi, and T. Yamaguchi, "DODDLE-OWL: A Domain Ontology Construction Tool with OWL," Proc. Int'l Semantic Web Conf., pp. 537-551, 2006.
[46] O. Corcho, M. Fernandez, and A. Gomez-Perez, "Methodologies, Tools and Languages for Building Ontologies: Where Is the Meeting Point?," Data and Knowledge Eng., vol. 46, pp. 41-64, 2003.
[47] E. Simperl, M. Mochol, and T. Burger, "Achieving Maturity: the State of Practice in Ontology Engineering in 2009," Int'l J. Computer Science and Applications, vol. 7, no. 1, pp. 45-65, 2010.
[48] E. Simperl, C. Tempich, and D. Vrandečić, "A Methodology for Ontology Learning," Proc. Conf. Ontology Learning and Population: Bridging the Gap between Text and Knowledge, pp. 225-249, 2008.
295 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool