This Article 
 Bibliographic References 
 Add to: 
Second 2012 (vol. 5 no. 2)
pp. 143-156
M. J. Weal, Electron. & Comput. Sci. Dept., Univ. of Southampton, Southampton, UK
D. T. Michaelides, Electron. & Comput. Sci. Dept., Univ. of Southampton, Southampton, UK
K. Page, Electron. & Comput. Sci. Dept., Univ. of Southampton, Southampton, UK
David C. De Roure, Oxford e-Res. Centre, Univ. of Oxford, Oxford, UK
E. Monger, Fac. of Health Sci., Southampton, UK
M. Gobbi, Fac. of Health Sci., Southampton, UK
Skills-based learning environments are used to promote the acquisition of practical skills as well as decision making, communication, and problem solving. It is important to provide feedback to the students from these sessions and observations of their actions may inform the assessment process and help researchers to better understand the learning process. Through a series of prototype demonstrators, we have investigated the use of semantic annotation in the recording and subsequent understanding of such simulation environments. Our Semantic Web approach is outlined and conclusions drawn as to the suitability of different annotation methods and their combination with ubiquitous computing techniques to provide novel mechanisms for both student feedback and increased understanding of the learning environment.

[1] M. Gobbi, E. Monger, G. Watkinson, A. Spencer, M. Weaver, J. Lathlean, and S. Bryant, "Virtual Interactive Practice: A Strategy to Enhance Learning and Competence in Health Care Students," Proc. Medinfo, pp. 874-878, 2004.
[2] M. Seropian, K. Brown, J.S. Gavilanes, and B. Driggers, "Simulation: Not Just a Manikin," J. Nursing Education, vol. 43, no. 4, pp. 164-169, 2004.
[3] R. Hays, H. Davies, J. Beard, L. Caldon, E. Famer, and P. Fincane, "Selecting Performance Assessment Methods for Experienced Physicians," Medical Education, vol. 36, pp. 910-917, 2002.
[4] T. Blackburn and C. Sadler, "The Role of Human Simulators in Health-Care Training," British J. Hospital Medicine, vol. 64, no. 11, pp. 677-681, 2004.
[5] T. D. of Health, "Delivery 21st Century IT Support for the NHS: National Strategic Programme," technical report, The Stationary Office, June 2002.
[6] M. Gobbi and E. Monger, "Using Web Based Multimedia, Simulated and Virtual Practice to Assess Students Professional Practice Skills," technical report, HEA, 2008.
[7] M. Hatala, R. Wakkary, and L. Kalantari, "Rules and Ontologies in Support of Real-Time Ubiquitous Application," J. Web Semantics: Science, Services and Agents on the World Wide Web, vol. 3, pp. 5-22, 2005.
[8] G. Hughes, H. Mills, D. De Roure, J. Frey, L. Moreau, M.C. schraefel, G. Smith, and E. Zaluska, "The Semantic Smart Laboratory: A System for Supporting the Chemical Escientist," Organic and Biomolecular Chemistry, vol. 2, pp. 1-10, 2004.
[9] R. Masuoka, B. Parsia, and Y. Labrou, "Task Computing—The Semantic Web Meets Pervasive Computing," Proc. Second Int'l Semantic Web Conf., pp. 866-881, Oct. 2003.
[10] H. Chen, F. Perich, T. Finin, and A. Joshi, "SOUPA: Standard Ontology for Ubiquitous and Pervasive Applications," Proc. Int'l Conf. Mobile and Ubiquitous Systems, pp. 258-267, 2004.
[11] K. Grønbæk, P.P. Vestergaard, and P. Ørbæk, "Towards Geo-Spatial Hypermedia: Concepts and Prototype Implementation," Proc. 13th ACM Conf. Hypertext and Hypermedia, pp. 117-126, 2002.
[12] R. Ballagas, M. Ringel, M. Stone, and J. Borchers, "Istuff: A Physical User Interface Toolkit for Ubiquitous Computing Environments," Proc. SIGCHI Conf. Human Factors in Computing Systems (CHI '03), pp. 537-544, Apr. 2003.
[13] L. G, "Urban Tapestries: Wireless Networking, Public Authoring and Social Knowledge," Personal Ubiquitous Computing, vol. 7, nos. 3/4, pp. 169-175, July 2003.
[14] P. Pan, C. Kastner, D. Crow, and G. Davenport, "M-Studio: An Authoring Application for Context-Aware Multimedia," Proc. 10th ACM Int'l Conf. Multimedia, pp. 351-354, Dec. 2002.
[15] Y. Li, J.I. Hong, and J.A. Landay, "Topiary: A Tool for Prototyping Location-Enhanced Applications," Proc. Symp. User Interface Software and Technology (UIST '04), pp. 217-226, Oct. 2004.
[16] G. Iacucci, J. Kela, and P. Pehkonen, "Computational Support to Record and Re-Experience Visits," Personal and Ubiquitous Computing, vol. 8, pp. 100-109, 2004.
[17] R. Pea and R. Lindgren, "Video Collaboratories for Research and Education: An Analysis of Collaboration Design Patterns," IEEE Trans. Learning Technologies, vol. 1, no. 4, pp. 235-247, Oct.-Dec. 2008.
[18] H. Ogata, T. Misumi, T. Matsuka, M.M. El-Bishouty, and Y. Yano, "A Framework for Capturing, Sharing and Comparing Learning Experiences in a Ubiquitous Learning Environment," Research and Practice in Technology, vol. 3, no. 3, pp. 297-312, 2008.
[19] L. Ballan, M. Bertini, A. Del Bimbo, L. Seidenari, and G. Serra, "Event Detection and Recognition for Semantic Annotation of Video," Multimedia Tools and Applications, vol. 51, pp. 279-302, 2011.
[20] D. Murray, J. Boulet, J. Kras, J. Woodhouse, M. Thomas, and J. McAllister, "Acute Care Skills in Anaesthesia Practice: A Simulation Based Student Performance Assessment," Anaesthesiology, vol. 101, no. 5, pp. 1084-1095, 2004.
[21] R. Kneebone, D. Nestel, F. Yadollahi, R. Brown, C. Nolan, J.D.H. Brenton, C. Moulton, J. Archer, and A. Darzi, "Assessing Procedural Skills in Context: Exploring the Feasibility of an Integrated Procedural Performance Instrument (IPPI)," Medical Education, vol. 40, pp. 1105-1114, 2006.
[22] J. DiGiacomo, W. Hoff, M. Rotondo, K. Martin, D. Kauder, H. Anderson, G. Phillips, and W. Schwab, "Barrier Precautions in Trauma Resuscitation: Real-Time Analysis Utilising Videotape Review," Am. J. Emergency Medicine, vol. 15, no. 1, pp. 34-39, 1997.
[23] P. Ram, R. Grol, J. Rethans, B. Schouten, C. van der Vleuten, and A. Kester, "Assessment of General Practitioners by Video Observation of Communicative and Medical Performance in Daily Practice: Issues of Validity, Reliability and Feasibility," Medical Education, vol. 33, pp. 447-454, 1999.
[24] P. Vivekananda-Schmidt, M. Lewis, D. Coady, C. Morley, L. Kay, D. Walker, and A. Hassell, "Exploring the Use of Videotaped Objective Structured Clinical Examination in the Assessment of Joint Examination Skills of Medical Students," Arthritis and Rheumatism, vol. 57, no. 5, pp. 869-876, 2007.
[25] T. Berners-Lee, J. Hendler, and O. Lassila, "The Semantic Web: Scientific American," Scientific Am., May 2001.
[26] N. Shadbolt, T. Berners-Lee, and W. Hall, "The Semantic Web Revisited," IEEE Intelligent Systems, vol. 21, no. 3, pp. 96-101, July 2006.
[27] T. Strang and C. Linnhoff-Popien, "A Context Modeling Survey," Proc. First Int'l Workshop Advanced Context Modelling, Reasoning and Management, Sept. 2004.
[28] I. Millard, D.D. Roure, and N. Shadbolt, "Contextually Aware Information Delivery in Pervasive Computing Environments," Proc. Location and ContextAwareness, pp. 189-197, Jan. 2005.
[29] O. Lassila and M. Adler, "Semantic Gadgets: Ubiquitous Computing Meets the Semantic Web," Spinning the Semantic Web, D. Fensel, ed., MIT, pp. 363-376, 2003.
[30] K.R. Page, D. Cruickshank, and D.D. Roure, "It's About Time: Link Streams as Continuous Metadata," Proc. 12th ACM Conf. Hypertext and Hypermedia (Hypertext '01), pp. 93-102, Aug. 2001.
[31] K.R. Page, D.T. Michaelides, S.J.B. Shum, Y.-H. Chen-Burger, J. Dalton, D.C. De Roure, M. Eisenstadt, S. Potter, N.R. Shadbolt, A. Tate, M. Bachler, and J. Komzak, "Collaboration in the Semantic Grid: A Basis for E-learning," Applied Artificial Intelligence, vol. 19, nos. 9/10, pp. 881-904, Nov. 2005.
[32] M.J. Weal, D.T. Michaelides, D.E. Millard, D.C.D. Roure, K. Howland, and G. Fitzpatrick, "Card Based Metaphor for Organising Pervasive Educational Experiences," Proc. IEEE Fifth Int'l Conf. Pervasive Computing and Comm. Workshops (PERCOMW '07), pp. 19-23, 2007.
[33] D. Brickley and L. Miller, "FOAF Vocabulary Specification," technical report, WC3, 2005.
[34] T. Tiropanis, H. Davis, D. Millard, and M. Weal, "Semantic Technologies for Learning and Teaching in the Web 2.0 Era—A Survey," Proc. Society On-Line (WebSci '09), http://eprints.ecs., 2009.
[35] P. Anderson, "What Is Web 2.0? Ideas, Technologies and Implications for Education," technical report, JISC Technology and Standards Watch, Feb. 2007.
[36] J. Ohler, "The Semantic Web in Education—What Happens When the Read-Write Web Gets Smart Enough to Help Us Organize and Evaluate the Information it Provides?" EDUCAUSE Quarterly Magazine, no. 4, 2008.
[37] J.J. Carroll, I. Dickinson, C. Dollin, D. Reynolds, A. Seaborne, and K. Wilkinson, "Jena: Implementing the Semantic Web Recommendations," Proc. 13th Int'l World Wide Web Conf. Alternate Track Papers and Posters (WWW Alt. '04), pp. 74-83, 2004.
[38] T. Young, S. Brailsford, C. Connell, R. Davies, P. Harper, and J.H. Klein, "Using Industrial Processes to Improve Patient Care," BMJ, vol. 328, no. 7432, pp. 162-164, 2004.
[39] S.C. Brailsford, "Advances and Challenges in Healthcare Simulation Modeling: Tutorial," Proc. 39th Conf. Winter Simulation (WSC '07), pp. 1436-1448, 2007.
[40] C. Roberts, V. Wass, R. Jones, S. Sarangi, and A. Gillett, "A Discourse Analysis Study of Good and Poor Communication in an Osce: A Proposed New Framework for Teaching Students," Medical Education, vol. 37, no. 3, pp. 192-201, 2003.
[41] J.E. Bardram and C. Bossen, "A Web of Coordinative Artifacts: Collaborative Work at a Hospital Ward," Proc. Int'l ACM SIGGROUP Supporting Group Work (GROUP '05), pp. 168-176, 2005.
[42] J. Favela, M. Tentori, L.A. Castro, V.M. Gonzalez, E.B. Moran, and A.I. Martinez-Garcia, "Estimating Hospital Work Activities in Context-Aware Healthcare Applications," Proc. First Int'l Conf. Pervasive Computing Technologies for Healthcare, pp. 1-10, 2006.
[43] J.A. Muras, V. Cahill, and E.K. Stokes, "A Taxonomy of Pervasive Healthcare Systems," Proc. First Int'l Conf. Pervasive Computing Technologies for Healthcare, pp. 1-10, 2006.
[44] M. Gustafsson, G. Falkman, F. Lindahl, and O. Torgersson, "Enabling an Online Community for Sharing Oral Medicine Cases Using Semantic Web Technologies," Proc. Fifth Int'l Semantic Web Conf. (ISWC '06), pp. 820-832, 2006.
[45] V. Kashyap, A. Morales, T. Hongsermeier, and Q. Li, "Definitions Management: A Semantics-Based Approach for Clinical Documentation in Healthcare Delivery," Proc. Int'l Semantic Web Conf. (ISWC '05), pp. 887-901, 2005.
[46] R. Jain, "Eventweb: Developing a Human-Centered Computing System," Computer, vol. 41, no. 2, pp. 42-50, Feb. 2008.
[47] F. Nack and W. Putz, "Designing Annotation Before it's Needed," Proc. Ninth ACM Int'l Conf. Multimedia (MULTIMEDIA '01), pp. 251-260, 2001.
[48] M. Fraser, J. Hindmarsh, K. Best, C. Heath, G. Biegel1, C. Greenhalgh, and S. Reeves, "Remote Collaboration Over Video Data: Towards Real-Time E-social Science," Computer Supported Cooperative Work (CSCW), vol. 15, no. 4, pp. 257-279, Aug. 2006.
[49] M.J. Weal, D.T. Michaelides, D.C. De Roure, M. Gobbi, E. Monger, and J.W. McDonald, "Semantic Annotation in Ubiquitous Healthcare Skills-Based Learning Environments," Proc. Workshop Semantic Web in Ubiquitous Healthcare (ISWC), Nov. 2007.
[50] J.W. McDonald, M.O. Gobbi, D. Michaelides, E. Monger, M.J. Weal, and D. De Roure, "Grid-Enabled Data Collection and Analysis: Semantic Annotation in Skills-Based Learning," Proc. Fourth Int'l Conf. E-Social Science, June 2008.
[51] L. Coyle, S. Neely, P. Nixon, and A. Quigley, "Sensor Aggregation and Integration in Healthcare Location Based Services," Proc. Pervasive Health Conf. and Workshops, pp. 1-4, 2006.
[52] A.L. Liu, H. Hile, G. Borriello, H. Kautz, B. Ferris, P.A. Brown, M. Harniss, and K. Johnson, "Implications for Location Systems in Indoor Wayfinding for Individuals with Cognitive Impairments," Proc. Pervasive Health Conf. and Workshops, pp. 1-5, 2006.
[53] J. Bravo, R. Hervás, C. Fuentes, G. Chavira, and S.W. Nava, "Tagging for Nursing Care," Proc. Second Int'l Conf. Pervasive Computing Technologies for Healthcare, pp. 305-307, 2008.
[54] C. Greenhalgh, A. French, P. Tennant, J. Humble, and A. Crabtree, "From Replaytool to Digital Replay System," Proc. Third Int'l Conf. E-Social Science, Oct. 2007.
[55] G. Reitmayr and D. Schmalstieg, "Location Based Applications for Mobile Augmented Reality," Proc. Fourth Australasian User Interface Conf. User Interfaces (AUIC '03), pp. 65-73, 2003.
[56] D. Chen, J. Yang, R. Malkin, and H.D. Wactlar, "Detecting Social Interactions of the Elderly in a Nursing Home Environment," ACM Trans. Multimedia Computing Comm., and Applications, vol. 3, no. 1, p. 6, 2007.
[57] M. Gobbi and E. Monger, "Using Web Based Multimedia, Simulated and Virtual Practice to Assess Students? Professional Practice Skills," technical report, HEA HSP Centre and Univ. of Southampton, 2008.

Index Terms:
Cameras,Semantics,Ontologies,Resource description framework,Educational institutions,Vocabulary,case study.,Semantic annotation,Semantic Web,ubiquitous computing
M. J. Weal, D. T. Michaelides, K. Page, David C. De Roure, E. Monger, M. Gobbi, "Semantic Annotation of Ubiquitous Learning Environments," IEEE Transactions on Learning Technologies, vol. 5, no. 2, pp. 143-156, Second 2012, doi:10.1109/TLT.2011.37
Usage of this product signifies your acceptance of the Terms of Use.