The Community for Technology Leaders
RSS Icon
Issue No.06 - June (2012 vol.24)
pp: 961-974
Liming Chen , University of Ulster, Newtownabbey
Chris D. Nugent , University of Ulster, Newtownabbey
Hui Wang , University of Ulster, Newtownabbey
This paper introduces a knowledge-driven approach to real-time, continuous activity recognition based on multisensor data streams in smart homes. The approach goes beyond the traditional data-centric methods for activity recognition in three ways. First, it makes extensive use of domain knowledge in the life cycle of activity recognition. Second, it uses ontologies for explicit context and activity modeling and representation. Third and finally, it exploits semantic reasoning and classification for activity inferencing, thus enabling both coarse-grained and fine-grained activity recognition. In this paper, we analyze the characteristics of smart homes and Activities of Daily Living (ADL) upon which we built both context and ADL ontologies. We present a generic system architecture for the proposed knowledge-driven approach and describe the underlying ontology-based recognition process. Special emphasis is placed on semantic subsumption reasoning algorithms for activity recognition. The proposed approach has been implemented in a function-rich software system, which was deployed in a smart home research laboratory. We evaluated the proposed approach and the developed system through extensive experiments involving a number of various ADL use scenarios. An average activity recognition rate of 94.44 percent was achieved and the average recognition runtime per recognition operation was measured as 2.5 seconds.
Activity recognition, activity ontologies, smart home, ontological modeling, semantic reasoning.
Liming Chen, Chris D. Nugent, Hui Wang, "A Knowledge-Driven Approach to Activity Recognition in Smart Homes", IEEE Transactions on Knowledge & Data Engineering, vol.24, no. 6, pp. 961-974, June 2012, doi:10.1109/TKDE.2011.51
[1] M. Chan, D. Estève, and C. Escriba, "A Review of Smart Homes—Present State and Future Challenges," Computer Methods and Programs in Biomedicine, vol. 91, no. 1, pp. 55-81, 2008.
[2] D. Cook, H. Hagras, V. Callaghan, and A. Helal, "Making Our Environments Intelligent," J. Pervasive and Mobile Computing, vol. 5, pp. 556-557, 2009.
[3] S. Helal, W. Mann, H. El-Zabadani, J. King, Y. Kaddoura, and E. Jansen, "The Gator Tech Smart House: A Programmable Pervasive Space," Computer, vol. 38, no. 3, pp. 50-60, Mar. 2005.
[4] D.J. Cook and P. Rashidi, "Keeping the Resident in the Loop: Adapting the Smart Home to the User," IEEE Trans. Systems, Man, and Cybernetics J., Part A, vol. 39, no. 5, pp. 949-959, Sept. 2009.
[5] The Netwell Centre, Technologies for Ageing in Place, http:/, 2012.
[6] D. Cook and S.K. Das, "How Smart Are Our Environments? An Updated Look at the State of the Art," J. Pervasive and Mobile Computing, vol. 3, no. 2, pp. 53-73, 2007.
[7] L. Chen, C. Nugent, M. Mulvenna, D. Finlay, and X. Hong, "A Logical Framework for Behaviour Reasoning and Assistance in a Smart Home," Int'l J. Assistive Robotics and Mechatronics, vol. 9, no. 4, pp. 20-34, 2008.
[8] M. Philipose, K.P. Fishkin, M. Perkowitz, D.J. Patterson, D. Fox, H. Kautz, and D. Hahnel, "Inferring Activities from Interactions with Objects," IEEE Pervasive Computing, vol. 3, no. 4, pp. 50-57, Oct.-Dec. 2004.
[9] W. Geyer, H. Richter, and G.D. Abowd, "Towards a Smarter Meeting Record—Capture and Access of Meetings Revisited," Multimedia Tools and Applications, vol. 27, no. 3, pp. 393-410, 2005.
[10] Z. Yu and Y. Nakamura, "Smart Meeting Systems: A Survey of State-of-the-Art and Open Issues," ACM Computing Surveys, vol. 42, no. 2, Article 8, 2010.
[11] J. Hoey and J. James, "Little Value-Directed Human Behavior Analysis from Video Using Partially Observable Markov Decision Processes," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 7, pp. 1118-1132, July 2007.
[12] T.B. Moeslund, A. Hilton, and V. Krüger, "A Survey of Advances in Vision-Based Human Motion Capture and Analysis," Computer Vision Image Understanding, vol. 104, no. 2, pp. 90-126, 2006.
[13] L. Fiore, D. Fehr, R. Bodor, A. Drenner, G. Somasundaram, and N. Papanikolopoulos, "Multi-Camera Human Activity Monitoring," J. Intelligent and Robotic Systems, vol. 52, no. 1, pp. 5-43, 2008.
[14] P. Turaga, R. Chellappa, V.S. Subrahmanian, and O. Udrea, "Machine Recognition of Human Activities: A Survey," IEEE Trans. Circuits and Systems for Video Technology, vol. 18, no. 11, pp. 1473-1488, Nov. 2008.
[15] S.W. Lee and K. Mase, "Activity and Location Recognition Using Wearable Sensors," IEEE Pervasive Computing, vol. 1, no. 3, pp. 24-32, 2002.
[16] J. Parkka, M. Ermes, P. Korpipaa, J. Mantyjarvi, J. Peltola, and I. Korhonen, "Activity Classification Using Realistic Data from Wearable Sensors," IEEE Trans. Information Technology in Biomedicine, vol. 10, no. 1, pp. 119-128, Jan. 2006.
[17] D. Sanchez and M. Tentori, "Activity Recognition for the Smart Hospital," IEEE Intelligent Systems, vol. 23, no. 2, pp. 50-57, Mar./Apr. 2008.
[18] L. Bao and S. Intille, "Activity Recognition from Userannotated Acceleration Data," Proc. Int'l Conf. Pervasive Computing, pp. 1-17, 2004.
[19] O. Brdiczka, J.L. Crowley, and P. Reignier, "Learning Situation Models in a Smart Home," IEEE Trans. Systems, Man and Cybernetics—Part B: Cybernetics, vol. 39, no. 1, pp. 56-63, Feb. 2009.
[20] J. Hoey and P. Poupart, "Solving POMDPs with Continuous or Large Discrete Observation Spaces," Proc. Int'l Joint Conf. Artificial Intelligence, pp. 1332-1338, 2005.
[21] B. Bouchard and S. Giroux, "A Smart Home Agent for Plan Recognition of Cognitively-Impaired Patients," J. Computers, vol. 1, no. 5, pp. 53-62, 2006.
[22] D. Preuveneers, J. Van den Bergh, and K. De Bosschere, "Towards an Extensible Context Ontology for Ambient Intelligence," Proc. Second European Symp. Ambient Intelligence (EUSAI '04), pp. 148-159, 2004.
[23] A.B. James, "Activities of Daily Living and Instrumental Activities of Daily Living," Willard and Spackman's Occupational Therapy, E.B. Crepeau, E.S. Cohn, B.B. Schell, eds., pp. 538-578, Lippincott, Williams and Wilkins, 2008.
[24] V. Wadley, O. Okonkwo, M. Crowe, and L.A. Ross-Meadows, "Mild Cognitive Impairment and Everyday Function: Evidence of Reduced Speed in Performing Instrumental Activities of Daily Living," Am. J. Geriatr Psychiatry, vol. 16, no. 5, pp. 416-424, 2007.
[25] U. Akdemir and P. Turaga, "An Ontology Based Approach for Activity Recognition from Video," Proc. 16th ACM Int'l Conf. Multimedia, pp. 709-712, 2008.
[26] E.M. Tapia and S. Intille, "Real-Time Recognition of Physical Activities and Their Intensities Using Wireless Accelerometers and a Heart Rate Monitor," Proc. Int'l Symp. Wearable Computers (ISWC), pp. 1-4, 2007.
[27] N. Yamada, K. Sakamoto, G. Kunito, Y. Isoda, K. Yamazaki, and S. Tanaka, "Applying Ontology and Probabilistic Model to Human Activity Recognition from Surrounding Things," IPSJ Digital Courier, vol. 3, pp. 506-517, 2007.
[28] G. Okeyo, L. Chen, H. Wang, and R. Sterritt, "Ontology-Enabled Activity Learning and Model Evolution in Smart Homes," Proc. Seventh Int'l Conf. Ubiquitous Intelligence and Computing, 2010.
[29] F. Baader, I. Horrocks, and U. Sattler, "Description Logics," Handbook of Knowledge Representation, F. van Harmelen, V. Lifschitz, and B. Porter, eds., Elsevier, 2007.
[30] D. Tsarkov and I. Horrocks, "FaCT++ Description Logic Reasoner: System Description," Proc. Int'l Joint Conf. Automated Reasoning (IJCAR '06), pp. 292-297, 2006.
[31] I. Horrocks and U. Sattler, "A Tableau Decision Procedure for SHOIQ," J. Automated Reasoning, vol. 39, no. 3, pp. 249-276, 2007.
[32] B. Motik, R. Shearer, and I. Horrocks, "Hypertableau Reasoning for Description Logics," J. Artificial Intelligence Research, vol. 36, pp. 165-228, 2009.
[33] L. Chen and C.D. Nugent, "Ontology-Based Activity Recognition in Intelligent Pervasive Environments," Int'l J. Web Information Systems, vol. 5, no. 4, pp. 410-430, 2009.
[34] Semantic Web/RDF Liberary for C#.NET, http://razor.occams. info/codesemweb/, 2012.
[35] SPARQL Query Language for RDF,, 2012.
[36] Euler Proof Mechanism,, 2012.
[37] C.D. Nugent, M. Mulvenna, X. Hong, and S. Devlin, "Experiences in the Development of a Smart Lab," The Int'l J. Biomedical Eng. and Technology, vol. 2, no. 4, pp. 319-331, 2009.
[38] The Protégé Framework, http:/, 2012.
31 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool