The Community for Technology Leaders
RSS Icon
Issue No.04 - April (2011 vol.23)
pp: 527-539
Diane J. Cook , Washington State University, Pullman
Parisa Rashidi , Washington State University, Pullman
Maureen Schmitter-Edgecombe , Washington State University, Pullman
The machine learning and pervasive sensing technologies found in smart homes offer unprecedented opportunities for providing health monitoring and assistance to individuals experiencing difficulties living independently at home. In order to monitor the functional health of smart home residents, we need to design technologies that recognize and track activities that people normally perform as part of their daily routines. Although approaches do exist for recognizing activities, the approaches are applied to activities that have been preselected and for which labeled training data are available. In contrast, we introduce an automated approach to activity tracking that identifies frequent activities that naturally occur in an individual's routine. With this capability, we can then track the occurrence of regular activities to monitor functional health and to detect changes in an individual's patterns and lifestyle. In this paper, we describe our activity mining and tracking approach, and validate our algorithms on data collected in physical smart environments.
Activity recognition, data mining, sequence mining, clustering, smart homes.
Diane J. Cook, Parisa Rashidi, Maureen Schmitter-Edgecombe, "Discovering Activities to Recognize and Track in a Smart Environment", IEEE Transactions on Knowledge & Data Engineering, vol.23, no. 4, pp. 527-539, April 2011, doi:10.1109/TKDE.2010.148
[1] B. Reisberg, S. Finkel, J. Overall, N. Schmidt-Gollas, S. Kanowski, H. Lehfeld, F. Hulla, S.G. Sclan, H.-U. Wilms, K. Heininger, I. Hindmarch, M. Stemmler, L. Poon, A. Kluger, C. Cooler, M. Bergener, L. Hugonot-Diener, P.H. Robert, and H. Erzigkeit, "The Alzheimer's Disease Activities of Daily Living International Scale (ADL-IS)," Int'l Psychogeriatrics, vol. 13, no. 2, pp. 163-181, 2001.
[2] V. Rialle, C. Ollivet, C. Guigui, and C. Hervé, "What Do Family Caregivers of Alzheimer's Disease Patients Desire in Smart Home Technologies? Contrasted Results of a Wide Survey," Methods of Information in Medicine, vol. 47, pp. 63-69, 2008.
[3] V.G. Wadley, O. Okonkwo, M. Crowe, and L.A. Ross-Meadows, "Mild Cognitive Impairment and Everyday Function: Evidence of Reduced Speed in Performing Instrumental Activities of Daily Living," Am. J. Geriatric Psychiatry, vol. 16, no. 5, pp. 416-424, May 2008.
[4] T.L. Hayes, M. Pavel, N. Larimer, I.A. Tsay, J. Nutt, and A.G. Adami, "Distributed Healthcare: Simultaneous Assessment of Multiple Individuals," IEEE Pervasive Computing, vol. 6, no. 1, pp. 36-43, Jan.-Mar. 2007.
[5] R. Wray and J. Laird, "Variability in Human Modeling of Military Simulations," Proc. Behavior Representation in Modeling and Simulation Conf., pp. 160-169, 2003.
[6] S. Szewcyzk, K. Dwan, B. Minor, B. Swedlove, and D. Cook, "Annotating Smart Environment Sensor Data for Activity Learning," Technology and Health Care, Special Issue on Smart Environments: Technology to Support Health Care, vol. 17, pp. 161-169, 2009.
[7] D.J. Cook and P. Rashidi, "The Resident in the Loop: Adapting the Smart Home to the User," IEEE Trans. Systems, Man, and Cybernetics, Part A: Systems and Humans, vol. 39, no. 5, pp. 949-959, Sept. 2009.
[8] D. Cook and S. Das, Smart Environments: Technology, Protocols and Applications. Wiley-Interscience, 2004.
[9] C. Wren and E. Munguia-Tapia, "Toward Scalable Activity Recognition for Sensor Networks," Proc. Workshop Location and Context-Awareness, pp. 218-235, 2006.
[10] D. Cook, M. Youngblood, I. Heierman, E.O.K. Gopalratnam, S. Rao, A. Litvin, and F. Khawaja, "Mavhome: An Agent-Based Smart Home," Proc. First IEEE Int'l Conf. Pervasive Computing and Comm., pp. 521-524, Mar. 2003.
[11] S. Helal, W. Mann, H. El-Zabadani, J. King, Y. Kaddoura, and E. Jansen, "The Gator Tech Smart House: A Programmable Pervasive Space," Computer, vol. 38, no. 3, pp. 50-60, Mar. 2005.
[12] F. Doctor, H. Hagras, and V. Callaghan, "A Fuzzy Embedded Agent-Based Approach for Realizing Ambient Intelligence in Intelligent Inhabited Environments," IEEE Trans. Systems, Man and Cybernetics, Part A: Systems and Humans, vol. 35, no. 1, pp. 55-65, Jan. 2005.
[13] G. Abowd and E. Mynatt, "Designing for the Human Experience in Smart Environments" Smart Environments: Technology, Protocols, and Applications, pp. 153-174, Wiley, 2004.
[14] T. Barger, D. Brown, and M. Alwan, "Health-Status Monitoring through Analysis of Behavioral Patterns," IEEE Trans. Systems, Man and Cybernetics, Part A: Systems and Humans, vol. 35, no. 1, pp. 22-27, Jan. 2005.
[15] H.K. Dieter, D. Fox, O. Etzioni, G. Borriello, and L. Arnstein, "An Overview of the Assisted Cognition Project," Proc. AAAI-2002 Workshop Automation as Caregiver: The Role of Intelligent Technology in Elder, 2002.
[16] A. Mihailidis, J. Barbenl, and G. Fernie, "The Efficacy of an Intelligent Cognitive Orthosis to Facilitate Handwashing by Persons with Moderate-to-Severe Dementia," Neuropsychological Rehabilitation, vol. 14, no. 1, pp. 135-171, 2004.
[17] M. Pollack, "Intelligent Technology for an Aging Population: The Use of AI to Assist Elders with Cognitive Impairment," AI Magazine, vol. 26, no. 2, pp. 9-24, 2005.
[18] I.P. Health, "Aging in Place," , 2007.
[19] U. Maurer, A. Smailagic, D. Siewiorek, and M. Deisher, "Activity Recognition and Monitoring Using Multiple Sensors on Different Body Positions," Proc. Int'l Workshop Wearable and Implantable Body Sensor Networks (BSN '06), pp. 113-116, Apr. 2006.
[20] J. Yin, Q. Yang, and J.J. Pan, "Sensor-Based Abnormal Human-Activity Detection," IEEE Trans. Knowledge and Data Eng., vol. 20, no. 8, pp. 1082-1090, Aug. 2008.
[21] E.M. Tapia, S.S. Intille, and K. Larson, "Activity Recognition in the Home Using Simple and Ubiquitous Sensors," Pervasive Computing, vol. 3001, pp. 158-175, 2004.
[22] M. Philipose, K.P. Fishkin, M. Perkowitz, D.J. Patterson, D. Fox, H. Kautz, and D. Hahnel, "Inferring Activities from Interactions with Objects," IEEE Pervasive Computing, vol. 3, no. 4, pp. 50-57, Oct.-Dec. 2004.
[23] D. Cook and M. Schmitter-Edgecombe, "Assessing the Quality of Activities in a Smart Environment," Methods of Information in Medicine, vol. 48, pp. 480-485, 2009.
[24] J. Yang, B.N. Schilit, and D.W. McDonald, "Activity Recognition for the Digital Home," Computer, vol. 41, no. 4, pp. 102-104, Apr. 2008.
[25] O. Brdiczka, P. Reignier, and J.L. Crowley, "Detecting Individual Activities from Video in a Smart Home," Proc. 11th Int'l Conf. Knowledge-Based and Intelligent Information and Eng. Systems (KES), pp. 363-370, 2007.
[26] G.D.B.K. Hensel and K. Courtney, "Defining Obtrusiveness in Home Telehealth Technologies: A Conceptual Framework," J. Am. Medical Informatics Assoc., vol. 13, pp. 428-431, 2006.
[27] C. Stauffer and W. Grimson, "Learning Patterns of Activity Using Real-Time Tracking," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 747-757, Aug. 2000.
[28] T. van Kasteren and B. Krose, "Bayesian Activity Recognition in Residence for Elders," Proc. Third IET Int'l Conf. Intelligent Environments (IE '07), pp. 209-212, Sept. 2007.
[29] T. Gu, Z. Wu, X. Tao, H. Pung, and J. Lu, "epSICAR: An Emerging Patterns Based Approach to Sequential, Interleaved and Concurrent Activity Recognition," Proc. IEEE Int'l Conf. Pervasive Computing and Comm., 2009.
[30] L. Liao, D. Fox, and H. Kautz, "Location-Based Activity Recognition Using Relational Markov Networks," Proc. Int'l Joint Conf. Artificial Intelligence, pp. 773-778, 2005.
[31] D. Sánchez, M. Tentori, and J. Favela, "Activity Recognition for the Smart Hospital," IEEE Intelligent Systems, vol. 23, no. 2, pp. 50-57, Mar./Apr. 2008.
[32] R. Agrawal and R. Srikant, "Mining Sequential Patterns," Proc. Int'l Conf. Data Eng., pp. 3-14, 1995.
[33] J. Pei, J. Han, and W. Wang, "Constraint-Based Sequential Pattern Mining: The Pattern-Growth Methods," J. Intelligent Information Systems, vol. 28, no. 2, pp. 133-160, 2007.
[34] I. Heierman and E.O.D. Cook, "Improving Home Automation by Discovering Regularly Occurring Device Usage Patterns," Proc. Third IEEE Int'l Conf. Data Mining (ICDM '03), pp. 537-540, Nov. 2003.
[35] A. Ruotsalainen and T. Ala-Kleemola, "GAIS: A Method for Detecting Discontinuous Sequential Patterns from Imperfect Data," Proc. Int'l Conf. Data Mining, pp. 530-534, 2007.
[36] J. Pei, J. Han, M.B. Asl, H. Pinto, Q. Chen, U. Dayal, and M.C. Hsu, "Prefixspan Mining Sequential Patterns Efficiently by Prefix Projected Pattern Growth," Proc. 17th Int'l Conf. Data Eng., pp. 215-226, 2001.
[37] M.J. Zaki, N. Lesh, and M. Ogihara, "Planmine: Sequence Mining for Plan Failures," Proc. Fourth Int'l Conf. Knowledge Discovery and Data Mining, pp. 369-373, 1998.
[38] Y.-L. Chen, S.-S. Chen, and P.-Y. Hsu, "Mining Hybrid Sequential Patterns and Sequential Rules," Information Systems, vol. 27, no. 5, pp. 345-362, 2002.
[39] E. Keogh, J. Lin, and W. Truppel, "Clustering of Time Series Subsequences Is Meaningless: Implications for Previous and Future Research," Proc. Third IEEE Int'l Conf. Data Mining (ICDM '03), pp. 115-121, 2003.
[40] K. Malde, E. Coward, and I. Jonassen, "Fast Sequence Clustering Using a Suffix Array Algorithm," Bioinformatics, vol. 19, no. 10, pp. 1221-1226, July 2003.
[41] V.I. Levenshtein, "Binary Codes Capable of Correct Deletions, Insertions, and Reversals," Soviet Physics Doklady, vol. 10, no. 8, pp. 707-710, 1966.
[42] J. Rissanen, "Modeling by Shortest Data Description," Automatica, vol. 14, pp. 465-471, 1978.
[43] J.A. Hartigan and M.A. Wong, "A K-Means Clustering Algorithm," Applied Statistics, vol. 28, pp. 100-108, 1979.
[44] J. Yang and W. Wang, "Towards Automatic Clustering of Protein Sequences," Proc. IEEE CS Bioinformatics Conf., pp. 175-186, 2002.
[45] S.-K. Noh, Y.-M. Kim, D. Kim, and B.-N. Noh, "Network Anomaly Detection Based on Clustering of Sequence Patterns," Computational Science and Its Applications, pp. 349-358, Springer, May 2006.
[46] K. Sequeira and M. Zaki, "Admit: Anomaly-Based Data Mining for Intrusions," Proc. Int'l Conf. Knowledge Discovery and Data Mining, pp. 386-395, 2002.
[47] H. Saneifar, S. Bringay, A. Laurent, and M. Teisseire, "S2mp: Similarity Measure for Sequential Patterns," Proc. Australasian Data Mining Conf. (AusDM), vol. 87, pp. 95-104, 2008.
[48] C.A. Sugar and G.M. James, "Finding the Number of Clusters in a Data Set: An Information Theoretic Approach," J. Am. Statistical Assoc., vol. 98, pp. 750-763, 2003.
[49] G.W. Milligan and M.C. Cooper, "An Examination of Procedures for Determining the Number of Clusters in a Data Set," Psychometrika, vol. 50, pp. 159-179, 1985.
[50] A. Viterbi, "Error Bounds for Convolutional Codes and an Asymptotically Optimum Decoding Algorithm," IEEE Trans. Information Theory, vol. IT-13, no. 2, pp. 260-269, Apr. 1967.
[51] R. Meir and G. Rätsch, "An Introduction to Boosting and Leveraging," Advanced Lectures on Machine Learning, pp. 118-183, Springer, 2003.
[52] R.E. Schapire and Y. Singer, "Improved Boosting Algorithms Using Confidence-Rated Predictions," Machine Learning, vol. 37, no. 3, pp. 297-336, 1999.
[53] Y. Freund and R.E. Schapire, "A Decision-Theoretic Generalization of Online Learning and an Application to Boosting," Proc. Second European Conf. Computational Learning Theory (EuroCOLT '95), pp. 23-37, 1995.
[54] H.S. International, "Using Boosting to Improve a Hybrid HMM/Neural Network Speech Recognizer," 1999.
[55] C. Dimitrakakis and S. Bengio, "Boosting HMMs with an Application to Speech Recognition," 2004.
[56] "Asterisk Guru," www.asteriskguru.comtutorials, 2009.
[57] "Open Instant Messaging and Presence," http:/, 2009.
[58] M. Schmitter-Edgecombe, E. Woo, and D. Greeley, "Memory Deficits, Everyday Functioning, and Mild Cognitive Impairment," Proc. Ann. Rehabilitation Psychology Conf., 2008.
37 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool