This Article 
 Bibliographic References 
 Add to: 
Recognizing Multiuser Activities Using Wireless Body Sensor Networks
November 2011 (vol. 10 no. 11)
pp. 1618-1631
Tao Gu, University of Southern Denmark, Odense
Liang Wang, University of Southern Denmark, Odense
Hanhua Chen, University of Southern Denmark, Odense
Xianping Tao, Nanjing University, Nanjing
Jian Lu, Nanjing University, Nanjing
The advances of wireless networking and sensor technology open up an interesting opportunity to infer human activities in a smart home environment. Existing work in this paradigm focuses mainly on recognizing activities of single user. In this work, we focus on the fundamental problem of recognizing activities of multiple users using a wireless body sensor network, and propose a scalable pattern mining approach to recognize both single- and multiuser activities in a unified framework. We exploit Emerging Pattern—a discriminative knowledge pattern which describes significant changes among activity classes of data—for building activity models and design a scalable, noise-resistant, Emerging Pattern-based Multiuser Activity Recognizer (epMAR) to recognize both single- and multiuser activities. We develop a multimodal, wireless body sensor network for collecting real-world traces in a smart home environment, and conduct comprehensive empirical studies to evaluate our system. Results show that epMAR outperforms existing schemes in terms of accuracy, scalability, and robustness.

[1] A. Arora, P. Dutta, S. Bapat, V. Kulathumani, H. Zhang, V. Naik, V. Mittal, H. Cao, M. Demirbas, M. Gouda, Y. Choi, T. Herman, S. Kulkarni, U. Arumugam, M. Nesterenko, A. Vora, and M. Miyashita, "A Wireless Sensor Network for Target Detection, Classification, and Tracking," Computer Networks, vol. 46, pp. 605-634, 2004.
[2] R. Szewczyk, A. Mainwaring, J. Anderson, and D. Culler, "An Analysis of a Large Scale Habit Monitoring Application," Proc. ACM Second Int'l Conf. Embedded Networked Sensor Systems (SenSys '04), 2004.
[3] N. Xu, S. Rangwala, K.K. Chintalapudi, D. Ganesan, A. Broad, R. Govindan, and D. Estrin, "A Wireless Sensor Network for Structural Monitoring," Proc. ACM Second Int'l Conf. Embedded Networked Sensor Systems (SenSys '04), 2004.
[4] M. Philipose, K.P. Fishkin, M. Perkowitz, D.J. Patterson, D. Fox, H. Kautz, and D. Hähnel, "Inferring Activities from Interactions with Objects," IEEE Pervasive Computing, vol. 3, no. 4, pp. 50-57, Oct.-Dec. 2004.
[5] E.M. Tapia, S.S. Intille, and K. Larson, "Activity Recognition in the Home Setting Using Simple and Ubiquitous Sensors," Proc. Int'l Conf. Pervasive, pp. 158-175, 2004.
[6] B. Logan, J. Healey, M. Philipose, E. Munguia-Tapia, and S. Intille, "A Long-Term Evaluation of Sensing Modalities for Activity Recognition," Proc. Ninth Int'l Conf. Ubiquitous Computing (Ubicomp '07), Sept. 2007.
[7] D.J. Patterson, L. Liao, D. Fox, and H.A. Kautz, "Inferring High-Level Behavior from Low-Level Sensors," Proc. Int'l Conf. Ubiquitous Computing (Ubicomp '03), pp. 73-89, Oct. 2003.
[8] D. Jea, R. Balani, J. Hsu, D. Cho, M. Gerla, and M.B. Srivastava, "Diagnostic Quality Driven Physiological Data Collection for Personal Healthcare," Proc. IEEE 30th Ann. Int'l Conf. Eng. in Medicine and Biology Soc. (EMBC '08), Aug. 2008.
[9] S. Reddy, M. Mun, J. Burke, D. Estrin, M. Hansen, and M.B. Srivastava, "Using Mobile Phones to Determine Transportation Modes," ACM Trans. Sensor Networks, vol. 6, pp. 1-27, Feb. 2010.
[10] L. Chen and C. Nugent, "Ontology-Based Activity Recognition in Intelligent Pervasive Environments," Int'l J. Web Information Systems, vol. 5, pp. 410-430, 2009.
[11] G.Z. Dong and J.Y. Li, "Efficient Mining of Emerging Patterns: Discovering Trends and Differences," Proc. ACM Int'l Conf. Knowledge Discovery and Data Mining, pp. 43-52, Aug. 1999.
[12] L. Bao and S.S. Intille, "Activity Recognition from User-Annotated Acceleration Data," Proc. Int'l Conf. Pervasive, pp. 1-17, 2004.
[13] D. Patterson, D. Fox, H. Kautz, and M. Philipose, "Fine-Grained Activity Recognition by Aggregating Abstract Object Usage," Proc. IEEE Int'l Symp. Wearable Computers, Oct. 2005.
[14] T.Y. Wu, C.C. Lian, and J.Y. Hsu, "Joint Recognition of Multiple Concurrent Activities Using Factorial Conditional Random Fields," Proc. AAAI Workshop Plan, Activity, and Intent Recognition, July 2007.
[15] D. Lymberopoulos, A. Ogale, A. Savvides, and Y. Aloimonos, "A Sensory Grammar for Inferring Behaviors in Sensor Networks," Proc. Fifth Int'l Conf. Information Processing in Sensor Networks, 2006.
[16] R. Hamid, S. Maddi, A. Bobick, and I. Essa, "Unsupervised Analysis of Activity Sequences Using Event Motifs," Proc. ACM Int'l Workshop Video Surveillance and Sensor, 2006.
[17] N. Oliver, B. Rosario, and A. Pentland, "A Bayesian Computer Vision System for Modeling Human Interactions," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 831-843, Aug. 2000.
[18] S. Gong and T. Xiang, "Recognition of Group Activities Using Dynamic Probabilistic Networks," Proc. IEEE Ninth Int'l Conf. Computer Vision (ICCV '03), pp. 742-749, Oct. 2003.
[19] N. Nguyen, H. Bui, and S. Venkatesh, "Recognising Behaviour of Multpile People with Hierarchical Probabilistic and Statistical Data Association," Proc. 17th British Machine Vision Conf., 2006.
[20] S. Park and M.M. Trivedi, "Multi-Person Interaction and Activity Analysis: A Synergistic Track- and Body-Level Analysis Framework," Machine Vision and Applications: Special Issue on Novel Concepts and Challenges for the Generation of Video Surveillance Systems, vol. 18, no. 3, pp. 151-166, 2007.
[21] Y. Du, F. Chen, W. Xu, and Y. Li, "Recognizing Interaction Activities Using Dynamic Bayesian Network," Proc. 18th Int'l Conf. Pattern Recognition (ICPR '06), Aug. 2006.
[22] D. Wyatt, T. Choudhury, J. Bilmes, and H. Kautz, "A Privacy Sensitive Approach to Modeling Multi-Person Conversations," Proc. 20th Int'l Joint Conf. Artifical Intelligence (IJCAI '07), Jan. 2007.
[23] D.V. Compernolle, "Noise Adaptation in a Hidden Markov Model Speech Recognition System," Computer Speech and Language, vol. 3, pp. 151-167, 1989.
[24] M.M.H. Khan, H.K. Le, H. Ahmadi, T.F. Abdelzaher, and J. Han, "Dustminer: Troubleshooting Interactive Complexity Bugs in Sensor Networks," Proc. Sixth ACM Int'l Conf. Embedded Network Sensor Systems (SenSys '08), Nov. 2008.
[25] T. Gu, Z. Wu, X. Tao, H.K. Pung, and J. Lu, "epSICAR: An Emerging Patterns Based Approach to Sequential, Interleaved and Concurrent Activity Recognition," Proc. IEEE Seventh Ann. Int'l Conf. Pervasive Computing and Comm. (PerCom '09), Mar. 2009.
[26] L. Wang, T. Gu, X. Tao, and J. Lu, "Sensor-Based Human Activity Recognition in a Multi-User Scenario," Proc. European Conf. Ambient Intelligence (AmI '09), Nov. 2009.
[27] T. Gu, Z. Wu, L. Wang, X. Tao, and J. Lu, "Mining Emerging Patterns for Recognizing Activities of Multiple Users in Pervasive Computing," Proc. Sixth Int'l Conf. Mobile and Ubiquitous Systems: Computing, Networking and Services, July 2009.
[28] U. Fayyad and K. Irani, "Multi-Interval Discretization of Continuous-Valued Attributes for Classification Learning," Proc. Int'l Joint Conf. Artificial Intelligence, 1993.
[29] R. Kohavi, "A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection," Proc. 14th Int'l Joint Conf. Artificial Intelligence (IJCAI '95), pp. 1137-1143, 1995.
[30] J.Y. Li, G.M. Liu, and L. Wong, "Mining Statistically Important Equivalence Classes and Delta-Discriminative Emerging Patterns," Proc. ACM Int'l Conf. Knowledge Discovery and Data Mining, pp. 430-439, 2007.
[31] L. Coyle, J. Ye, S. McKeever, S. Knox, M. Stabeler, S. Dobson, and P. Nixon, "Gathering Data Sets for Activity Identification," Proc. CHI '09 Workshop Developing Shared Home Behavior Data Sets to Advance HCI and Ubiquitous Computing Research, Apr. 2009.
[32] M. Brand, N. Oliver, and A. Pentland, "Coupled Hidden Markov Models for Complex Action Recognition," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, 1997.

Index Terms:
Wireless body sensor networks, sensor-based activity recognition, pattern mining.
Tao Gu, Liang Wang, Hanhua Chen, Xianping Tao, Jian Lu, "Recognizing Multiuser Activities Using Wireless Body Sensor Networks," IEEE Transactions on Mobile Computing, vol. 10, no. 11, pp. 1618-1631, Nov. 2011, doi:10.1109/TMC.2011.43
Usage of this product signifies your acceptance of the Terms of Use.