The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.12 - December (2011 vol.33)
pp: 2521-2537
Maja Stikic , Advanced Brain Monitoring, Inc., Carlsbad
Diane Larlus , Xerox Research Centre Europe, Grenoble
Sandra Ebert , Max-Planck-Institut for Computer Science, Saarbrücken
Bernt Schiele , Max-Planck-Institut for Computer Science, Saarbrücken
ABSTRACT
This paper considers scalable and unobtrusive activity recognition using on-body sensing for context awareness in wearable computing. Common methods for activity recognition rely on supervised learning requiring substantial amounts of labeled training data. Obtaining accurate and detailed annotations of activities is challenging, preventing the applicability of these approaches in real-world settings. This paper proposes new annotation strategies that substantially reduce the required amount of annotation. We explore two learning schemes for activity recognition that effectively leverage such sparsely labeled data together with more easily obtainable unlabeled data. Experimental results on two public data sets indicate that both approaches obtain results close to fully supervised techniques. The proposed methods are robust to the presence of erroneous labels occurring in real-world annotation data.
INDEX TERMS
Wearable computing, activity recognition, wearable sensing, semi-supervised learning.
CITATION
Maja Stikic, Diane Larlus, Sandra Ebert, Bernt Schiele, "Weakly Supervised Recognition of Daily Life Activities with Wearable Sensors", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.33, no. 12, pp. 2521-2537, December 2011, doi:10.1109/TPAMI.2011.36
REFERENCES
[1] L. Bao and S. Intille, "Activity Recognition from User-Annotated Acceleration Data," Proc. Int'l Conf. Pervasive Computing, 2004.
[2] N. Ravi, N. Dandekar, P. Mysore, and M. Littman, "Activity Recognition from Accelerometer Data," Proc. Conf. Innovative Applications of Artificial Intelligence, 2005.
[3] K.V. Laerhoven, D. Kilian, and B. Schiele, "Using Rhythm Awareness in Long-Term Activity Recognition," Proc. IEEE Int'l Symp. Wearable Computers, 2008.
[4] T. Huynh, U. Blanke, and B. Schiele, "Scalable Recognition of Daily Activities with Wearable Sensors," Proc. Int'l Symp. Location- and Context-Awareness, 2007.
[5] T. Huynh, M. Fritz, and B. Schiele, "Discovery of Activity Patterns Using Topic Models," Proc. Int'l Conf. Ubiquitous Computing, 2007.
[6] B. Logan, J. Healey, M. Philipose, E. Tapia, and S. Intille, "A Long-Term Evaluation of Sensing Modalities for Activity Recognition," Proc. Int'l Conf. Ubiquitous Computing, 2007.
[7] E.M. Tapia, S.S. Intille, and K. Larson, "Activity Recognition in the Home Using Simple and Ubiquitous Sensors," Proc. Int'l Conf. Pervasive Computing, 2004.
[8] J. Froehlich, M.Y. Chen, S. Consolvo, B. Harrison, and J.A. Landay, "MyExperience: A System for In Situ Tracing and Capturing of User Feedback on Mobile Phones," Proc. Int'l Conf. Mobile Systems, Applications, and Services, 2007.
[9] U. Maurer, A. Smailagic, D. Siewiorek, and M. Deisher, "Activity Recognition and Monitoring Using Multiple Sensors on Different Body Positions," Proc. Int'l Workshop Wearable and Implantable Body Sensor Networks, 2006.
[10] M. Stikic and B. Schiele, "Activity Recognition from Sparsely Labeled Data Using Multi-Instance Learning," Proc. Int'l Symp. Location and Context Awareness, 2009.
[11] M. Stikic, D. Larlus, and B. Schiele, "Multi-Graph Based Semi-Supervised Learning for Activity Recognition," Proc. IEEE Int'l Symp. Wearable Computers, 2009.
[12] Y. Yacoob and M. Black, "Parameterized Modeling and Recognition of Activities," Computer Vision and Image Understanding, vol. 73, no. 2, pp. 232-247, 1999.
[13] C. Fanti, L. Zelnik-Manor, and P. Perona, "Hybrid Models for Human Motion Recognition," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, 2005.
[14] L. Wang and D. Suter, "Recognizing Human Activities from Silhouettes: Motion Subspace and Factorial Discriminative Graphical Model," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[15] L. Gorelick, M. Blank, E. Shechtman, M. Irani, and R. Basri, "Actions as Space-Time Shapes," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 12, pp. 2247-2253, Dec. 2007.
[16] J. Niebles and L. Fei-Fei, "A Hierarchical Model of Shape and Appearance for Human Action Classification," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[17] I. Laptev and T. Lindeberg, "Space-Time Interest Points," Proc. IEEE Int'l Conf. Computer Vision, 2003.
[18] C.R. Wren and E.M. Tapia, "Toward Scalable Activity Recognition for Sensor Networks," Proc. Int'l Symp. Location and Context-Awareness, 2006.
[19] D. Wyatt, M. Philipose, and T. Choudhury, "Unsupervised Activity Recognition Using Automatically Mined Common Sense," Proc. Nat'l Conf. Artificial Intelligence, 2005.
[20] G. Ogris, T. Stiefmeieer, P. Lukowicz, and G. Tröster, "Using a Complex Multi-Modal On-Body Sensor System for Activity Spotting," Proc. IEEE Int'l Symp. Wearable Computers, 2008.
[21] S. Wang, W. Pentney, A.-M. Popescu, T. Choudhury, and M. Philipose, "Common Sense Based Joint Training of Human Activity Recognizers," Proc. Int'l Joint Conf. Artificial Intelligence, 2007.
[22] J. Lester, T. Choudhury, and G. Borriello, "A Practical Approach to Recognizing Physical Activities," Proc. Int'l Conf. Pervasive Computing, 2006.
[23] T.V. Duong, H.H. Bui, D.Q. Phung, and S. Venkatesh, "Activity Recognition and Abnormality Detection with the Switching Hidden Semi-Markov Model," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, 2005.
[24] J.A. Ward, P. Lukowicz, G. Tröster, and T. Starner, "Activity Recognition of Assembly Tasks Using Body-Worn Microphones and Accelerometers," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 10, pp. 1553-1567, Oct. 2006.
[25] M. Stikic, K.V. Laerhoven, and B. Schiele, "Exploring Semi-Supervised and Active Learning for Activity Recognition," Proc. IEEE Int'l Symp. Wearable Computers, 2008.
[26] A. Kapoor and E. Horvitz, "On Discarding, Caching, and Recalling Samples in Active Learning," Proc. Conf. Uncertainty and Artificial Intelligence, 2007.
[27] A. Kapoor and E. Horvitz, "Experience Sampling for Building Predictive User Models: A Comparative Study," Proc. Ann. SIGCHI Conf. Human Factors in Computing Systems, 2008.
[28] O. Chapelle, B. Schölkopf, and A. Zien, Semi-Supervised Learning. MIT Press, 2006.
[29] D. Guan, W. Yuan, Y.-K. Lee, A. Gavrilov, and S. Lee, "Activity Recognition Based on Semi-Supervised Learning," Proc. IEEE Int'l Conf. Embedded and Real-Time Computing Systems and Applications, 2007.
[30] A. Subramanya, A. Raj, J. Blimes, and D. Fox, "Recognizing Activities and Spatial Context Using Wearable Sensors," Proc. Conf. Uncertainty and Artificial Intelligence, 2006.
[31] M. Mahdaviani and T. Choudhury, "Fast and Scalable Training of Semi-Supervised CRFs with Application to Activity Recognition," Proc. Neural Information Processing Systems, 2007.
[32] J. Hoey, P. Poupart, C. Boutilier, and A. Mihailidis, "Semi-Supervised Learning of a Pomdp Model of Patient-Caregiver Interactions," Proc. Int'l Joint Conf. Artificial Intelligence Workshop Modeling Others from Observations, 2005.
[33] Z.-H. Zhou, "Multi-Instance Learning: A Survey," technical report, AI Lab, Dept. of Computer Science and Technology, Nanjing Univ., 2004.
[34] X. Zhu and Z. Ghahramani, "Learning from Labeled and Unlabeled Data with Label Propagation," Technical Report CMU-CALD-02-107, 2002.
[35] D. Zhou, O. Bousquet, T.N. Lal, J. Weston, and B. Schölkopf, "Learning with Local and Global Consistency," Advances in Neural Information Processing Systems, MIT Press, 2004.
[36] S. Andrews, I. Tsochantaridis, and T. Hofmann, "Support Vector Machines for Multiple-Instance Learning," Advances in Neural Information Processing Systems, MIT Press, 2003.
[37] K. Partridge and P. Golle, "On Using Existing Time-Use Study Data for Ubiquitous Computing Applications," Proc. Int'l Conf. Ubiquitous Computing, 2008.
[38] M.-F. Balcan, A. Blum, P.P. Choi, J. Lafferty, B. Pantano, M.R. Rwebangira, and X. Zhu, "Person Identification in Webcam Images: An Application of Semi-Supervised Learning," Proc. Int'l Conf. Machine Learning, 2005.
[39] J. Lester, T. Choudhury, N. Kern, G. Borriello, and B. Hannford, "A Hybrid Discriminative/Generative Approach for Modeling Human Activities," Proc. Int'l Joint Conf. Artificial Intelligence, 2005.
[40] S.S. Intille, J. Rondoni, C. Kukla, I. Ancona, and L. Bao, "A Context-Aware Experience Sampling Tool," Proc. SIGCHI Conf. Human Factors in Computing Systems, 2003.
5 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool