Issue No.01 - Jan.-March (2013 vol.4)
pp: 93-105
M. Kusserow , Electron. Lab., ETH Zurich, Zurich, Switzerland
O. Amft , ACTLab, Tech. Univ. Eindhoven, Eindhoven, Netherlands
Gerhard Troster , Electron. Lab., ETH Zurich, Zurich, Switzerland
In this work, we introduce methods for studying psychological arousal in naturalistic daily living. We present an activity-aware arousal phase modeling approach that incorporates the additional heart rate (AHR) algorithm to estimate arousal onsets (activations) in the presence of physical activity (PA). In particular, our method filters spurious PA-induced activations from AHR activations, e.g., caused by changes in body posture, using activity primitive patterns and their distributions. Furthermore, our approach includes algorithms for estimating arousal duration and intensity, which are key to arousal assessment. We analyzed the modeling procedure in a participant study with 180 h of unconstrained daily life recordings using a multimodal wearable system comprising two acceleration sensors, a heart rate monitor, and a belt computer. We show how participants' sensor-based arousal phase estimations can be evaluated in relation to daily activity and self-report information. For example, participant-specific arousal was frequently estimated during conversations and yielded highest intensities during office work. We believe that our activity-aware arousal modeling can be used to investigate personal arousal characteristics and introduce novel options for studying human behavior in daily living.
Heart rate, Acceleration, Wearable computers, Sensors, Monitoring, Biomedical monitoring, Motion control, body motion, Heart rate, Acceleration, Wearable computers, Sensors, Monitoring, Biomedical monitoring, Motion control, daily activity, Arousal estimation, affect monitoring, daily hassles, wearable system, heart rate
M. Kusserow, O. Amft, Gerhard Troster, "Modeling arousal phases in daily living using wearable sensors", IEEE Transactions on Affective Computing, vol.4, no. 1, pp. 93-105, Jan.-March 2013, doi:10.1109/T-AFFC.2012.37
[1] J. Russell, "Core Affect and the Psychological Construction of Emotion," Psychological Rev., vol. 110, no. 1, pp. 145-172, 2003.
[2] A.C. Guyton and J.E. Hall, Textbook of Medical Physiology, 11th ed., ch. 60, pp. 748-760. Elsevier, 2006.
[3] R. Picard, Affective Wearables, series Affective Computing, ch. 8, pp. 227-252. MIT Press, 1997.
[4] D. Almeida, "Resilience and Vulnerability to Daily Stressors Assessed via Diary Methods," Current Directions in Psychological Science, vol. 14, no. 2, pp. 64-68, 2005.
[5] P. Kohn, K. Lafreniere, and M. Gurevich, "Hassles, Health, and Personality," J. Personality and Social Psychology, vol. 61, no. 3, pp. 478-482, 1991.
[6] M. Kusserow, O. Amft, and G. Tröster, "Analysis of Heart Stress Response for a Public Talk Assistant System," Proc. European Conf. Ambient Intelligence, pp. 326-342, 2008.
[7] R.S. Lazarus, Stress and Emotion: A New Synthesis, R.S. Lazarus, ed. Springer, 2006.
[8] M.A. Nicolaou, H. Gunes, and M. Pantic, "Continuous Prediction of Spontaneous Affect from Multiple Cues and Modalities in Valence-Arousal Space," IEEE Trans. Affective Computing, vol. 2, no. 2, pp. 92-105, Apr.-June 2011.
[9] M. Myrtek, G. Brügner, A. Fichtler, K. König, W. Müller, F. Foerster, and V. Höppner, "Detection of Emotionally Induced ECG Changes and Their Behavioural Correlates: A New Method for Ambulatory Monitoring," European Heart J., vol. 9, no. Supplement N, pp. 55-60, 1988.
[10] C. Kirschbaum, K. Pirke, and D. Hellhammer, "The 'Trier Social Stress Test'---a Tool for Investigating Psychobiological Stress Responses in a Laboratory Setting," Neuropsychobiology, vol. 28, no. 1/2, pp. 76-81, 1993.
[11] D. Wu, C.G. Courtney, B.J. Lance, S.S. Narayanan, M.E. Dawson, K.S. Oie, and T.D. Parsons, "Optimal Arousal Identification and Classification for Affective Computing Using Physiological Signals: Virtual Reality Stroop Task," IEEE Trans. Affective Computing, vol. 1, no. 2, pp. 109-118, July-Dec. 2010.
[12] R.A. Calvo and S. D'Mello, "Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications," IEEE Trans. Affective Computing, vol. 1, no. 1, pp. 18-37, Jan.-June 2010.
[13] H. Gunes, B. Schuller, M. Pantic, and R. Cowie, "Emotion Representation, Analysis and Synthesis in Continuous Space: A Survey," Proc. Int'l Conf. Automatic Face & Gesture Recognition and Workshops, pp. 827-834, 2011.
[14] J. Fahrenberg, M. Myrtek, K. Pawlik, and M. Perrez, "Ambulatory Assessment---Monitoring Behavior in Daily Life Settings," European J. Psychological Assessment, vol. 23, no. 4, pp. 206-213, 2007.
[15] F.H. Wilhelm and P. Grossman, "Emotions Beyond the Laboratory: Theoretical Fundaments, Study Design, and Analytic Strategies for Advanced Ambulatory Assessment," Biological Psychology, vol. 84, no. 3, pp. 552-569, 2010.
[16] E. André, "Experimental Methodology in Emotion-Oriented Computing," IEEE Pervasive Computing, vol. 10, no. 3, pp. 54-56, July-Sept. 2011.
[17] R. Fletcher, K. Dobson, M. Goodwin, H. Eydgahi, O. Wilder-Smith, D. Fernholz, Y. Kuboyama, E. Hedman, M. Poh, and R. Picard, "iCalm: Wearable Sensor and Network Architecture for Wirelessly Communicating and Logging Autonomic Activity," IEEE Trans. Information Technology in Biomedicine, vol. 14, no. 2, pp. 215-223, Mar. 2010.
[18] M. Kusserow, O. Amft, H. Gubelmann, and G. Tröster, "Arousal Pattern Analysis of an Olympic Champion in Ski Jumping," Sports Technology, vol. 3, no. 3, pp. 192-203, 2010.
[19] M. Kusserow, O. Amft, and G. Tröster, "BodyANT: Miniature Wireless Sensors for Naturalistic Monitoring of Daily Activity," Proc. Fourth Int'l Conf. Body Area Networks (BodyNets), pp. 1-8, 2009.
[20] H. Gunes and M. Pantic, "Automatic, Dimensional and Continuous Emotion Recognition," Int'l J. Synthetic Emotions, vol. 1, no. 1, pp. 68-99, 2010.
[21] S. Koelstra, A. Yazdani, M. Soleymani, C. Mühl, J.-S. Lee, A. Nijholt, T. Pun, T. Ebrahimi, and I. Patras, "Single Trial Classification of EEG and Peripheral Physiological Signals for Recognition of Emotions Induced by Music Videos," Proc. Int'l Conf. Brain Informatics, Y. Yao, R. Sun, T. Poggio, J. Liu, N. Zhong, and J. Huang, eds., pp. 89-100, 2010.
[22] M. Myrtek, Heart and Emotion: Ambulatory Monitoring Studies in Everyday Life, M. Myrtek, ed. Hogrefe & Huber, 2004.
[23] N. Bolger, A. Davis, and E. Rafaeli, "Diary Methods: Capturing Life as It Is Lived." Ann. Rev. Psychology, vol. 54, no. 1, pp. 579-616, 2003.
[24] J. Healey, L. Nachman, S. Subramanian, J. Shahabdeen, and M. Morris, "Out of the Lab and into the Fray: Towards Modeling Emotion in Everyday Life," Proc. Eighth Int'l Conf. Pervasive Computing, pp. 156-173, 2010.
[25] K. Plarre, A. Raij, S. Hossain, A. Ali, M. Nakajima, M. al'Absi, E. Ertin, T. Kamarck, S. Kumar, M. Scott, D. Siewiorek, A. Smailagic, and L. Wittmers, "Continuous Inference of Psychological Stress from Sensory Measurements Collected in the Natural Environment," Proc. 10th Int'l Conf. Information Processing in Sensor Networks (IPSN), pp. 97-108, 2011.
[26] M. Myrtek, F. Foerster, and G. Brügner, Freiburger Monitoring System, series Psychophysiologie in Labor und Feld, M. Myrtek, ed., vol. 9, Peter Lang, 2001.
[27] P. Grossman, F. Wilhelm, and M. Spoerle, "Respiratory Sinus Arrhythmia, Cardiac Vagal Control, and Daily Activity," Am. J. Physiology-Heart and Circulatory Physiology, vol. 287, no. 2, pp. H728-H734, 2004.
[28] J. Turner, D. Carroll, J. Hanson, and J. Sims, "A Comparison of Additional Heart Rates during Active Psychological Challenge Calculated from Upper Body and Lower Body Dynamic Exercise," Psychophysiology, vol. 25, no. 2, pp. 209-216, 1988.
[29] A.S. Blix, S.B. Stromme, and H. Ursin, "Additional Heart Rate— An Indicator of Psychological Activation." Aerospace Medicine, vol. 45, no. 11, pp. 1219-1221, 1974.
[30] T. Prill and J. Fahrenberg, "New Methods in Ambulatory Blood Pressure Monitoring: Interactive Monitoring and Detection of Posture and Movement Patterns," Behavior Research Methods, vol. 39, no. 3, pp. 390-398, 2007.
[31] R. Kleiger, J. Miller, J. Bigger Jr, and A. Moss, "Decreased Heart Rate Variability and Its Association with Increased Mortality after Acute Myocardial Infarction," The Am. J. Cardiology, vol. 59, no. 4, pp. 256-262, 1987.
[32] R. Steyer, P. Schwenkmezger, P. Notz, and M. Eid, Der Mehrdimensionale Befindlichkeitsfragebogen (MDBF) [Multidimensional Mood Questionnaire]. Hogrefe, 1997.
[33] O. Amft, M. Lauffer, S. Ossevoort, F. Macaluso, P. Lukowicz, and G. Tröster, "Design of the QBIC Wearable Computing Platform," Proc. 15th Int'l Conf. Application-Specific Systems, Architectures and Processors (ASAP), pp. 398-410, 2004.
[34] D. Bannach, O. Amft, and P. Lukowicz, "Rapid Prototyping of Activity Recognition Applications," IEEE Pervasive Computing, vol. 7, no. 2, pp. 22-31, Apr.-June 2008.
[35] C. Zysset, K. Cherenack, T. Kinkeldei, and G. Tröster, "Weaving Integrated Circuits into Textiles," Proc. 14th Int'l Symp. Wearable Computers (ISWC), pp. 1-8, 2010.
[36] F. Wilhelm and W. Roth, "Using Minute Ventilation for Ambulatory Estimation of Additional Heart Rate," Biological Psychology, vol. 49, no. 1/2, pp. 137-150, 1998.
[37] M. Morris and F. Guilak, "Mobile Heart Health: Project Highlight," IEEE Pervasive Computing, vol. 8, no. 2, pp. 57-61, Apr.-June 2009.
[38] Y. Zanstra and D. Johnston, "Cardiovascular Reactivity in Real Life Settings: Measurement, Mechanisms and Meaning," Biological Psychology, vol. 86, no. 2, pp. 98-105, 2011.
[39] L.J. van Doornen and E.J. de Geus, "Aerobic Fitness and the Cardiovascular Response to Stress," Psychophysiology, vol. 26, no. 1, pp. 17-28, 1989.
[40] W. Linden, "A Microanalysis of Autonomic Activity during Human Speech," Psychosomatic Medicine, vol. 49, no. 6, pp. 562-578, 1987.
[41] M. Kusserow, O. Amft, and G. Tröster, "Monitoring Stress-Arousal in the Wild---Measuring the Intangible," IEEE Pervasive Computing, preprint, doi: 10.1109/MPRC.2012.56, 2012.