The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.01 - Jan.-March (2013 vol.4)
pp: 57-68
Marjolein D. van der Zwaag , Philips Research, Eindhoven
Joris H. Janssen , Eindhoven University of Technology, Eindhoven and Philips Research, Eindhoven
Joyce H.D.M. Westerink , Philips Research, Eindhoven
ABSTRACT
Music is important in everyday life, as it provides entertainment and influences our moods. As music is widely available, it is becoming increasingly difficult to select songs to suit our mood. An affective music player can remove this obstacle by taking a desired mood as input and then selecting songs that direct toward that desired mood. In the present study, we validate the concept of an affective music player directing the energy dimension of mood. User models were trained for 10 participants based on skin conductance changes to songs from their own music database. Based on the resulting user models, the songs that most increased or decreased the skin conductance level of the participants were selected to induce either a relatively energized or a calm mood. Experiments were conducted in a real-world office setting. The results showed that a reliable prediction can be made of the impact of a song on skin conductance, that skin conductance and mood can be directed toward an energized or calm state and that skin conductance remains in these states for at least 30 minutes. All in all, this study shows that the concept and models of the affective music player worked in an ecologically valid setting, suggesting the feasibility of using physiological responses in real-life affective computing applications.
INDEX TERMS
Music, Physiology, Skin conductance levels, Temperature sensors, Heart rate, Biological system modeling, skin temperature, Music, Physiology, Skin conductance levels, Temperature sensors, Heart rate, Biological system modeling, mood, Affective music player, music, physiology, skin conductance
CITATION
Marjolein D. van der Zwaag, Joris H. Janssen, Joyce H.D.M. Westerink, "Directing Physiology and Mood through Music: Validation of an Affective Music Player", IEEE Transactions on Affective Computing, vol.4, no. 1, pp. 57-68, Jan.-March 2013, doi:10.1109/T-AFFC.2012.28
REFERENCES
[1] P.N. Juslin and J. Sloboda, Handbook of Music and Emotion: Theory, Research, Applications. Oxford Univ. Press, 2010.
[2] J.J. Gross, Handbook of Emotion Regulation. Guilford Press, 2007.
[3] A.C. North and D.J. Hargreaves, The Social and Applied Psychology of Music. Oxford Univ. Press, 2008.
[4] A.M. Isen, "Positive Affect and Decision Making," Handbook of Emotions, second ed., C.R. Snyder and S. Lopez, eds., pp. 417-435, Oxford Univ. Press, 2000.
[5] G.H.E. Gendolla, "On the Impact of Mood on Behavior: An Integrative Theory and a Review," Rev. of General Psychology, vol. 4, pp. 378-408, 2000.
[6] T. Lesiuk, "The Effect of Preferred Music on Mood and Performance in a High-Cognitive Demand Occupation," J. Music Therapy, vol. 47, no. 2, pp. 137-154, 2010.
[7] J.H. Janssen, E.L. Van den Broek, and J.H.D.M. Westerink, "Tune in to Your Emotions: A Robust Personalized Affective Music Player," User Modeling and User Adapted Interaction, vol. 22, pp. 25-279, 2012.
[8] N. Oliver and L. Kreger-Stickles, "Papa: Physiology and Purpose-Aware Automatic Playlist Generation," Proc. Seventh Int'l Conf. Music Information Retrieval, pp. 250-253, 2006.
[9] G.G. Cassidy and R.A.R. MacDonald, "The Effects of Music Choice on Task Performance: A Study of the Impact of Self-Selected and Experimenter-Selected Music on Driving Game Performance and Experience," Musicae Scientiae, vol. 13, pp. 357-386, 2009.
[10] P. Wilhelm and D. Schoebi, "Assessing Mood in Daily Life," European J. Psychological Assessment, vol. 23, no. 3, pp. 258-267, 2007.
[11] V. Konečni, "Social Interaction and Musical Preference," The Psychology of Music, D. Deutsch, ed., pp. 497-516, Academic Press, 1982.
[12] R.M. Yerkes and J.D. Dodson, "The Relation of Strength of Stimulus to Rapidity of Habit-Formation," J. Comparative Neurology and Psychology, vol. 18, pp. 459-482, 1908.
[13] D.E. Berlyne, Aesthetics and Psychobiology. Appleton-Century-Crofts, 1971.
[14] D. Hodges, "Psycho-Physiological Measures," Handbook of Music and Emotions: Theory, Research, Applications, second ed., P.N. Juslin and J.A. Sloboda, eds., chapter 11, pp. 279-311, Oxford Univ. Press, 2010.
[15] R.A. Calvo and S. D'Mello, "Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications," IEEE Trans. Affective Computing, vol. 1, no. 1, pp. 18-37, Jan. 2010.
[16] J.H. Janssen, J.N. Bailenson, W.A. IJsselsteijn, and J.H.D.M. Westerink, "Intimate Heartbeats: Opportunities for Affective Communication Technology," IEEE Trans. Affective Computing, vol. 1, no. 2, pp. 72-80, July-Dec. 2010.
[17] R.W. Picard, Affective Computing. MIT Press, 1997.
[18] M.D. Van der Zwaag, J.H.D.M. Westerink, L.J.M. Mulder, D. de Waard, and K.A. Brookhuis, "Sustaining Moods with Background Music: Physiological Patterns and Subjective Experience," submitted for publication.
[19] J.T. Cacioppo, L. Tassinary, and G.G. Berntson, Handbook of Psychophysiology. Cambridge Univ. Press, 2007.
[20] C.L. Krumhansl, "An Exploratory Study of Musical Emotions and Psychophysiology," Canadian J. Experimental Psychology, vol. 51, pp. 336-353, 1997.
[21] I. Nykliček, J.F. Thayer, and L.J.P. Van Doornen, "Cardiorespiratory Differentiation of Musically-Induced Emotions." J. Psychophysiology, vol. 11, pp. 304-321, 1997.
[22] L. Venables and S.H. Fairclough, "The Influence of Performance Feedback on Goal-Setting and Mental Effort Regulation," Motivation and Emotion, vol. 33, pp. 63-74, 2009.
[23] M.D. Van der Zwaag and J.H.D.M. Westerink, "Physiological Patterns during Music Mood Induction," submitted for publication.
[24] M.D. Van der Zwaag, J.H.D.M. Westerink, and E.L. Van den Broek, "Emotional and Psychophysiological Responses to Tempo, Mode, and Percussiveness," Musicae Scientiae, vol. 15, no. 2, pp. 250-269, 2011.
[25] L.-O. Lundqvist, F. Carlsson, P. Hilmersson, and P.N. Juslin, "Emotional Responses to Music: Experience, Expression, and Physiology," Psychology of Music, vol. 37, pp. 61-90, 2009.
[26] R.A. McFarland, "Relationship of Skin Temperature Changes to the Emotions Accompanying Music," Biofeedback and Self-Regulation, vol. 10, pp. 255-267, 1985.
[27] S. Rimm-Kaufman and J. Kagan, "The Psychological Significance of Changes in Skin Temperature," Motivation and Emotion, vol. 20, pp. 64-78, 1996.
[28] R.A. McFarland and R. Kadish, "Sex Differences in Finger Temperature Response to Music," Int'l J. Psychophysiology, vol. 11, pp. 295-298, 1991.
[29] B. Mittelmann and H. Wolff, "Emotions and Skin Temperature: Observations on Patients during Psychotherapeutic (Psychoanalytic) Interviews," Psychosomatic Medicine, vol. 5, pp. 211-231, 1943.
[30] U.M. Nater, E. Abbruzzese, M. Krebs, and U. Ehlert, "Sex Differences in Emotional and Psychophysiological Responses to Musical Stimuli," Int'l J. Psychophysiology, vol. 62, pp. 300-308, 2006.
[31] E.N. Marieb and K. Hoehn, Human Anatomy & Physiology, seventh ed. Pearson Education, 2007.
[32] J.-W. Chung and G.S. Vercoe, "The Affective Remixer: Personalized Music Arranging," Proc. Extended Abstracts on Human Factors in Computing Systems (CHI '06), pp. 393-398, 2006.
[33] J. Kim and E. André, "Emotion Recognition Based on Physiological Changes in Music Listening," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 12, pp. 2067-2083, Dec. 2008.
[34] J. Skowronek, M.F. McKinney, and S. Van de Par, "Ground Truth for Automatic Music Mood Classification," Proc. Seventh Int'l Conf. Music Information Retrieval (ISMIR), pp. 395-396, 2006.
[35] J. Skowronek, M.F. McKinney, and S. Van de Par, "A Demonstrator for Automatic Music Mood Estimation," Proc. Eighth Int'l Conf. Music Information Retrieval (ISMIR), pp. 345-346, 2007.
[36] M.D. Van der Zwaag, J.H.D.M. Westerink, and E.L. Van den Broek, "Deploying Music Characteristics for an Affective Music Player," Proc. IEEE Int'l Conf. Affective Computing & Intelligent Interaction, J. Cohn, A. Nijholt, and M. Pantic, eds., pp. 459-465, 2009.
[37] G. Wijnalda, S. Pauws, F. Vignoli, and H. Stuckenschmidt, "A Personalized Music System for Motivation in Sport Performance," IEEE Pervasive Computing, vol. 4, no. 3, pp. 26-32, July/Sept. 2005.
[38] S. Zhang, Q. Tian, S. Jiang, Q. Huang, and W. Gao, "Affective MTB Analysis Based on Arousal and Valence Features," Proc. IEEE Int'l Conf. Multimedia and Expo (ICME '08), pp. 1369-1372, 2008.
[39] N. Oliver and F. Flores-Mangas, "MPTrain: A Mobile, Music and Physiology-Based Personal Trainer," Proc. Eighth Conf. Human-Computer Interaction with Mobile Devices and Services, pp. 21-28, 2006.
[40] J.A. Healey, R.W. Picard, and F. Dabek, "A New Affect-Perceiving Interface and Its Application to Personalized Music Selection," Proc. Workshop Perceptual User Interfaces (PUI), M. Turk, ed., pp. 2-5, 1998.
[41] J.H. Janssen, E.L. Van den Broek, and J.H.D.M. Westerink, "Personalized Affective Music Player," Proc. IEEE Int'l Conf. Affective Computing and Intelligent Interaction (ACII), pp. 472-477, 2009.
[42] K. Höök, "Affective Loop Experiences: What Are They?" Proc. Third Int'l Conf. Persuasive Technology, pp. 1-12, 2008.
[43] K. Höök, "Affective Loop Experiences: Designing for Interactional Embodiment," Philosophical Trans. Royal Soc. B, vol. 364, pp. 3585-3595, 2009.
[44] R. Geenen and F.J.R. Van de Vijver, "A Simple Test of the Law of Initial Values," Psychophysiology, vol. 30, pp. 525-530, 1993.
[45] A. Schroeder, M.D. Van der Zwaag, and M. Hammer, "A Middleware Architecture for Human-Centred Pervasive Adaptive Applications," Proc. IEEE Int'l Conf. Self-Adaptive and Self-Organizing Systems, vol. 1, pp. 138-143, 2008.
[46] A. Haarmann, W. Boucsein, and F. Schaefer, "Combining Electrodermal Responses and Cardiovascular Measures for Probing Adaptive Automation during Simulated Flight," Applied Ergonomics, vol. 40, no. 6, pp. 1026-1040, 2009.
[47] D. Novak, M. Mihelj, J. Ziherl, A. Olensek, and M. Munih, "Measuring Motor Actions and Psychophysiology for Task Difficulty Estimation in Human-Robot Interaction," Proc. Seventh Int'l Conf. Methods and Techniques in Behavioral Research (MB '10), pp. 1-4, 2010.
[48] W.A. Wagenaar, "Note on the Construction of Digram-Balanced Latin Squares," Psychological Bull., vol. 72, no. 6, pp. 384-386, 1969.
[49] J. Wilder, Stimulus and Response: The Law of Initial Values. Wright, 1967.
[50] B.W. Silverman, Density Estimation for Statistics and Data Analysis. Chapman and Hall, 1986.
[51] S.H. Fairclough and L. Venables, "Prediction of Subjective States from Psychophysiology: A Multivariate Approach," Biological Psychology, vol. 71, pp. 100-110, 2006.
[52] L.J.M. Mulder, C. Dijksterhuis, A. Stuiver, and D. De Waard, "Cardiovascular State Changes during Performance of a Simulated Ambulance Dispatchers' Task: Potential Use for Adaptive Support," Applied Ergonomics, vol. 40, no. 6, pp. 965-77, 2009.
[53] G. Matthews, D.M. Jones, and A.G. Chamberlain, "Refining the Measurement of Mood: The UWIST Mood Adjective Checklist," British J. Psychology, vol. 81, no. 1, pp. 17-42, 1990.
[54] W. Boucsein, Electrodermal Activity, first ed. Plenum Press, 1992.
[55] M.D. Van der Zwaag, S.H. Fairclough, E. Spiridon, and J.H.D.M. Westerink, "The Impact of Music on Affect during Anger Inducing Drives," Proc. Fourth Int'l Conf. Affective Computing and Intelligent Interaction, 2011.
[56] M.D. Van der Zwaag, C. Dijksterhuis, D. De Waard, L.J.M. Mulder, J.H.D.M. Westerink, and K.A. Brookhuis, "The Influence of Music on Mood and Performance While Driving," Ergonomics, vol. 55, no. 1, pp. 12-22, 2012.
[57] M.D. Van der Zwaag, J.H. Janssen, C. Nass, J.H.D.M. Westerink, S. Chowdhury, and D. De Waard, "Using Music to Regulate Mood While Driving," submitted for publication.
[58] M.D. Van der Zwaag, T. Tijs, J.H.D.M. Westerink, and R. Molegraaf, "Personalized Relax Music to Reduce Patient Anxiety," Proc. 32nd Int'l Conf. Stress and Anxiety Research Soc. (STAR), P. Buchwald, K. Moore, and T. Ringeisen, eds., 2011.
[59] M.D. Van der Zwaag, T. Tijs, and J.H.D.M. Westerink, "Person- alized Calming Music to Reduce Patient Anxiety," Proc. Int'l Conf. Music Health and Wellbeing, Current Developments in Research and Practice, M. Shipton and E. Himonides, eds., pp. 211-212, 2011.
[60] M. Ouwerkerk, "Unobtrusive Emotions Sensing in Daily Life," Sensing Emotions. The Impact of Context on Experience Measurements. Philips Research Book Series, 12th ed., J.H.D.M. Westerink, M. Krans, and M. Ouwerkerk, eds., pp. 21-39, Springer, 2011.
[61] M.-Z. Poh, N.C. Swensen, and R.W. Picard, "A Wearable Sensor for Unobtrusive, Long-Term Assessment of Electrodermal Activity," IEEE Trans. Biomedical Eng., vol. 57, no. 5, pp. 1243-1252, 2010.
39 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool