This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Identifying Emotion through Implicit and Explicit Measures: Cultural Differences, Cognitive Load, and Immersion
April-June 2012 (vol. 3 no. 2)
pp. 199-210
ASCII Text
x 
 
M. Yasumura, M. Chignell, D. Lottridge, "Identifying Emotion through Implicit and Explicit Measures: Cultural Differences, Cognitive Load, and Immersion," IEEE Transactions on Affective Computing, vol. 3, no. 2, pp. 199-210, April-June, 2012.
 
 
BibTex
x
 
@article{ 10.1109/T-AFFC.2011.36,
author = {M. Yasumura and M. Chignell and D. Lottridge},
title = {Identifying Emotion through Implicit and Explicit Measures: Cultural Differences, Cognitive Load, and Immersion},
journal ={IEEE Transactions on Affective Computing},
volume = {3},
number = {2},
issn = {1949-3045},
year = {2012},
pages = {199-210},
doi = {http://doi.ieeecomputersociety.org/10.1109/T-AFFC.2011.36},
publisher = {IEEE Computer Society},
address = {Los Alamitos, CA, USA},
}
 
 
RefWorks Procite/RefMan/Endnote
x 
 
TY - JOUR
JO - IEEE Transactions on Affective Computing
TI - Identifying Emotion through Implicit and Explicit Measures: Cultural Differences, Cognitive Load, and Immersion
IS - 2
SN - 1949-3045
SP199
EP210
EPD - 199-210
A1 - M. Yasumura,
A1 - M. Chignell,
A1 - D. Lottridge,
PY - 2012
KW - skin
KW - cognition
KW - cultural aspects
KW - data analysis
KW - emotion recognition
KW - affective interaction
KW - emotion identification
KW - cultural differences
KW - cognitive load
KW - emotional experience
KW - skin conductance measures
KW - slider configurations
KW - short videos
KW - Japanese participants
KW - Canadian participants
KW - data interpretation techniques
KW - implicit emotion data
KW - explicit emotion data
KW - Videos
KW - Physiology
KW - Particle measurements
KW - Atmospheric measurements
KW - Prototypes
KW - Skin
KW - Computational modeling
KW - evaluation/methodology.
KW - Models and principles
KW - user/machine systems
KW - human factors
KW - human centered computing
KW - information interfaces and representation
KW - multimedia information systems
VL - 3
JA - IEEE Transactions on Affective Computing
ER -
 
M. Yasumura, Interaction Design Lab., Keio Univ., Fujisawa, Japan
M. Chignell, Dept. of Mech. & Ind. Eng., Univ. of Toronto, Toronto, ON, Canada
D. Lottridge, Dept. of Commun., Stanford Univ., Stanford, CA, USA
Measures of emotion should accurately characterize the nature of an emotional experience and determine whether that experience is universal or unique to a subgroup or culture. We investigated the value of assessing emotion through skin conductance (an easy-to-interpret physiological measure) and sliders (frequently used and direct measures of perceived emotion). This paper describes findings from two experiments. The first evaluated various slider configurations and found that measured emotions successfully characterized the emotional nature of short videos. The second experiment collected the slider and skin conductance measures of emotion while one sample of Japanese participants and another sample of Canadian participants viewed longer videos. The measures were sensitive enough to identify cultural differences consistent with existing literature and were also able to identify parts of the experience where members from different cultures reacted consistently, pinpointing content that provoked a universal experience. We offer a toolkit of data interpretation techniques to gain more insight into the implicit and explicit emotion data: analyses for expressiveness and agreement that can infer states such as engagement and fatigue. We summarize the aspects of our measurement approach and toolkit in a model: the ability to distinguish the emotional nature of stimuli, individuals, and affective interaction.

[1] D. Lottridge, M. Chignell, and A. Jovicic, "Affective Interaction," Rev. Human Factors and Ergonomics, vol. 7, no. 1, pp. 197-237, 2011.
[2] D. Norman, Emotional Design: Why We Love (or Hate) Everyday Things. Basic Books, 2005.
[3] R.A. Calvo and S.K. D'Mello, "Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications," IEEE Trans. Affective Computing, vol. 1, no. 1, pp. 18-37, Jan.-June 2010.
[4] G. Laurens and P. Desmet, "Designing a Research Tool: A Case-Study in How Design and Research Can Cross-Fertilize Each Other," Proc. Design Research Soc., pp. 362(1)-362(10), 2008.
[5] A. Ranjan, J. Birnholtz, and R. Balakrishnan, "Improving Meeting Capture by Applying Television Production Principles with Audio and Motion Detection," Proc. 26th Ann. SIGCHI Conf. Human Factors in Computing Systems, pp. 227-236. 2008.
[6] J.A. Russell, "A Circumplex Model of Affect," J. Personality and Social Psychology, vol. 39, pp. 1161-1178, 1980.
[7] P. Ekman, "Are There Basic Emotions?" Psychological Rev., vol. 99, no. 1, pp. 550-553, 1992.
[8] J.T. Cacioppo and W.L. Gardner, "Emotion," Ann. Rev. of Psychology, vol. 50, pp. 191-214, 1999.
[9] P. Lang, "The Emotion Probe: Studies of Motivation and Attention," Am. Psychologist, vol. 50, no. 5, pp. 372-385, 1995.
[10] J.A. Russell, "Core Affect and the Psychological Construction of Emotion," Psychological Rev. vol. 110, no. 1, pp. 145-172, 2003.
[11] J.A. Russell and A. Mehrabian, "Evidence for a Three-Factor Theory of Emotions," J. Research in Personality, vol. 11, pp. 273-294, 1977.
[12] P. Desmet, "Measuring Emotion: Development and Application of an Instrument to Measure Emotional Responses to Products," Funology: From Usability to Enjoyment, M. Blythe, A.F. Monk, K. Overbeeke, and P.C. Wright, eds., pp. 111-123, Kluwer Academic Press, 2003.
[13] C. Swindells, K.E. MacLean, K.S. Booth, and M. Meitner, "A Case-Study of Affect Measurement Tools for Physical User Interface Design," Proc. Graphics Interface, vol. 137, pp. 243-250, 2006.
[14] J.A. Russell, A. Weiss, and G.A. Mendelsohn, "Affect Grid: A Single-Item Scale of Pleasure and Arousal," J. Personality and Social Psychology, vol. 57, no. 3, pp. 493-502, 1989.
[15] D. Kahneman, "Objective Happiness," Well-Being: The Foundations of Hedonic Psychology, D. Kahneman, E. Diener, and N. Schwarz, eds., pp. 3-25, Russell Sage Foundation, 1999.
[16] R.L. Mandryk and K.M. Inkpen, "Physiological Indicators for the Evaluation of Co-Located Collaborative Play," Proc. ACM Conf. Computer Supported Cooperative Work, pp. 102-111, 2004.
[17] R.L. Hazlett, "Measuring Emotional Valence During Interactive Experiences: Boys at Video Game Play," Proc. SIGCHI Conf. Human Factors in Computing Systems, pp. 1023-1026, 2006.
[18] I.B. Mauss, R.W. Levenson, L. McCarter, F.H. Wilhelm, and J.J. Gross, "The Tie That Binds? Coherence Among Emotional Experience, Behavior, and Autonomic Physiology," Emotion, vol. 5, pp. 175-190, 2005.
[19] D.T. Lykken and P.H. Venables, "Direct Measurement of Skin Conductance: A Proposal for Standardization," Psychophysiology, vol. 8, no. 5, pp. 656-672, 1971.
[20] C. Latulipe, E.A. Carroll, and D. Lottridge, "Love, Hate, Arousal and Engagement: Exploring Audience Responses to Performing Arts," Proc. Ann. Conf. Human Factors in Computing Systems, pp 1845-1854, 2011.
[21] R. Cowie, E. Douglas-Cowie, S. Savvidou, E. McMahon, M. Sawey, and M. Schröder, "'FEELTRACE': An Instrument for Recording Perceived Emotion in Real time," Proc. ISCA Workshop Speech and Emotion, pp. 19-24, 2000.
[22] J.M. Gottman and R.W. Levenson, "A Valid Procedure for Obtaining Self-Report of Affect in Marital Interaction," J. Consulting and Clinical Psychology, vol. 53, no. 2., pp. 151-160, 1985.
[23] J. LeDoux, The Emotional Brain, the Mysterious Underpinnings of Emotional Life. Simon & Schuster, 1996.
[24] C.A. Hutcherson, P.R. Goldin, K.N. Ochsner, J.D. Gabrieli, J.L. Feldman Barret, and J.J. Gross, "Attention and Emotion: Does Rating Emotion Alter Neural Responses to Amusing and Sad Films?" NeuroImage, vol. 27, pp. 656-668, 2005.
[25] R. Bar-On, EQ-i: Bar-On Emotional Quotient Inventory: A Measure of Emotional Intelligence: Technical Manual, Multi-Health Systems, Inc., 1995.
[26] J.D. Mayer and P. Salovey, "What Is Emotional Intelligence?" Emotional Development and Emotional Intelligence: Implications for Educators, P. Salovey and D. Sluyter, eds., pp. 3-31, Basic Books, 1997.
[27] R.D. Lane, D.M. Quinlan, G.E. Schwartz, P.A Walker, and S.B. Zeitlin, "The Levels of Emotional Awareness Scale: A Cognitive-Developmental Measure of Emotion," J. Personality Assessment, vol. 55, pp. 124-134, 1990.
[28] B. Mesquita and M. Karasawa, "Different Emotional Lives," Cognition and Emotion, vol. 16, pp. 127-141, 2002.
[29] D. Matsumoto, "More Evidence for the Universality of a Contempt Expression," Motivation and Emotion, vol. 16, pp. 363-368, 1992.
[30] D. Lottridge and M. Chignell, "Emotrace: Tracing Emotions through Human-System Interaction," Proc. Human Factors and Ergonomics Soc., pp. 1541-1545, 2009.
[31] J. Rottenberg, R. Ray, and J.J. Gross, "Emotion Elicitation Using Video," Handbook of Emotion Elicitation and Assessment, J. Coan, and J. Allen, eds., pp 9-28, Oxford Univ. Press, 2007.
[32] P.A. Hancock and N. Meshkati, Human Mental Workload. Elsevier, 1988.
[33] Z. Kunda, Social Cognition: Making Sense of People. The MIT Press, 1999.
[34] D. Lottridge and M. Chignell, "Emotional Majority Agreement: A Psychometric Property of Affective Self-report Instruments," Proc. IEEE Int'l Conf.—Science and Technology for Humanity TIC-STH, pp. 795-800, 2009.
[35] D. Lottridge and M. Chignell, "Emotional Bandwidth: Information Theory Analysis of Affective Response Ratings Using a Continuous Slider," Proc. 12th IFIP TC13 Conf. Human-Computer Interaction, pp. 111-114, 2009.
[36] C.E. Shannon and W. Weaver, The Mathematical Theory of Communication. The Univ. of Illinois Press, 1949.
[37] M. Csikszentmihalyi, Flow: The Psychology of Optimal Experience. Harper and Row, 1990.

Index Terms:
skin,cognition,cultural aspects,data analysis,emotion recognition,affective interaction,emotion identification,cultural differences,cognitive load,emotional experience,skin conductance measures,slider configurations,short videos,Japanese participants,Canadian participants,data interpretation techniques,implicit emotion data,explicit emotion data,Videos,Physiology,Particle measurements,Atmospheric measurements,Prototypes,Skin,Computational modeling,evaluation/methodology.,Models and principles,user/machine systems,human factors,human centered computing,information interfaces and representation,multimedia information systems
Citation:
M. Yasumura, M. Chignell, D. Lottridge, "Identifying Emotion through Implicit and Explicit Measures: Cultural Differences, Cognitive Load, and Immersion," IEEE Transactions on Affective Computing, vol. 3, no. 2, pp. 199-210, April-June 2012, doi:10.1109/T-AFFC.2011.36
Usage of this product signifies your acceptance of the Terms of Use.