This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Smile When You Read This, Whether You Like It or Not: Conceptual Challenges to Affect Detection
January-June 2010 (vol. 1 no. 1)
pp. 38-41
Arvid Kappas, Jacobs University Bremen, Bremen
The survey by Calvo and D'Mello presents a useful overview of the progress of and issues in affect detection. They focus on emotion theories that are relevant to Affective Computing (AC) and suggest stronger collaborations between disciplines. My contribution emphasizes the importance of these issues for AC. In fact, empirical research strongly suggests that facial, vocal, and bodily expressions, subjective experience, and physiological changes are often not very highly correlated in spontaneous situations. Overestimating this cohesion limits the usefulness of affect detection methods in real-world applications. Other factors, such as social context, knowledge regarding the goals of certain interactions, as well as interindividual differences are critically important factors for improving affect detection. At times, social concepts, such as politeness, might be more conducive to model realistic behavior. Knowledge on affect perception is important to estimate the level of realism required to create satisfying and productive interactions between users and artificial systems. Interdisciplinary joint research between social and biological scientists on the one hand and computer scientists and engineers on the other is necessary to deal with the complexity of affective processes. All disciplines involved have much to gain in the process.

[1] D. Lazer, A. Pentland, L. Adamic, S. Aral, A.L. Barabasi, D. Brewer, N. Christakis, N. Contractor, J. Fowler, M. Gutmann, T. Jebara, G. King, M. Macy, D. Roy, and M. Van Alstyne, "Computational Social Science," Science, vol. 323, pp. 721-723, 2009.
[2] R.W. Picard, Affective Computing. MIT Press, 1999.
[3] A. Kappas, "The Science of Emotion as a Multidisciplinary Research Paradigm," Behavioral Processes, vol. 60, pp. 85-98, 2002.
[4] P. Ekman, "All Emotions Are Basic," The Nature of Emotion: Fundamental Questions, P. Ekman and R. J. Davidson, eds., pp. 15-19, Oxford Univ. Press, 1992.
[5] E.G. Krumhuber and A.S.R. Manstead, "Can Duchenne Smiles Be Feigned? New Evidence on Felt and False Smiles," Emotion, vol. 9, pp. 807-820, 2009.
[6] P. Ekman, "Universals and Cultural Differences in Facial Expressions of Emotions," Proc. Nebraska Symp. Motivation 1971, 1972.
[7] D. Matsumoto, "Cultural Similarities and Differences in Display Rules," Motivation and Emotion, vol. 14, pp. 195-214, 1990.
[8] A. Kappas, "What Facial Expressions Can and Cannot Tell Us about Emotions," The Human Face: Measurement and Meaning, M. Katsikitis, ed., pp. 215-234, Kluwer, 2003.
[9] A. Fridlund, Human Facial Expression: An Evolutionary View. Academic Press, 1994.
[10] A. Fridlund, "The Sociality of Solitary Smiles: Effects of an Implicit Audience," J. Personality and Social Psychology, vol. 60, pp. 229-240, 1991.
[11] U. Hess, R. Banse, and A. Kappas, "The Intensity of Facial Expression Is Determined by Underlying Affective State and Social Situation," J. Personality and Social Psychology, vol. 69, pp. 280-288, 1995.
[12] E. Jakobs, A.S.R. Manstead, and A.H. Fischer, "Social Motives and Emotional Feelings as Determinants of Facial Displays: The Case of Smiling," Personality and Social Psychology Bull., vol. 25, pp. 424-435, 1999.
[13] E. Jakobs, A.S.R. Manstead, and A.H. Fischer, "Social Motives, Emotional Feelings, and Smiling," Cognition and Emotion, vol. 13, pp. 321-345, 1999.
[14] E. Jakobs, A.S.R. Manstead, and A.H. Fischer, "Social Context Effects on Facial Activity on a Negative Emotional Set-ting," Emotion, vol. 1, pp. 51-69, 2001.
[15] B. Parkinson, "Do Facial Movements Express Emotions or Communicative Motives?" Personality and Social Psychology Rev., vol. 9, pp. 278-311, 2005.
[16] I.B. Mauss and M.D. Robinson, "Measures of Emotion: A Review," Cognition and Emotion, vol. 23, pp. 209-237, 2009.
[17] A. Kappas and N. Poliakova, "Judgments of the Affective Valence of Spontaneous Vocalizations: The Influence of Situational Context," Emotions of the Human Voice, K. Izdebski, ed., pp. 109-122, Plural, 2007.
[18] J.A. Russell, J.A. Bachorowski, and J.M. Fernández-Dols, "Facial and Vocal Expressions of Emotion," Ann. Rev. Psychology, vol. 42, pp. 329-349, 2003.
[19] P. Ekman and M. O'Sullivan, "Who Can Catch a Liar?" Am. Psychologist, vol. 46, pp. 913-920, 1991.
[20] J.R. Averill, Anger and Aggression: An Essay on Emotion. Springer, 1982.

Index Terms:
Emotion theory, emotion detection, facial expressions, social context.
Citation:
Arvid Kappas, "Smile When You Read This, Whether You Like It or Not: Conceptual Challenges to Affect Detection," IEEE Transactions on Affective Computing, vol. 1, no. 1, pp. 38-41, Jan.-June 2010, doi:10.1109/T-AFFC.2010.6
Usage of this product signifies your acceptance of the Terms of Use.