This Article 
 Bibliographic References 
 Add to: 
Broadening the Scope of Affect Detection Research
January-June 2010 (vol. 1 no. 1)
pp. 42-45
Rainer Reisenzein, University of Greifswald, Greifswald
I propose to broaden the scope of affect detection research in three related directions. First, the task definition should be broadened from the detection of affects to the inference of mental states. Second, the detection process should be reconceptualized as an inference to the best explanation that makes essential use of a theory of mind. Third, additional data sources should be utilized to infer emotions: information about the situation (eliciting events), information about emotion-related goal-directed actions, and self-reports about emotions.

[1] M.G. Armentano and A. Amandi, "Plan Recognition for Interface Agents. State of the Art," Artificial Intelligence Rev., vol. 28, pp. 131-162, 2007.
[2] C. Conati, "Probabilistic Assessment of User's Emotions in Educational Games," J. Applied Artificial Intelligence, vol. 16, pp. 555-575, 2002.
[3] J.-L. Dessalles, Why We Talk: The Evolutionary Origins of Language. Oxford Univ. Press, 2007.
[4] M.J. Doherty, Theory of Mind: How Children Understand Others' Thoughts and Feelings. Psychology Press, 2009.
[5] P. Ekman, "An Argument for Basic Emotions," Cognition and Emotion, vol. 6, pp. 169-200, 1992.
[6] A. Fridlund, Human Facial Expression. An Evolutionary View. Academic Press, 1994.
[7] N.H. Frijda, The Emotions. Cambridge Univ. Press, 1986.
[8] S.R. Fussell, The Verbal Communication of Emotion: Interdisciplinary Perspectives. Lawrence Erlbaum, 2002.
[9] A.I. Goldman, Simulating Minds: The Philosophy, Psychology and Neuroscience of Mindreading. Oxford Univ. Press, 2006.
[10] F. Heider, The Psychology of Interpersonal Relations. Wiley, 1958.
[11] M. Holodynski, "The Miniaturization of Expression in the Development of Emotional Self-Regulation," Developmental Psychology, vol. 40, pp. 16-28, 2004.
[12] A. Kapoor, B. Burleson, and R. Picard, "Automatic Prediction of Frustration," Int'l J. Human Computer Studies, vol. 65, pp. 724-736, 2007.
[13] R.J. Kate and R.J. Mooney, "Probabilistic Abduction Using Markov Logic Networks," Proc. IJCAI-'09 Workshop Plan, Activity, and Intent Recognition, July 2009.
[14] A. Kappas and A. Pecchinenda, "Don't Wait for the Monsters to Get You: A Video Game task to Manipulate Appraisals in Real Time," Cognition and Emotion, vol. 13, pp. 119-124, 1999.
[15] J.T. Larsen, G.G. Berntson, K.M. Poehlmann, T.A. Ito, and J.T. Cacioppo, "The Psychophysiology of Emotion," Handbook of Emotions, M. Lewis, J.M. Haviland-Jones, and L.F. Barrett, eds., third ed., pp. 180-195, Guilford, 2008.
[16] B.F. Malle, How the Mind Explains Behavior: Folk Explanations, Meaning, and Social Interaction. MIT Press, 2004.
[17] I.B. Mauss, F.H. Wilhelm, and J.J. Gross, "Is There Less to Social Anxiety than Meets the Eye? Emotion Experience, Expression, and Bodily Responding," Cognition and Emotion, vol. 18, pp. 631-662, 2004.
[18] A. Ortony, G. Clore, and A. Collins, The Cognitive Structure of Emotions. Cambridge Univ. Press, 1988.
[19] R.W. Picard, Affective Computing. MIT Press, 1997.
[20] B. Parkinson, "What Holds Emotions Together? Meaning and Response Coordination," Cognitive Systems Research, vol. 10, pp. 31-47, 2009.
[21] D.V. Pynadath and S. Marsella, "PsychSim: Modeling Theory of Mind with Decision-Theoretic Agents" Proc. 19th Int'l Joint Conf. Artificial Intelligence, pp. 1181-1186, 2005.
[22] R. Reisenzein, "Exploring the Strength of Association between the Components of Emotion Syndromes: The Case of Surprise," Cognition and Emotion, vol. 14, pp. 1-38, 2000.
[23] R. Reisenzein, "Emotions as Metarepresentational States of Mind: Naturalizing the Belief-Desire Theory of Emotion," Cognitive Systems Research, vol. 10, pp. 6-20, 2009.
[24] R. Reisenzein and M. Junge, "Language and Emotion from the Perspective of the Computational Belief-Desire Theory of Emotion," The Conceptualisation of Emotion, Lodz Studies in Language, vol. 20, B. Lewandowska-Tomaszczyk and P. Wilson, eds., Peter Lang, 2010 (in press).
[25] R. Reisenzein, S. Bördgen, T. Holtbernd, and D. Matz, "Evidence for Strong Dissociation between Emotion and Facial Displays: The Case of Surprise," J. Personality and Social Psychology, vol. 91, pp. 295-315, 2006.
[26] R. Reisenzein, S. Bördgen, M. Studtmann, and H. Weber, "Spontaneous Facial Expressions of Emotion: Data on Surprise, Disgust, and Anger," Proc. XXIX Int'l Congress Psychology, July 2008.
[27] R. Reisenzein and U. Rudolph, "The Discovery of Common-Sense Psychology," Social Psychology, vol. 39, pp. 141-150, 2008.
[28] C. Reynolds and R. Picard, "Affective Sensors, Privacy, and Ethical Contracts," Proc. Conf. Human Factors in Computing Systems, pp. 1103-1106, 2004.
[29] P.J. Richerson and R. Boyd, Not by Genes Alone. How Culture Transformed Human Evolution. Univ. of Chicago Press, 2005.
[30] B. Rimé, "Emotions Elicit the Social Sharing of Emotion: Theory and Empirical Review," Emotion Rev., vol. 1, pp. 60-85, 2009.
[31] W. Ruch, "Will the Real Relationship between Facial Expression and Affective Experience Please Stand Up: The Case of Exhilaration," Cognition and Emotion, vol. 9, pp. 33-58, 1995.
[32] J.A. Russell, J.-A. Bachorowski, and J.M. Fernández-Dols, "Facial and Vocal Expressions of Emotion," Ann. Rev. Psychology, vol. 54, pp. 329-349, 2003.
[33] M. Siemer and R. Reisenzein, "The Process of Emotion Inference," Emotion, vol. 7, pp. 1-20, 2007.
[34] P. Thagard, Coherence in Thought and Action. MIT Press, 2000.
[35] H. Wagner and V. Lee, "Facial Behavior Alone and in the Presence of Others," The Social Context of Nonverbal Behavior, P. Philippot, R.S. Feldman, and E.J. Coats, eds., pp. 262-286, Cambridge Univ. Press, 1999.
[36] N. Wang and S. Marsella, "Introducing EVG: An Emotion Evoking Game," Proc. Sixth Int'l Conf. Intelligent Virtual Agents, Aug. 2006.
[37] B. Weiner, Social Motivation, Justice, and the Moral Emotions: An Attributional Approach. Erlbaum, 2006.
[38] Z. Zeng, M. Pantic, G.I. Roisman, and T.S. Huang, "A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 1, pp. 39-58, Jan. 2009.

Index Terms:
Human-computer interaction, affective computing, affect detection, theory of mind, inference to the best explanation, emotion self-reports.
Rainer Reisenzein, "Broadening the Scope of Affect Detection Research," IEEE Transactions on Affective Computing, vol. 1, no. 1, pp. 42-45, Jan.-June 2010, doi:10.1109/T-AFFC.2010.9
Usage of this product signifies your acceptance of the Terms of Use.