The Community for Technology Leaders
RSS Icon
Issue No.03 - July-September (2012 vol.3)
pp: 311-322
Margaret McRorie , Queen's University Belfast, Belfast
Ian Sneddon , Queen's University Belfast, Belfast
Gary McKeown , Queen's University Belfast, Belfast
Elisabetta Bevacqua , CNRS-LTCI, Paris
Etienne de Sevin , LIP6 UMPC, Paris
Catherine Pelachaud , CNRS-LTCI, Paris
Convincing conversational agents require a coherent set of behavioral responses that can be interpreted by a human observer as indicative of a personality. This paper discusses the continued development and subsequent evaluation of virtual agents based on sound psychological principles. We use Eysenck's theoretical basis to explain aspects of the characterization of our agents, and we describe an architecture where personality affects the agent's global behavior quality as well as their back-channel productions. Drawing on psychological research, we evaluate perception of our agents' personalities and credibility by human viewers ({\rm N} = 187). Our results suggest that we succeeded in validating theoretically grounded indicators of personality in our virtual agents, and that it is feasible to place our characters on Eysenck's scales. A key finding is that the presence of behavioral characteristics reinforces the prescribed personality profiles that are already emerging from the still images. Our long-term goal is to enhance agents' ability to sustain realistic interaction with human users, and we discuss how this preliminary work may be further developed to include more systematic variation of Eysenck's personality scales.
Humans, Psychology, Face, Visualization, Biological system modeling, Real time systems, virtual agents, Personality traits, Eysenck, emotional traits
Margaret McRorie, Ian Sneddon, Gary McKeown, Elisabetta Bevacqua, Etienne de Sevin, Catherine Pelachaud, "Evaluation of Four Designed Virtual Agent Personalities", IEEE Transactions on Affective Computing, vol.3, no. 3, pp. 311-322, July-September 2012, doi:10.1109/T-AFFC.2011.38
[1] D.K.J. Heylen, A. Nijholt, and M. Poel, “‘Generating Nonverbal Signals for a Sensitive Artificial Listener,” Proc. Int'l Conf. Verbal and Nonverbal Comm. Behaviours, A. Esposito, M. Faunder-Zanny, E. Keller, and M. Marinaro, eds., pp. 264-274, 2007.
[2] P. Rizzo, M. Veloso, M. Miceliand, and A. Cesta, “Personality-Driven Social Behaviors in Believable Agents,” Proc. AAAI Fall Symp. Socially Intelligent Agents, pp. 109-114, 1997.
[3] B. Reeves and C. Nass, The Media Equation: How People Treat Computers, Television and New Media Like Real People and Places. CSLI Publications, 1996.
[4] A. Ortony, “On Making Believable Emotional Agents Believable,” Emotions in Humans and Artifacts, R. Trappl, P. Petta, and S. Payr, eds., MIT Press, 2003.
[5] E. Bevacqua, E. de Sevin, C. Pelachaud, M. McRorie, and I. Sneddon, “Building Credible Agents: Behaviour Influenced by Personality and Emotional Traits,” Proc. Int'l Conf. Kansei Eng. and Emotion Research, pp. 1071-1080, 2010.
[6] R. McCrae and P. Costa, “Validation of the Five-Factor Model of Personality across Instruments and Observers,” J. Personality and Social Psychology, vol. 52, pp. 81-90, 1987.
[7] H. Eysenck, The Measurement of Personality. Medical and Technical Publishers, 1976.
[8] L. Goldberg, “The Structure of Phenotypic Personality Traits,” Am. Psychologist, vol. 84, pp. 26-34, 1993.
[9] A. Saggino, “The Big Three or the Big Five? A Replication Study,” Personality and Individual Differences, vol. 28, no. 5, pp. 879-886, 2000.
[10] A. Arya, L. Jeffries, J. Ennis, and S.J. DiPaola, “Facial Actions as Visual Cues for Personality,” Computer Animation and Virtual Worlds, vol. 17, pp. 1-12, 2006.
[11] M. Mancini and C. Pelachaud, “Distinctiveness in Multimodal Behaviors,” Proc. Conf. Autonomous Agents and Multi-Agent Systems, L. Padgham, D.C. Parkes, J. Muller, and S. Parsons, eds., pp. 159-166, 2008.
[12] B. Hartmann, M. Mancini, S. Buisineand, and C. Pelachaud, “Design and Evaluation of Expressive Gesture Synthesis for Embodied Conversational Agents,” Proc. Third Int'l Joint Conf. Autonomous Agents & Multi-Agent Systems, pp. 1095-1096, 2005.
[13] C. Pelachaud and M. Bilvi, “Modelling Gaze Behavior for Conversational Agents,” Proc. Int'l Working Conf. Intelligent Virtual Agents, pp. 15-17, 2003.
[14] M. Mancini and C. Pelachaud, “Dynamic Behavior Qualifiers for Conversational Agents,” Proc. Seventh Int'l Conf. Intelligent Virtual Agents, C. Pelachaud, J-C. Martin, E. Andre, G. Chollet, K. Karpouzis, and D. Pel, eds., pp. 112-124, 2007.
[15] P. Borkenau, N. Mauer, R. Riemann, F.M. Spinath, and A. Angleitner, “Thin Slices of Behavior as Cues of Personality and Intelligence,” J. Personality and Social Psychology, vol. 86, pp. 599-614, 2004.
[16] I.S. Penton-Voak, N. Pound, A.C. Little, and D.I. Perrett, “Personality Judgments from Natural and Composite Facial Images: More Evidence for a Kernel of Truth in Social Perception,” Social Cognition, vol. 24, pp. 607-640, 2006.
[17] P. Ekman, W. Friesen, and J.C. Hager, The Facial Action Coding System. Weidenfeld & Nicolson, 2002.
[18] J. Tipples, “Wide Eyes and an Open Mouth Enhance Facial Threat,” Cognition and Emotion, vol. 21, pp. 535-557, 2007.
[19] N. Fink, N. Neave, J.T. Manning, and K. Grammar, “Facial Symmetry and the Big-Five Personality Factors,” Personality and Individual Differences, vol. 39, pp. 523-529, 2005.
[20] J. Walline, “High Eye-Q,” Science, vol. 320, no. 5879, p. 993, 2008, doi: 10.1126/science.320.5879.993d.
[21] D. Farabee, R. Nelson, and R. Spence, “Psychosocial Profiles of Criminal Justice- and Non-Criminal Justice-Referred Clients in Treatment,” Criminal Justice and Behaviour, vol. 20, pp. 336-346, 1993.
[22] D. Hebb, “Drives and the CNS (Conceptual Nervous System),” Psychological Rev., vol. 62, pp. 243-259, 1955.
[23] B. La France, A. Heisel, and M. Beatty, “Is There Empirical Evidence for a Nonverbal Profile of Extraversion? A Meta-Analysis and Critique of the Literature,” Comm. Monographs, vol. 71, pp. 28-48, 2004.
[24] A. Gill and J. Oberlander, “Taking Care of the Linguistic Features of Extraversion,” Proc. 24th Ann. Conf. Cognitive Science Soc., pp. 363-368, 2002.
[25] J. McCroskey, A. Heisel, and V. Richmond, “Eysenck's Big Three and Communication Traits: Three Correlational Studies,” Comm. Monographs, vol. 68, pp. 360-386, 2001.
[26] B. Smith, B. Brown, W. Strong, and A. Rencher, “Effects of Speech Rate on Personality Perceptions,” Language and Speech, vol. 18, pp. 145-152, 1975.
[27] W. Exline, “Affect Relations and Mutual Gaze in Dyads,” Affect, Cognition and Personality, S. Tomkins and C. Izard, ed., Springer, 1965.
[28] K. Pennebaker and L.A. King, “Linguistic Styles: Language Use as an Individual Difference,” J. Personality and Social Psychology, vol. 77, pp. 1296-1312, 1999.
[29] R.J. Larsen and T.K. Shackelford, “Gaze Avoidance: Personality and Social Judgements of People Who Avoid Direct Face-to-Face Contact,” Personality and Individual Differences, vol. 21, pp. 907-917, 1996.
[30] M. Schröder, “The SEMAINE API: Towards a Standards-based Framework for Building Emotion-Oriented Systems,” Advances in Human-Machine Interaction, vol. 2010, pp. 1-22,, 2010.
[31] N. Ward and W. Tsukahara, “Prosodic Features which Cue Back-Channel Responses in English and Japanese,” J. Pragmatics, vol. 23, pp. 1177-1207, 2000.
[32] R.M. Maatman, J. Gratch, and S. Marsella, “Natural Behavior of a Listening Agent,” Proc. Fifth Int'l Conf. Interactive Virtual Agents, pp. 25-36, 2005.
[33] D. Heylen, E. Bevacqua, M. Tellier, and C. Pelachaud, “Searching for Prototypical Facial Feedback Signals,” Proc. Seventh Int'l Conf. Intelligent Virtual Agents, pp. 147-153, 2007.
[34] E. Bevacqua, D. Heylen, M. Tellier, and C. Pelachaud, “Facial Feedback Signals for ECAs,” Proc. AISB '07 Ann. Convention, Workshop “Mindful Environments,” pp. 147-153, Apr. 2007.
[35] G. McKeown, M.F. Valstar, R. Cowie, and M. Pantic, “The SEMAINE Corpus of Emotionally Coloured Character Interactions,” Proc. IEEE Int'l Conf. Multimedia & Expo, pp. 1079-1084, 2010.
[36] R.R. McCrae and P.T. Costa, Personality in Adulthood: A Five Factor Theory Perspective. Guilford Press, 2003.
[37] P. Borkenau, N. Mauer, R. Riemann, F. Spinath, and A. Angleitner, “Thin Slices of Behaviour as Cues of Personality and Intelligence,” J. Personality and Social Psychology, vol 86, no. 4, pp. 599-614, 2004.
[38] D.C. Funder and S.G. West, “Consensus, Self-Other Agreement and Accuracy in Personality Judgement: An Introduction,” J. Personality, vol. 61, pp. 457-476, 1993.
[39] T.D. Letzring, S.M. Wells, and D.C. Funder, “Information Quantity and Quality Affect the Realistic Accuracy of Personality Judgment,” J. Personality and Social Psychology, vol 91, no. 1, pp. 111-123, 2006.
[40] N. Ambady, F.J. Bernieri, and J.A. Richeson, “Toward a History of Social Behaviour: Judgemental Accuracy from Thin Slices of the Behavioural Stream,” Advances in Experimental Social Psychology, vol. 32, pp. 201- 271, 2000.
[41] R.R. McCrae, S.V. Stone, P.J. Fagan, and P.T. Costa, “Identifying Causes of Disagreement between Self-Reports and Spouse Ratings of Personality,” J. Personality, vol. 66, no. 3, pp. 285-313, 1998.
[42] A.R. King and A.N. Pate, “Individual Differences in Judgemental Tendencies Derived from First Impressions,” Personality and Individual Differences, vol. 33, no. 1, pp. 131-145, 2002.
[43] N. Ambady and R. Rosenthal, “Thin Slices of Behaviour as Predictors of Interpersonal Consequences: A Meta-Analysis,” Psychological Bull., vol. 111, no. 2, pp. 256-274, 1992.
[44] M. Shevlin, S. Walker, M.N.O. Davies, P. Banyard, and C.A. Lewis, “Can You Judge a Book by Its Cover? Evidence of Self-Stranger Agreement on Personality at Zero Acquaintance,” Personality and Individual Differences, vol. 35, pp. 1373-1383, 2003.
[45] R. Hassin and Y. Trope, “Facing Faces: Studies on the Cognitive Aspects of Physiognomy,” J. Personality and Social Psychology, vol. 78, pp. 837-852, 2000.
[46] C. Toris and B.M. DePaulo, “Effects of Actual Deception and Suspiciousness of Deception on Interpersonal Perceptions,” J. Personality and Social Psychology, vol. 47, pp. 1063-1073, 1984.
[47] D.R. Carney, C.R. Colvin, and J.A. Hall, “A Thin Slice Perspective on the Accuracy of First Impressions,” J. Research in Personality, vol. 41, pp. 1054-1072, 2007.
[48] D.C. Funder and K. Dobroth, “Differences between Traits: Properties Associated with Inter-Judge Agreement,” J. Personality and Social Psychology, vol. 52, pp. 409-418, 1987.
[49] D.C. Funder, “Accuracy in Personality Judgement: Research and Theory Concerning an Obvious Question,” Personality Psychology in the Workplace: Decade of Behaviour, B.W. Roberts and R. Hogan, eds., pp. 121-140, Am. Psychological Assoc., 2001.
[50] L.J. Francis, L.B. Brownand, and R. Philipchalk, “The Development of an Abbreviated Form of the Revised Eysenck Personality Questionnaire,(EPQR-A)—Its Use among Students in England, Canada, the USA and Australia,” Personality and Individual Differences, vol. 13, no. 4, pp. 443-449, 1992.
[51] G.J. McKeown, “Chatting with a Virtual Agent: The SEMAINE Project Character Spike [Video file],” http://youtu.be6KZc6e_ EuCg, Apr. 2011.
[52] R. Lippaand and J.K. Dietz, “The Relation of Gender, Personality and Intelligence to Judges' Accuracy in Judging Strangers' Personality from Brief Video Segments,” J. Nonverbal Behaviour, vol. 24, pp. 25-43, 2000.
[53] R. Gifford, “Mapping Nonverbal Behaviour on the Interpersonal Circle,” J. Personality and Social Psychology, vol. 61, pp. 279-288, 1999.
[54] D.C. Funder and C.D. Sneed, “Behavioural Manifestations of Personality: An Ecological Approach to Judgemental Accuracy,” J. Personality and Social Psychology, vol. 64, pp. 479-490, 1993.
[55] D. Matsumoto et al., “A New Test to Measure Emotion Recognition Ability: Matsumoto and Ekman's Japanese and Caucasian Brief Affect Recognition Test (JACBART),” J. Nonverbal Behaviour, vol. 24, pp. 179-209, 2000.
[56] C.E. Izard, The Psychology of Emotions. Plenum Press, 1991.
[57] V. Demeure, R. Niewiadomski, and C. Pelachaud, “How Believability of Virtual Agent Is Linked to Warmth, Competence, Personification and Embodiment?,” Int'l J. Presence, in press.
[58] I.V. Blair, C.J. Judd, M.S. Sadler, and C. Jenkins, “The Role of Afrocentric Features in Person Perception: Judging by Features and Categories,” J. Personality & Social Psychology, vol. 83, no. 1, pp. 5-25, 2002.
[59] S.E. Holleran, M.R. Mehl, and S. Levitt, “Eavesdropping on Social Life: The Accuracy Ratings of Daily Behaviour from Thin Slices of Natural Conversations,” J. Research in Personality, vol. 43, pp. 660-672, 2009.
[60] D.A. Kenny and T.V. West, “Self-Perception as Interpersonal Perception,” Self and Relationships, J. Wood, J. Holmes, and A. Tesser, eds., pp. 119-138, Psychology Press, 2008.
[61] J. Krueger and M. Rothbart, “Use of Categorical and Individuating Information in Making Inferences about Personality,” J. Personality and Social Psychology, vol. 55, pp. 187-195, 1988.
[62] E. de Sevin, S. Hyniewska, and C. Pelachaud, “Real-Time Listener Action Selection for ECAs According to Personality,” Proc. Int'l Conf. Intelligent Virtual Agents, pp. 187-193, 2010.
59 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool