Issue No.01 - Jan.-March (2012 vol.3)
pp: 56-68
M. A. Salichs , E.P.S., Robot. Lab., Univ. Carlos III de Madrid, Madrid, Spain
M. Malfaz , E.P.S., Robot. Lab., Univ. Carlos III de Madrid, Madrid, Spain
In this paper, a new approach to the generation and the role of artificial emotions in the decision-making process of autonomous agents (physical and virtual) is presented. The proposed decision-making system is biologically inspired and it is based on drives, motivations, and emotions. The agent has certain needs or drives that must be within a certain range, and motivations are understood as what moves the agent to satisfy a drive. Considering that the well-being of the agent is a function of its drives, the goal of the agent is to optimize it. Currently, the implemented artificial emotions are happiness, sadness, and fear. The novelties of our approach are, on one hand, that the generation method and the role of each of the artificial emotions are not defined as a whole, as most authors do. Each artificial emotion is treated separately. On the other hand, in the proposed system it is not mandatory to predefine either the situations that must release any artificial emotion or the actions that must be executed in each case. Both the emotional releaser and the actions can be learned by the agent, as happens on some occasions in nature, based on its own experience. In order to test the decision-making process, it has been implemented on virtual agents (software entities) living in a simple virtual environment. The results presented in this paper correspond to the implementation of the decision-making system on an agent whose main goal is to learn from scratch how to behave in order to maximize its well-being by satisfying its drives or needs. The learning process, as shown by the experiments, produces very natural results. The usefulness of the artificial emotions in the decision-making system is proven by making the same experiments with and without artificial emotions, and then comparing the performance of the agent.
software agents, decision making, intelligent robots, learning (artificial intelligence), robot, emotion modeling, decision-making system, artificial agent, artificial emotion, autonomous agent, drive, motivation, happiness, sadness, fear, generation method, virtual agent, software entities, virtual environment, learning process, Decision making, Humans, Monitoring, Robot kinematics, Animals, Appraisal, learning., Artificial emotions, decision-making system, motivations, autonomy
M. A. Salichs, M. Malfaz, "A New Approach to Modeling Emotions and Their Use on a Decision-Making System for Artificial Agents", IEEE Transactions on Affective Computing, vol.3, no. 1, pp. 56-68, Jan.-March 2012, doi:10.1109/T-AFFC.2011.32
[1] J. LeDoux, El Cerebro Emocional. Ariel/Planeta, 1996.
[2] A. Damasio, Descartes' Error—Emotion, Reason and Human Brain. Picador, 1994.
[3] A. Sloman, “How Many Separately Evolved Emotional Beasties Live within Us,” Emotions in Humans and Artifacts, MIT Press, 2003.
[4] A. Kelley, “Neurochemical Networks Encoding Emotion and Motivation: An Evolutionary Perspective,” Who Needs Emotions? The Brain Meets the Robot, Oxford Univ. Press, 2004.
[5] R.W. Picard, “What Does It Mean for a Computer to Have Emotions?” Emotions in Humans and Artifacts, MIT Press, 2003.
[6] E. Rolls, “Theory of Emotion, Its Functions, and Its Adaptive Value,” Emotions in Humans and Artifacts, MIT Press, 2003.
[7] C. Breazeal, Designing Sociable Robots. MIT Press, 2002.
[8] S. Gadanho, “Reinforcement Learning in Autonomous Robots: An Empirical Investigation of the Role of Emotions,” PhD dissertation, Univ. of Edinburgh, 1999.
[9] F. Michaud, P. Pirjanian, J. Audet, and D. Ltourneau, “Artificial Emotion and Social Robotics,” Distributed Autonomous Robotic Systems, pp. 121-130, Springer Verlag, 2000.
[10] L. Cañamero, “Designing Emotions for Activity Selection in Autonomous Agents,” Emotions in Humans and Artifacts, MIT Press, 2003.
[11] R.C. Arkin, “Moving Up the Food Chain: Motivation and Emotion in Behavior-Based Robots,” Who Needs Emotions? The Brain Meets the Robots, Oxford Univ. Press, 2004.
[12] M.A. Salichs, R. Barber, A.M. Khamis, M. Malfaz, J.F. Gorostiza, R. Pacheco, R. Rivas, A. Corrales, and E. Delgado, “Maggie: A Robotic Platform for Human-Robot Social Interaction,” Proc. IEEE Int'l Conf. Robotics, Automation, and Mechatronics, 2006.
[13] M. Minsky, The Society of Mind. Simon and Schuster, 1986.
[14] K.L. Bellman, “Emotions: Meaningful Mappings between the Individual and Its World,” Emotions in Humans and Artifacts, MIT Press, 2003.
[15] A. Ortony, “On Making Believable Emotional Agents Believable,” Emotions in Humans and Artifacts, pp. 188-211, MIT Press, 2003.
[16] J. Fellows, “From Human Emotions to Robot Emotions,” Proc. AAAI Spring Symp. Architectures for Modelling Emotion: Cross-Disciplinary Foundations, 2004.
[17] A. Sloman, R. Chrisley, and M. Scheutz, “The Architectural Basis of Affective States and Processes,” Who Needs Emotions: The Brain Meets the Machine, Oxford Univ. Press, 2005.
[18] L. Cañamero, “Emotion Understanding from the Perspective of Autonomous Robots Research,” Neural Networks, vol. 18, pp. 445-455, 2005.
[19] M. Scheutz, “Useful Roles of Emotions in Artificial Agents: A Case Study from Artificial Life,” Proc. 19th Nat'l Conf. Am. Assoc. for Artificial Intelligence, pp. 42-48, 2004.
[20] C.J. Watkins, “Models of Delayed Reinforcement Learning,” PhD dissertation, Cambridge Univ., 1989.
[21] D. Cañamero, “Emotions and Adaptation in Autonomous Agents: A Design Perspective,” Cybernetics and Systems: Int'l J., vol. 32, pp. 507-529, 2001.
[22] C. Breazeal and R. Brooks, “Robot Emotion: A Functional Perspective,” Who Needs Emotions: The Brain Meets the Robot, MIT Press, 2004.
[23] P. Petta, “The Role of Emotions in a Tractable Architecture for Situated Cognizers,” Emotions in Humans and Artifacts, pp. 251-288, MIT Press, 2003.
[24] G. Hollinger, Y. Georgiev, A. Manfredi, B. Maxwell, Z. Pezzementi, and B. Mitchell, “Design of a Social Mobile Robot Using Emotion-Based Decision Mechanisms,” Proc. IEEE/RSJ Int'l Conf. Intelligent Robots and Systems, pp. 3093-3098, 2007.
[25] G. Qingji, W. Kai, and L. Haijuan, “A Robot Emotion Generation Mechanism Based on Pad Emotion Space,” Intelligent Information Processing IV, Advances in Information and Comm. Technology, Z. Shi, E. Mercier-Laurent, and D. Leake, eds., pp. 138-147, Springer, 2008.
[26] R.S. Lazarus, “Relational Meaning and Discrete Emotions,” Appraisal Processes in Emotion: Theory, Methods, Research, pp. 37-67, Oxford Univ. Press, 2001.
[27] L. Cañamero, “Modeling Motivations and Emotions as a Basis for Intelligent Behavior,” Proc. First Int'l Symp. Autonomous Agents, pp. 148-155, 1997.
[28] J. Velásquez, “An Emotion-Based Approach to Robotics,” Proc. IEEE/RSJ Int'l Conf. Intelligent Robots and Systems, 1999.
[29] R. Murphy, C. Lisetti, R. Tardif, L. Irish, and A. Gage, “Emotion Based Control of Cooperating Heterogeneous Mobile Robots,” IEEE Trans. Robotics and Automation, vol. 18, no. 5, pp. 744-757, Oct. 2002.
[30] F. Michaud, “EMIB Computational Architecture Based on Emotion and Motivation for Intentional Selection and Configuration of Behavior Producing Modules,” Cognitive Science Quaterly, vols. 3/4, pp. 340-361, 2002.
[31] J. Velásquez, “Modelling Emotion-Based Decision-Making,” Proc. AAAI Fall Symp. Emotional and Intelligent: The Tangled Knot of Cognition, 1998.
[32] J. Santa-Cruz, J.M. Tobal, A.C. Vindel, and E.G. Fernández, “Introducción a la Psicología,” Facultad de Psicologa, Universidad Complutense de Madrid, 1989.
[33] K. Lorenz and P. Leyhausen, Motivation of Human and Animal Behaviour: An Ethological View, Van Nostrand-Reinhold, 1973.
[34] Z. Liu and Y. Lu, “A Motivational Model for Virtual Characters,” Proc. Seventh Int'l Conf. Machine Learning and Cybernetics, 2008.
[35] K.C. Berridge, “Motivation Concepts in Behavioural Neuroscience,” Physiology and Behaviour, vol. 18, pp. 179-209, 2004.
[36] M. Malfaz and M. Salichs, “Learning to Deal with Objects,” Proc. Eighth Int'l Conf. Development and Learning, 2009.
[37] A. Ortony, G.L. Clore, and A. Collins, The Cognitive Structure of Emotions. Cambridge Univ. Press, 1988.
[38] M. Malfaz and M. Salichs, “Using MUDs as an Experimental Platform for Testing a Decision Making System for Self-Motivated Autonomous Agents,” Artificial Intelligence and Simulation of Behaviour J., vol. 2, no. 1, pp. 21-44, 2010.
[39] R. Gautier and G. Boeree, Teorias de la Personalidad: Una Selección de los Mejores Autores del S. XX. UNIBE 2005.
[40] S. Gadanho and L. Custodio, “Asynchronous Learning by Emotions and Cognition,” Proc. Seventh Int'l Conf. Simulation of Adaptive Behavior on from Animals to Animals, 2002.