2015 International Conference on Affective Computing and Intelligent Interaction (ACII) (2015)
Sept. 21, 2015 to Sept. 24, 2015
Donald Glowinski , Swiss Center for Affective Sciences, University of Geneva, Switzerland CH-1205
Marcello Mortillaro , Swiss Center for Affective Sciences, University of Geneva, Switzerland CH-1205
Klaus Scherer , Swiss Center for Affective Sciences, University of Geneva, Switzerland CH-1205
Nele Dael , Institute of Psychology, University of Lausanne, Lausanne, CH 1015
Gualtiero Volpe Antonio Camurri , Casa Paganini - InfoMus (DIBRIS), University of Genoa, Genoa, IT-16145
How efficiently decoding affective information when computational resources and sensor systems are limited? This paper presents a framework for analysis of affective behavior starting with a reduced amount of visual information related to human upper-body movements. The main goal is to individuate a minimal representation of emotional displays based on non-verbal gesture features. The GEMEP (Geneva multimodal emotion portrayals) corpus was used to validate this framework. Twelve emotions expressed by ten actors form the selected data set of emotion portrayals. Visual tracking of trajectories of head and hands was performed from a frontal and a lateral view. Postural/shape and dynamic expressive gesture features were identified and analyzed. A feature reduction procedure was carried out, resulting in a four-dimensional model of emotion expression, that effectively classified/grouped emotions according to their valence (positive, negative) and arousal (high, low). These results show that emotionally relevant information can be detected/measured/obtained from the dynamic qualities of gesture. The framework was implemented as software modules (plug-ins) extending the EyesWeb XMI Expressive Gesture Processing Library and was tested as a component for a multimodal search engine in collaboration with Google within the EU-ICT I-SEARCH project.
Feature extraction, Visualization, Trajectory, Face, Psychology, Kinematics
D. Glowinski, M. Mortillaro, K. Scherer, N. Dael and G. V. Camurri, "Towards a minimal representation of affective gestures (Extended abstract)," 2015 International Conference on Affective Computing and Intelligent Interaction (ACII), Xi'an, China, 2015, pp. 498-504.