2015 International Conference on Affective Computing and Intelligent Interaction (ACII) (2015)
Sept. 21, 2015 to Sept. 24, 2015
Radoslaw Niewiadomski , Casa Paganini-InfoMus, DIBRIS University of Genoa, Genoa, Italy
Yu Ding , CNRS-LTCI Telecom-ParisTech, Paris, France
Maurizio Mancini , Casa Paganini-InfoMus, DIBRIS University of Genoa, Genoa, Italy
Catherine Pelachaud , CNRS-LTCI Telecom-ParisTech, Paris, France
Gualtiero Volpe , Casa Paganini-InfoMus, DIBRIS University of Genoa, Genoa, Italy
Antonio Camurri , Casa Paganini-InfoMus, DIBRIS University of Genoa, Genoa, Italy
In this paper, we study perception of intensity in-congruence between auditory and visual modalities of synthesized expressions of laughter. In particular, we investigate whether incongruent expressions are perceived as 1) regulated, and 2) unsuccessful in terms of animation synthesis. For this purpose, we conducted a perceptive study with the use of a virtual agent. Congruent and incongruent multimodal expressions of laughter were synthesized from natural audiovisual laughter episodes, using machine learning algorithms. Next, the intensity of facial expressions and body movements were systematically manipulated to check whether the resulting incongruent expressions are perceived differently compared to the corresponding congruent expressions. Results show that 1) intensity incongruence lowers the perception of believability and plausibility, and 2) the in-congruent laughter expressions displaying high intensity in the audio modality and low intensity in the body movement and facial expression are perceived as more fake than the corresponding congruent expressions. Such results have implications for both animation synthesis as well as expression regulation research.
Animation, Face, Visualization, Torso, Electronic mail, Machine learning algorithms, Context
R. Niewiadomski, Y. Ding, M. Mancini, C. Pelachaud, G. Volpe and A. Camurri, "Perception of intensity incongruence in synthesized multimodal expressions of laughter," 2015 International Conference on Affective Computing and Intelligent Interaction (ACII), Xi'an, China, 2015, pp. 684-690.