Issue No. 01 - January-June (2010 vol. 1)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/T-AFFC.2010.4
Timothy W. Bickmore , Northeastern University, Boston
Rukmal Fernando , Northeastern University, Boston
Lazlo Ring , Northeastern University, Boston
Daniel Schulman , Northeastern University, Boston
We describe a series of experiments with an agent designed to model human conversational touch—capable of physically touching users in synchrony with speech and other nonverbal communicative behavior—and its use in expressing empathy to users in distress. The agent is composed of an animated human face that is displayed on a monitor affixed to the top of a human mannequin, with touch conveyed by an air bladder that squeezes a user's hand. We demonstrate that when touch is used alone, hand squeeze pressure and number of squeezes are associated with user perceptions of affect arousal conveyed by an agent, while number of squeezes and squeeze duration are associated with affect valence. We also show that, when affect-relevant cues are present in facial display, speech prosody, and touch used simultaneously by the agent, facial display dominates user perceptions of affect valence, and facial display and prosody are associated with affect arousal, while touch had little effect. Finally, we show that when touch is used in the context of an empathic, comforting interaction (but without the manipulation of affect cues in other modalities), it can lead to better perceptions of relationship with the agent, but only for users who are comfortable being touched by other people.
Animations, evaluation, haptic I/O, natural language, user interfaces.
Timothy W. Bickmore, Rukmal Fernando, Lazlo Ring, Daniel Schulman, "Empathic Touch by Relational Agents", IEEE Transactions on Affective Computing, vol. 1, no. , pp. 60-71, January-June 2010, doi:10.1109/T-AFFC.2010.4