Transactions on Affective Computing

IEEE Transactions on Affective Computing (TAC) is intended to be a cross disciplinary and international archive journal aimed at disseminating results of research on the design of systems that can recognize, interpret, and simulate human emotions and related affective phenomena. Read the full scope of TAC


Expand your horizons with Colloquium, a monthly survey of abstracts from all CS transactions!


From the October-December 2017 issue

Audio-Facial Laughter Detection in Naturalistic Dyadic Conversations

By Bekir Berker Turker, Yucel Yemez, T. Metin Sezgin, and Engin Erzin

Featured article thumbnail image We address the problem of continuous laughter detection over audio-facial input streams obtained from naturalistic dyadic conversations. We first present meticulous annotation of laughters, cross-talks and environmental noise in an audio-facial database with explicit 3D facial mocap data. Using this annotated database, we rigorously investigate the utility of facial information, head movement and audio features for laughter detection. We identify a set of discriminative features using mutual information-based criteria, and show how they can be used with classifiers based on support vector machines (SVMs) and time delay neural networks (TDNNs). Informed by the analysis of the individual modalities, we propose a multimodal fusion setup for laughter detection using different classifier-feature combinations. We also effectively incorporate bagging into our classification pipeline to address the class imbalance problem caused by the scarcity of positive laughter instances. Our results indicate that a combination of TDNNs and SVMs lead to superior detection performance, and bagging effectively addresses data imbalance. Our experiments show that our multimodal approach supported by bagging compares favorably to the state of the art in presence of detrimental factors such as cross-talk, environmental noise, and data imbalance.

download PDF View the PDF of this article      csdl View this issue in the digital library


Editorials and Announcements

Announcements

  • According to Clarivate Analytics' 2016 Journal Citation Report, TAC has an impact factor of 3.149.
  • Heartfelt congratulations are offered to Georgios N. Yannakakis and Julian Togelius, authors of "Experience-Driven Procedural Content Generation," who were presented with TAC's Most Influential Paper Award by Editor-in-Chief Björn W. Schuller at the 2015 6th AAAC Affective Computing and Intelligent Interaction Conference in Xi'An, P.R. China on 22 September 2015.

Editorials


Guest Editorials


Reviewers List


Author Index


Access recently published TAC articles

RSS Subscribe to the RSS feed of recently published TAC content

mail icon Sign up for e-mail notifications through IEEE Xplore Content Alerts

preprints icon View TAC preprints in the Computer Society Digital Library


TAC -- Call for Papers cover

View the PDF of TAC's ongoing call-for-papers.

TAC is indexed in ISI