The Community for Technology Leaders
Green Image
Issue No. 08 - Aug. (2016 vol. 38)
ISSN: 0162-8828
pp: 1548-1568
Ciprian Adrian Corneanu , Computer Vision Center, Universitat Autónoma de Barcelona, Barcelona, Spain
Marc Oliu Simon , Computer Vision Center, Universitat Autónoma de Barcelona, Barcelona, Spain
Jeffrey F. Cohn , Robotics Institute, Carnegie Mellon University, Pittsburgh, PA
Sergio Escalera Guerrero , Computer Vision Center, Universitat Autónoma de Barcelona, Barcelona, Spain
ABSTRACT
Facial expressions are an important way through which humans interact socially. Building a system capable of automatically recognizing facial expressions from images and video has been an intense field of study in recent years. Interpreting such expressions remains challenging and much research is needed about the way they relate to human affect. This paper presents a general overview of automatic RGB, 3D, thermal and multimodal facial expression analysis. We define a new taxonomy for the field, encompassing all steps from face detection to facial expression recognition, and describe and classify the state of the art methods accordingly. We also present the important datasets and the bench-marking of most influential methods. We conclude with a general discussion about trends, important questions and future lines of research.
INDEX TERMS
Iron, Face, Three-dimensional displays, Encoding, Taxonomy, Market research, Emotion recognition
CITATION
Ciprian Adrian Corneanu, Marc Oliu Simon, Jeffrey F. Cohn, Sergio Escalera Guerrero, "Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 38, no. , pp. 1548-1568, Aug. 2016, doi:10.1109/TPAMI.2016.2515606
181 ms
(Ver 3.3 (11022016))