The Community for Technology Leaders
Green Image
Issue No. 02 - Apr.-Jun. (2018 vol. 25)
ISSN: 1070-986X
pp: 47-60
Zahid Akhtar , INRS-EMT, University of Quebec
Tiago H. Falk , INRS-EMT, University of Quebec
ABSTRACT
Social signal processing (SSP) is a promising automated technology that aims to provide computers with the ability to sense and understand human social behaviors. Representative SSP applications include novel human-computer interaction mechanisms that enhance machine sensitivity of users emotional and mental states, more engaging games, ambient intelligence systems responsive to social context, and new quantitative psychological evaluation tools for coaching or diagnosis. Based on adopted cues, existing SSP methods can be categorized as verbal or nonverbal. Over the last decade, significant progress has been accomplished in visual nonverbal behavior analysis (VNBA). However, several emerging issues such as fusion of multimodal cues, context estimation, and user privacy protection still need to be addressed adequately. The authors present an overview of VNBA and describe various research challenges and proposed solutions.
INDEX TERMS
Visualization, Signal processing, Multimedia communication, Social factors, Human computer interaction
CITATION

Z. Akhtar and T. H. Falk, "Visual Nonverbal Behavior Analysis: The Path Forward," in IEEE MultiMedia, vol. 25, no. 2, pp. 47-60, 2018.
doi:10.1109/MMUL.2017.265091158
834 ms
(Ver 3.3 (11022016))