Big Island, Hawaii
Jan. 3, 2005 to Jan. 6, 2005
Judee K. Burgoon , University of Arizona
J. P. Blair , The University of Texas at San Antonio
Jay F. Nunamaker, Jr , University of Arizona
Modality is an important context factor in deception, which is context-dependent. In order to build a reliable and flexible tool for automatic-deception-detection (ADD), we investigated the characteristics of verbal cues to deceptive behavior in three modalities: text, audio and face-to-face communication. Seven categories of verbal cues (21 cues) were studied: quantity, complexity, diversity, verb nonimmediacy, uncertainty, specificity and affect. After testing the interaction effects between modality and condition (deception or truth), we found significance only with specificity and observed that differences between deception and truth were in general consistent across the three modalities. However, modality had strong effects on verbal cues. For example, messages delivered face-to-face were largest in quantity (number of words, verbs, and sentences), followed by the audio modality. Text had the sparsest examples. These modality effects are an important factor in building baselines in ADD tools, because they make it possible to use them to adjust the baseline for an unknown modality according to a known baseline, thereby simplifying the process of ADD. The paper discusses in detail the implications of these findings on modality effects in three modalities.
Judee K. Burgoon, J. P. Blair, Jay F. Nunamaker, Jr, "Modality Effects in Deception Detection and Applications in Automatic-Deception-Detection", HICSS, 2005, 2014 47th Hawaii International Conference on System Sciences, 2014 47th Hawaii International Conference on System Sciences 2005, pp. 23b, doi:10.1109/HICSS.2005.436