The Community for Technology Leaders
Green Image
Issue No. 05 - September/October (2003 vol. 23)
ISSN: 0272-1716
pp: 62-68
Sharon Oviatt , Oregon Health and Science University
<p>A well-designed multimodal interface that fuses two or more information sources can be an effective means of substantially reducing recognition uncertainty. Robustness advantages in multimodal systems have been demonstrated for different modality combinations, for varied tasks, and in different usage environments. Perhaps most importantly, the error suppression achievable with a multimodal system, compared with a unimodal one, can be in excess of 40 percent. In addition to improving overall recognition rates, a multimodal interface can perform in a more stable and effective manner across a variety of challenging user groups and real-world settings. This article reviews recent demonstrations of enhanced robustness for three types of multimodal interfaces, including ones that process speech and pen, speech and lip movement, and multibiometrics (physiological and behavioral) inputs. It concludes by discussing general design strategies for optimizing the robustness of future multimodal systems.</p>
Sharon Oviatt, "Advances in Robust Multimodal Interface Design", IEEE Computer Graphics and Applications, vol. 23, no. , pp. 62-68, September/October 2003, doi:10.1109/MCG.2003.1231179
108 ms
(Ver 3.3 (11022016))