Issue No. 04 - Winter (1996 vol. 3)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/93.556457
<p>Recent advances in multimedia systems, and research into so-called virtual realities and immersive environments for data visualization, hint that it might not be long before our repertoire of standard interaction techniques expands beyond the textual and visual domains to include touch, gestures, voice, and 3D sound. Although much progress has been made in the use of single modalities for human-computer communication, the general problem of designing integrated multimodal systems is not well understood. This article surveys recent research in this area in order to gain an appreciation of the issues and of the diverse approaches proposed or implemented, with particular emphasis on work whose goal is to provide a generic platform to support multimodal interaction. Relevant terminology is also defined and clarified, and several taxonomies for modalities are reviewed. </p>
multimodal interaction, multimedia, human-computer interfaces, interface design
E. P. Glinert and M. M. Blattner, "Multimodal Integration," in IEEE MultiMedia, vol. 3, no. , pp. 14-24, 1996.