This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Multimodal Integration
Winter 1996 (vol. 3 no. 4)
pp. 14-24

Recent advances in multimedia systems, and research into so-called virtual realities and immersive environments for data visualization, hint that it might not be long before our repertoire of standard interaction techniques expands beyond the textual and visual domains to include touch, gestures, voice, and 3D sound. Although much progress has been made in the use of single modalities for human-computer communication, the general problem of designing integrated multimodal systems is not well understood. This article surveys recent research in this area in order to gain an appreciation of the issues and of the diverse approaches proposed or implemented, with particular emphasis on work whose goal is to provide a generic platform to support multimodal interaction. Relevant terminology is also defined and clarified, and several taxonomies for modalities are reviewed.

Index Terms:
multimodal interaction, multimedia, human-computer interfaces, interface design
Citation:
Meera M. Blattner, Ephraim P. Glinert, "Multimodal Integration," IEEE Multimedia, vol. 3, no. 4, pp. 14-24, Winter 1996, doi:10.1109/93.556457
Usage of this product signifies your acceptance of the Terms of Use.