Fourth IEEE International Conference on Multimodal Interfaces (ICMI'02)
Flexi-Modal and Multi-Machine User Interfaces
Pittsburgh, Pennsylvania
October 14-October 16
ISBN: 0-7695-1834-6
Jie Zhu, Carnegie Mellon University
We describe our system which facilitates collaboration using multiple modalities, including speech, handwriting, gestures, gaze tracking, direct manipulation, large projected touch-sensitive displays, laser pointer tracking, regular monitors with a mouse and keyboard, and wirelessly-networked handhelds. Our system allows multiple, geographically dispersed participants to simultaneously and flexibly mix different modalities using the right interface at the right time on one or more machines. This paper discusses each of the modalities provided, how they were integrated in the system architecture, and how the user interface enabled one or more people to flexibly use one or more devices.
Index Terms:
Multi-modal interfaces, speech recognition, gesture recognition, handwriting recognition, gaze tracking, handhelds, personal digital assistants (PDAs), laser pointers, computer supported collaborative work (CSCW)
Citation:
Brad Myers, Robert Malkin, Michael Bett, Alex Waibel, Ben Bostwick, Robert C. Miller, Jie Yang, Matthias Denecke, Edgar Seemann, Jie Zhu, Choon Hong Peck, Dave Kong, Jeffrey Nichols, Bill Scherlis, "Flexi-Modal and Multi-Machine User Interfaces," icmi, pp.343, Fourth IEEE International Conference on Multimodal Interfaces (ICMI'02), 2002