loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06) Track 6
Kauai, Hawaii
January 04-January 07
ISBN: 0-7695-2507-5
Xiaoyu Chen, New Jersey Institute of Technology
Marilyn Tremaine, New Jersey Institute of Technology
Multimodal input is known to be advantageous for graphical user interfaces, but its benefits for non-visual interaction are unknown. To explore this issue, an exploratory study was conducted with fourteen sighted subjects on a system that allows speech input and hand input on a touchpad. Findings include: (1) Users chose between these two input modalities based on the types of operations undertaken. Navigation operations were done primarily with touchpad input, while non-navigation instructions were carried out primarily using speech input. (2) Multimodal error correction was not prevalent. Repeating a failed operation until it succeeded and trying other methods in the same input modality were dominant error-correction strategies. (3) The modality learned first was not necessarily the primary modality used later, but a training order effect existed. These empirical results provide guidelines for designing non-visual multimodal input and create a comparison baseline for a subsequent study with blind users.
Citation:
Xiaoyu Chen, Marilyn Tremaine, "Patterns of Multimodal Input Usage in Non-Visual Information Navigation," hicss, vol. 6, pp.123c, Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06) Track 6, 2006
Usage of this product signifies your acceptance of the Terms of Use.