loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Fourth IEEE International Conference on Multimodal Interfaces (ICMI'02)
The Added Value of Multimodality in the NESPOLE! Speech-to-Speech Translation System: an Experimental Study
Pittsburgh, Pennsylvania
October 14-October 16
ISBN: 0-7695-1834-6
Erica Costantini, University of Trieste
Fabio Pianesi, ITC-Irst
Susanne Burger, Carnegi Mellon University
Multimodal interfaces, which combine two or more input modes (speech, pen, touch…), are expected to be more efficient, natural and usable than single-input interfaces. However, the advantage of multimodal input has only been ascertained in highly controlled experimental conditions [4, 5, 6]; in particular, we lack data about what happens with ?real? human-human, multilingual communication systems. In this work we discuss the results of an experiment aiming to evaluate the added value of multimodality in a "true" speech-to-speech translation system, the NESPOLE! system, which provides for multilingual and multimodal communication in the tourism domain, allowing users to interact through the internet sharing maps, web-pages and pen-based gestures. We compared two experimental conditions differing as to whether multimodal resources were available: a speech-only condition (SO), and a multimodal condition (MM). Most of the data show tendencies for MM to be better than SO.
Citation:
Erica Costantini, Fabio Pianesi, Susanne Burger, "The Added Value of Multimodality in the NESPOLE! Speech-to-Speech Translation System: an Experimental Study," icmi, pp.235, Fourth IEEE International Conference on Multimodal Interfaces (ICMI'02), 2002
Usage of this product signifies your acceptance of the Terms of Use.