The Community for Technology Leaders
Asian Language Processing, International Conference on (2009)
Singapore
Dec. 7, 2009 to Dec. 9, 2009
ISBN: 978-0-7695-3904-1
pp: 17-22
ABSTRACT
This paper details how multiple languages are accommodated in the multimodal integration of sketch and speech, specifically, in spatial applications. The study encompasses English, Malay, Mandarin, and two under-resourced languages in Malaysia, i.e. Melanau and Iban. The preliminary study revealed that not all spatial terms (prepositions) appear in all languages. Based on these findings, we propose a method to assist in the design and development of multilingual multimodal applications. This method employs a generic representation model for spatial description.
INDEX TERMS
Multilingual, Multimodal Integration, Speech Representation Model, Spatial Description
CITATION
Alvin W. Yeo, Lee-Na Teh, "Multilingual Multimodal Integration of Sketch and Speech: A Generic Speech Representation Model for Spatial Description", Asian Language Processing, International Conference on, vol. 00, no. , pp. 17-22, 2009, doi:10.1109/IALP.2009.13
90 ms
(Ver 3.3 (11022016))