Multilingual Multimodal Integration of Sketch and Speech: A Generic Speech Representation Model for Spatial Description
Asian Language Processing, International Conference on (2009)
Dec. 7, 2009 to Dec. 9, 2009
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/IALP.2009.13
This paper details how multiple languages are accommodated in the multimodal integration of sketch and speech, specifically, in spatial applications. The study encompasses English, Malay, Mandarin, and two under-resourced languages in Malaysia, i.e. Melanau and Iban. The preliminary study revealed that not all spatial terms (prepositions) appear in all languages. Based on these findings, we propose a method to assist in the design and development of multilingual multimodal applications. This method employs a generic representation model for spatial description.
Multilingual, Multimodal Integration, Speech Representation Model, Spatial Description
Alvin W. Yeo, Lee-Na Teh, "Multilingual Multimodal Integration of Sketch and Speech: A Generic Speech Representation Model for Spatial Description", Asian Language Processing, International Conference on, vol. 00, no. , pp. 17-22, 2009, doi:10.1109/IALP.2009.13