An Articulation Training System with Intelligent Interface and Multimode Feedbacks to Articulation Disorders
Asian Language Processing, International Conference on (2009)
Dec. 7, 2009 to Dec. 9, 2009
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/IALP.2009.10
Articulation training with many kinds of stimulus and messages such as visual, voice, and articulatory information can teach user to pronounce correctly and improve user’s articulatory ability. In this paper, an articulation training system with intelligent interface and multimode feedbacks is proposed to improve the performance of articulation training. Clinical knowledge of speech evaluation is used to design the dependent network. Then, automatic speech recognition with dependent network is applied to identify the pronunciation errors. Besides, hierarchical Bayesian network is proposed to recognize user’s emotion from speeches. With the information of pronunciation errors and user’s emotional state, the articulation training sentences can be dynamically selected. Finally, a 3D facial animation is provided to teach users to pronounce a sentence by using speech, lip motion, and tongue motion. Experimental results reveal the usefulness of proposed method and system.
Chung-Hsien Wu, Shan-Shan Ju, Chih-Chang Chen, Hui-Mei Yang, Yeou-Jiunn Chen, Jiunn-Liang Wu, "An Articulation Training System with Intelligent Interface and Multimode Feedbacks to Articulation Disorders", Asian Language Processing, International Conference on, vol. 00, no. , pp. 3-6, 2009, doi:10.1109/IALP.2009.10