Incorporating Knowledge Sources Into a Statistical Acoustic Model for Spoken Language Communication Systems
Issue No. 09 - September (2007 vol. 56)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TC.2007.1069
This paper introduces a general framework for incorporating additional sources of knowledge into an HMM-based statistical acoustic model. Since the knowledge sources are often derived from different domains, it may be difficult to formulate a probabilistic function of the model without learning the causal dependencies between the sources. We utilized a Bayesian network framework to solve this problem. The advantages of this graphical model framework are 1) it allows the probabilistic relationship between information sources to be learned and 2) it facilitates the decomposition of the joint probability density function (PDF) into a linked set of local conditional PDFs. This way, a simplified form of the model can be constructed and reliably estimated using a limited amount of training data. We applied this framework to the problem of incorporating wide-phonetic knowledge information, which often suffers from a sparsity of data and memory constraints. We evaluated how well the proposed method performed on an large-vocabulary continuous speech recognition (LVCSR) task using English speech data that contained two different types of accents. The experimental results revealed that it improved the word accuracy with respect to standard HMM, with or without additional sources of knowledge.
belief networks, hidden Markov models, natural language interfaces, probability, speech recognition, speech-based user interfaces,knowledge sources, spoken language communication system, HMM-based statistical acoustic model, Bayesian network framework, graphical model framework, probability density function, large-vocabulary continuous speech recognition, English speech data,Hidden Markov models, Probability density function, Data models, Topology, Probability, Acoustics, Bayes methods,Acoustic modeling, knowledge incorporation, Bayesian network, junction tree, wide-context dependency
"Incorporating Knowledge Sources Into a Statistical Acoustic Model for Spoken Language Communication Systems", IEEE Transactions on Computers, vol. 56, no. , pp. 1199-1211, September 2007, doi:10.1109/TC.2007.1069