Conversion Function Clustering and Selection Using Linguistic and Spectral Information for Emotional Voice Conversion
Issue No.09 - September (2007 vol.56)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TC.2007.1079
In emotional speech synthesis, a large speech database is required for high quality speech output. Voice conversion needs only a compact-sized speech database for each emotion. This study designs and accumulates a set of phonetically balanced small-sized emotional parallel speech databases to construct conversion functions. Gaussian mixture bi-gram model (GMBM) is adopted as the conversion function to characterize the temporal and spectral evolution of the speech signal. The conversion function is initially constructed for each instance of parallel sub-syllable pairs in the collected speech database. To reduce the total number of conversion functions, and select an appropriate conversion function, this study presents a framework by incorporating linguistic and spectral information for conversion function clustering and selection. Subjective and objective evaluations with statistical hypothesis testing are conducted to evaluate the quality of the converted speech. The proposed method compares favorably with previous methods in conversion-based emotional speech synthesis.
Emotional text-to-speech synthesis, emotional voice conversion, linguistic feature, function clustering and selection, Gaussian mixture bi-gram model
Chi-Chun Hsia, Chung-Hsien Wu, Jian-Qi Wu, "Conversion Function Clustering and Selection Using Linguistic and Spectral Information for Emotional Voice Conversion", IEEE Transactions on Computers, vol.56, no. 9, pp. 1245-1254, September 2007, doi:10.1109/TC.2007.1079