loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Eighth IEEE International Symposium on Multimedia (ISM'06)
Automatic Synchronization between Lyrics and Music CD Recordings Based on Viterbi Alignment of Segregated Vocal Signals
San Diego, CA
December 11-December 13
ISBN: 0-7695-2746-9
Hiromasa Fujihara, Kyoto University, Japan
Masataka Goto, National Institute of Advanced Industrial Science and Technology (AIST), Japan
Jun Ogata, National Institute of Advanced Industrial Science and Technology (AIST), Japan
Kazunori Komatani, Kyoto University, Japan
Tetsuya Ogata, Kyoto University, Japan
Hiroshi G. Okuno, Kyoto University, Japan
This paper describes a system that can automatically synchronize between polyphonic musical audio signals and corresponding lyrics. Although there were methods that can synchronize between monophonic speech signals and corresponding text transcriptions by using Viterbi alignment techniques, they cannot be applied to vocals in CD recordings because accompaniment sounds often overlap with vocals. To align lyrics with such vocals, we therefore developed three methods: a method for segregating vocals from polyphonic sound mixtures, a method for detecting vocal sections, and a method for adapting a speech-recognizer phone model to segregated vocal signals. Experimental results for 10 Japanese popular-music songs showed that our system can synchronize between music and lyrics with satisfactory accuracy for 8 songs.
Citation:
Hiromasa Fujihara, Masataka Goto, Jun Ogata, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno, "Automatic Synchronization between Lyrics and Music CD Recordings Based on Viterbi Alignment of Segregated Vocal Signals," ism, pp.257-264, Eighth IEEE International Symposium on Multimedia (ISM'06), 2006
Usage of this product signifies your acceptance of the Terms of Use.