Issue No. 09 - September (2007 vol. 56)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TC.2007.1074
This paper presents the scheme and evaluation of a robust audio-visual digit-and-speaker-recognition system using lip motion and speech biometrics. Moreover, a liveness verification barrier based on a person's lip movement is added to the system to guard against advanced spoofing attempts such as replayed videos. The acoustic and visual features are integrated at the feature level and evaluated first by a support vector machine for digit and speaker identification and, then, by a Gaussian mixture model for speaker verification. Based on ap300 different personal identities, this paper represents, to our knowledge, the first extensive study investigating the added value of lip motion features for speaker and speech-recognition applications. Digit recognition and person-identification and verification experiments are conducted on the publicly available XM2VTS database showing favorable results (speaker verification is 98 percent, speaker identification is 100 percent, and digit identification is 83 percent to 100 percent).
acoustic signal processing, Gaussian processes, image motion analysis, speaker recognition, support vector machines, video signal processing,lip-motion synergy, biometric speech recognition, audio-visual digit-and-speaker-recognition system, liveness verification barrier, support vector machine, Gaussian mixture model, speaker verification, digit recognition, person-identification, XM2VTS database,Speech recognition, Hidden Markov models, Support vector machines, Protocols, Biometrics, Motion control,Speech recognition, speaker recognition, motion estimation, normal image flow, normal image velocity, lip reading, lip motion, GMM, SVM, biometrics
"Synergy of Lip-Motion and Acoustic Features in Biometric Speech and Speaker Recognition", IEEE Transactions on Computers, vol. 56, no. , pp. 1169-1175, September 2007, doi:10.1109/TC.2007.1074