2001 IEEE International Conference on Multimedia and Expo (ICME'01)
AUDIO DRIVEN FACIAL ANIMATION FOR AUDIO-VISUAL REALITY
Tokyo, Japan
August 22-August 25
ISBN: 0-7695-1198-8
In this paper, we demonstrate a morphing based automated audio driven facial animation system. Based on an incoming audio stream, a face image is animated with full lip synchronization and expression. An animation sequence using optical flow between visemes is constructed, given an incoming audio stream and still pictures of a face speaking different visemes. Rules are formulated based on coarticulation and the duration of a viseme to control the continuity in terms of shape and extent of lip opening. In addition to this new viseme-expression combinations are synthesized to be able to generate animations with new facial expressions. Finally various applications of this system are discussed in the context of creating audio-visual reality.
Citation:
T. A. Faruquie, A. Kapoor, R. Kate, N. Rajput, L.V. Subramaniam, "AUDIO DRIVEN FACIAL ANIMATION FOR AUDIO-VISUAL REALITY," icme, pp.209, 2001 IEEE International Conference on Multimedia and Expo (ICME'01), 2001