| | This Article | |
| |
| |
| | Share | |
| |
| |
| | Bibliographic References | |
| |
| |
| | Add to: | |
| |
 Digg
 Furl
 Spurl
 Blink
 Simpy
 Google
 Del.icio.us
 Y!MyWeb
| |
| | Search | |
| |
| |
| | |
Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models
June 1993 (vol. 15 no. 6)
pp. 569-579
An approach to the analysis of dynamic facial images for the purposes of estimating and resynthesizing dynamic facial expressions is presented. The approach exploits a sophisticated generative model of the human face originally developed for realistic facial animation. The face model which may be simulated and rendered at interactive rates on a graphics workstation, incorporates a physics-based synthetic facial tissue and a set of anatomically motivated facial muscle actuators. The estimation of dynamical facial muscle contractions from video sequences of expressive human faces is considered. An estimation technique that uses deformable contour models (snakes) to track the nonrigid motions of facial features in video images is developed. The technique estimates muscle actuator controls with sufficient accuracy to permit the face model to resynthesize transient expressions.
[1] 569K. Aizawa, H. Harashima, and T. Saito, "Model-based analysis synthesis image coding (MBASIC) system for a person's face,"Signal Processing: Image Commun., vol. 1, no. 2, pp. 139-152, 1989.[2] W. W. Bledsoe, "Man-machine facial recognition," Panoramic Res. Inc., Palo Alto, CA, Rep. PRI:22, Aug. 1966.[3] V. Bruce,Recognizing Faces. Hillsdale: Lawrence Erlbaum, 1988.[4] C. S. Choi, H. Harashima, and T. Takebe, "Analysis and synthesis of facial expressions in knowledge-based coding of facial image sequences," inProc. Int. Conf. Acoustics Speech Signal Processing(Toronto), 1991, pp. 2737-2740.[5] G. M. Davies, H. D. Ellis, and G. M. Shepherd,Perceiving and Remembering Faces. New York: Academic, 1981.[6] X. Deng, "A finite element analysis of surgery of the human facial tissues," Ph.D. thesis, Graduate Sch. Arts Sci., Columbia Univ., New York, NY, 1988.[7] P. Ekman,Unmasking the Human Face. New York: Prentice-Hall, 1971.[8] P. Ekman and W. V. Friesen,Manual for the Facial Action Coding System. Palo Alto: Consulting Psychologists, 1977.[9] M. A. Fischler and R. A. Elschlager, "The representation and matching of pictorial structures,"IEEE Trans. Comput., vol. C-22, pp. 67-92 1973.[10] R. Forchheimer and T. Kronander, "Image Coding--From Waveforms to Animation,"IEEE Trans. Acoustics, Speech and Image Processing, Vol. 37, No. 12, Dec. 1989, pp. 2008-2023.[11] A. J. Goldstein, L. D. Harmon, and A. B. Lesk, "Man-machine interaction in human face identification,"Bell System Tech. J., vol. 51, no. 2, pp. 399-427, 1972.[12] D. Hill, A. Pearce, and B. Wyvill, "Animating speech: A automated approach using speech synthesised by rules,"Visual Comput., vol. 3, pp. 277-287, 1988.[13] T. Kanade, "Picture processing system by computer complex and recognition of human faces," Ph.D. Thesis, Dept. of Inform. Sci., Kyoto Univ., Nov. 1973.[14] M. Kass, A. Witkin, and D. Terzopoulos, "Snakes: Active contour models,"Int. J. Comput. Vision, vol. 1, no. 4, pp. 321-331, 1987.[15] Y. Kaya and K. Kobayashi, "A basic study on human face recognition," inFrontiers of Pattern Recognition(S. Watanabe, Ed.). 1972, p. 265.[16] R. M. Kenedi, T. Gibson, J. H. Evans, and J. C. Barbenel, "Tissue mechanics,"Phys. Med. Biol., vol. 20, no. 5, pp. 699-717, 1975.[17] K. Komatsu, "Human skin model capable of natural shape variation,"Visual Comput., vol. 3, pp. 265-271, 1988.[18] W. Larrabee, "A finite element model of skin deformation I. Biomechanics of skin and soft tissue: A review,"Laryngoscope, vol. 96, pp. 399-419, 1986; "II. An experimental model of skin deformation,"Laryngoscope, vol. 96, pp. 406-412, 1986; "III. The finite element model,"Laryngoscope, vol. 96, pp. 413-419, 1986.[19] Y. Lee, D. Terzopoulos, and K. Waters, "Constructing physics based facial models of individuals," inProc. Graphics Interface `93(Toronto), to be published in May 1993.[20] J.P. Lewis and F.I. Parke, "Automated Lip-Sync and Speech Synthesis for Character Animation,"Proc. CHI+GI Conf., ACM, New York, 1987, pp. 143-147.[21] K. Mase, "Recognition of facial expression from optical flow,"IEICE Trans., vol. E74, no. 10, pp. 3474-3483, Oct. 1991.[22] F. I. Parke, "Parameterized models for facial animation,"IEEE Comput. Graphics Applications, vol. 2, no. 9, pp. 61-68, Nov. 1982.[23] S. Pieper, "More than skin deep: Physical modeling of facial tissue," M.Sc. thesis, Dept. of Media Arts Sci., Mass. Inst. of Technol., Cambridge MA, Jan. 1989.[24] W.H. Press et al.,Numerical Recipes--The Art of Scientific Computing, Cambridge University Press, 1986, p. 254.[25] T. Sakai, M. Nagao, and S. Jujibayashi, "Line extraction and pattern detection in a photograph,"Patt. Recogn., vol. 1, p. 233, 1969.[26] M. A. Shakleton and W. J. Welsh, "Classification of facial features for recognition," inProc. Comput. Vision Patt. Recogn. Conf. (CVPR' 91)(Lahaina, HI), 1991, pp. 573-578.[27] D. Terzopoulos, "On matching deformable models to images," inProc. Topical Meeting Machine Vision, Tech. Digest Series, vol. 12, Opt. Soc. Amer., Washington, DC, 1987, pp. 160-163; also Tech. Rep. 60, Schlumberger Palo Alto Res., Palo Alto, CA, Nov. 1986.[28] D. Terzopoulos and K. Fleischer, "Deformable models,"Visual Comput., vol. 4, no. 6, pp. 306-331, 1988.[29] D. Terzopoulos and K. Waters, "Analysis of dynamic facial images using physical and anatomical models," inProc. Third Int. Conf. Comput. Vision(Osaka, Japan), 1990, pp. 306-331.[30] N. Magnenat-Thalmann, E. Primeau, and D. Thalmann, "Abstract muscle action procedures for face animation,"Visual Comput., vol. 3, pp. 290-297, 1988.[31] A. L. Yuille, D. S. Cohen, and P. W. Hllinan, "Feature extraction from faces using deformable templates," inProc. Comput. Vision Patt. Recogn., (San Diego), 1988, pp. 104-109.[32] J. Waite and W. Welsh, "Head boundary location using snakes,"Brit. Telecom Tech. J., vol. 8, no. 3, pp. 127-136, 1990.[33] K. Waters, "A Muscle Model for Animating Three-Dimensional Facial Expression,"Computer Graphics, Vol. 21, No. 4, July 1987, pp. 17-24.[34] K. Waters and D. Terzopoulos, "Modeling and animating faces using scanned data,"J. Visualization Comput. Animation, vol. 2, no. 4, pp. 123-128, 1991.[35] L. Williams, "Performance-driven facial animation,"Comput. Graphics, vol. 24, no. 4, pp. 235-242.
Index Terms:
biomechanics; expressions resynthesis; facial image sequences; anatomical models; facial animation; face model; graphics workstation; physics-based synthetic facial tissue; anatomically motivated facial muscle actuators; dynamical facial muscle contractions; video sequences; expressive human faces; deformable contour models; snakes; biomechanics; computer animation; image sequences
Citation:
D. Terzopoulos, K. Waters, "Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 15, no. 6, pp. 569-579, June 1993, doi:10.1109/34.216726
