This Article 
 Bibliographic References 
 Add to: 
A New Physical Model with Multilayer Architecture for Facial Expression Animation Using Dynamic Adaptive Mesh
May/June 2004 (vol. 10 no. 3)
pp. 339-352

Abstract—This paper presents a new physically-based 3D facial model based on anatomical knowledge which provides high fidelity for facial expression animation while optimizing the computation. Our facial model has a multilayer biomechanical structure, incorporating a physically-based approximation to facial skin tissue, a set of anatomically-motivated facial muscle actuators, and underlying skull structure. In contrast to existing mass-spring-damper (MSD) facial models, our dynamic skin model uses the nonlinear springs to directly simulate the nonlinear visco-elastic behavior of soft tissue and a new kind of edge repulsion spring is developed to prevent collapse of the skin model. Different types of muscle models have been developed to simulate distribution of the muscle force applied on the skin due to muscle contraction. The presence of the skull advantageously constrain the skin movements, resulting in more accurate facial deformation and also guides the interactive placement of facial muscles. The governing dynamics are computed using a local semi-implicit ODE solver. In the dynamic simulation, an adaptive refinement automatically adapts the local resolution at which potential inaccuracies are detected depending on local deformation. The method, in effect, ensures the required speedup by concentrating computational time only where needed while ensuring realistic behavior within a predefined error threshold. This mechanism allows more pleasing animation results to be produced at a reduced computational cost.

[1] K.-J. Bathe, Finite Element Procedures in Engineering Analysis. Prentice Hall, 1982.
[2] V. Blanz and T. Vetter, A Morphable Model for the Synthesis of 3D Faces Proc. SIGGRAPH '99, vol. 33, pp. 187-194, Aug. 1999.
[3] M. Bro-Nielsen and S. Cotin, Real-Time Volumetric Deformable Models for Surgery Simulation Using Finite Elements and Condensation Proc. EUROGRAPHICS '96, vol. 15, pp. 57-66, Aug. 1996.
[4] E. Catmull and J. Clark, Recursively Generated B-Spline Surfaces on Arbitrary Topological Meshes Computer Aided Design, vol. 10, no. 6, pp. 350-355, 1978.
[5] S. Cotin, H. Delingette, and N. Ayache, Real-Time Elastic Deformations of Soft Tissues for Surgery Simulation IEEE Trans. Visualization and Computer Graphics, vol. 5, no. 1, pp. 62-73, 1999.
[6] G. Debunne, M. Desbrun, A. Barr, and M.-P. Cani, Interactive Multiresolution Animation of Deformable Models Proc. 10th Eurographics Workshop Computer Animation and Simulation, pp. 133-144, 1999.
[7] G. Debunne, M. Desbrun, M.-P. Cani, and A. Barr, Adaptive Simulation of Soft Bodies in Real-Time Proc. Computer Animation, pp. 15-20, 2000.
[8] D. DeCarlo, D. Metaxas, and M. Stone, An Anthropometric Face Model Using Variational Techniques Proc. SIGGRAPH '98, vol. 32, pp. 67-74, July 1998.
[9] T. DeRose, M. Kass, and T. Truong, Subdivision Surfaces in Character Animation Proc. SIGGRAPH '98, vol. 32, pp. 85-94, July 1998.
[10] S. DiPaola, Extending the Range of Facial Types J. Visualization and Computer Animation, vol. 2, no. 4, pp. 129-131, 1991.
[11] D. Doo and M. Sabin, Behaviour of Recursive Division Surfaces Near Extraordinary Points Computer Aided Design, vol. 10, no. 6, pp. 356-360, 1978.
[12] P. Ekman and W.V. Friesen, Facial Action Coding System. Palo Alto, Calif.: Consulting Psychologists Press Inc., 1978.
[13] I. Essa, S. Basu, T. Darrell, and A. Pentland, "Modeling, Tracking and Interactive Animation of Faces and Heads Using Input From Video," Proc. Computer Animation Conf. 1996, pp. 68-79, June 1996.
[14] D.R. Forsey and R. H. Bartels, Hierarchical B-Spline Refinement Proc. SIGGRAPH '88, vol. 22, pp. 205-212, Aug. 1988.
[15] Y. Fung, Biomechanics: Mechanical Properties of Living Tissues. Springer Verlag, 1993.
[16] F. Ganovelli, P. Cignoni, C. Montani, and R. Scopigno, A Multiresolution Model for Soft Objects Supporting Interactive Cuts and Lacerations Proc. EUROGRAPHICS 2000, pp. 271-282, 2000.
[17] J.D. Gascuel, M.P. Cani, M. Desbrun, E. Leroy, and C. Mirgon, Simulating Landslides for Natural Disaster Prevention Proc. Ninth Eurographics Workshop Computer Animation and Simulation, pp. 1-12, Sept. 1998.
[18] T. Goto, M. Escher, C. Zanardi, N. Magnenat-Thalmann, MPEG-4 Based Animation with Face Feature Tracking Proc. Erographics Workshop Computer Animation and Simulation '99, pp. 89-98, 1999.
[19] B. Guenter, C. Grimm, D. Wood, H. Malvar, and F. Pighin, Making Faces Proc. SIGGRAPH '98, vol. 32, pp. 55-66, July 1998.
[20] P. Kalra, A. Mangili, N. Magnenat-Thalmann, and D. Thalmann, Simulation of Facial Muscle Actions Based on Rational Free Form Deformations Proc. EUROGRAPHICS '92, pp. 59-69, 1992.
[21] L. Kobbelt, S. Campagna, J. Vorsatz, and H.P. Seidel, Interactive Multiresolution Modeling of Arbitrary Meshes Proc. SIGGRAPH '98, vol. 32, pp. 105-114, July 1998.
[22] L. Kobbelt, T. Bareuther, and H.P. Seidel, Multi-Resolution Shape Deformations for Meshes with Dynamic Vertex Connectivity Proc. EUROGRAPHICS 2000, Computer Graphics Forum, vol. 19, no. 3 pp. 249-260, 2000.
[23] R. Koch, M. Gross, F. Carls, D. Buren, G. Fankhauser, and Y. Parish, Simulating Facial Surgery Using Finite Element Models Proc. SIGGRAPH '96, vol. 30, pp. 421-428, Aug. 1996.
[24] R.M. Koch, M.H. Gross, and A.A. Bosshard, Emotion Editing Using Finite Elements Proc. EUROGRAPHICS '98, Computer Graphics Forum, vol. 17, no. 3, pp. 295-302, 1998.
[25] S. Kshirsagar, T. Molet, and N. Magnenat-Thalmann, Principal Components of Expressive Speech Animation Proc. Computer Graphics Int'l 2001, pp. 38-44, July 2001.
[26] Y. Lee, D. Terzopoulis, and K. Waters, Realistic Modeling for Facial Animation Proc. SIGGRAPH '95, vol. 29, pp. 55-62, Aug. 1995.
[27] C. Loop, Smooth Subdivision Surfaces Based on Triangles master's thesis, Univ. of Utah, 1987.
[28] P. Meseure and C. Chaillou, Deformable Body Simulation with Adaptive Subdivision and Cuttings Proc. Inte'l Conf. in Central Europe Computer Graphics, Visualization and Computer Vision (WSCG '97), pp. 361-370, 1997.
[29] M. Nahas, H. Huitric, and M. Saintourens, Animation of a B-Spline Figure The Visual Computer, vol. 3, no. 5, pp. 272-276, Mar. 1988.
[30] J. O'Brien and J. Hodgins, Graphical Models and Animation of Brittle Fracture Proc. SIGGRAPH '99, vol. 33, pp. 137-146, Aug. 1999.
[31] J. Ostermann, Animation of Synthetic Faces in MPEG-4 Proc. Computer Animation '98, pp. 49-55, 1998.
[32] D.J. Ostry, E. Vatikiotis-Bateson, and P.L. Gribble, An Examination of the Degrees of Freedom of Human Jaw Motion in Speech and Mastication J. Speech, Language, and Hearing Research, vol. 40, pp. 1341-1351, 1997.
[33] F.I. Parke, Computer Generated Animation of Faces master's thesis, Univ. of Utah, Salt Lake City, June 1972.
[34] F.I. Parke, Parameterized Models for Facial Animation IEEE Computer Graphics and Applications, vol. 2, no. 4, pp. 61-68, Nov. 1982.
[35] F.I. Parke and K. Waters, Computer Facial Animation. Wellesley, Mass.: AK Peters, 1996.
[36] L. Piegl and W. Tiller, The NURBS Book, second ed. Springer-Verlag, 1997.
[37] F. Pighin, J. Hecker, D. Lischinski, R. Szeliski, and D.H. Salesin, Synthesizing Realistic Facial Expressions from Photographs Proc. SIGGRAPH '98, vol. 32, pp. 75-84, July 1998.
[38] S. Platt and N. Badler, Animating Facial Expressions Proc. SIGGRAPH '81, vol. 15, pp. 245-252, 1981.
[39] H. Tao and T.S. Huang, Facial Animation and Video Tracking Proc. Int'l Workshop Modeling and Motion Capture Techniques for Virtual Environments (CAPTECH '98), pp. 242-253, 1998.
[40] D. Terzopoulus and K. Waters, Physically-Based Facial Modeling, Analysis and Animation J. Visualization and Computer Animation, vol. 1, pp. 73-80, 1990.
[41] N. Magnenat-Thalmann, H. Minh, M. deAngelis, and D. Thalmann, Design, Transformation and Animation of Human Faces The Visual Computer, vol. 5, pp. 32-39, 1989.
[42] P. Volino and N. Magnenat-Thalmann, The SPHERIGON: A Simple Polygon Patch for Smoothing Quickly Your Polygonal Meshes Proc. Computer Animation '98, pp. 72-79, 1998.
[43] C.L.Y. Wang and D.R. Forsey, Langwidere: A New Facial Animation System Proc. Computer Animation '94, pp. 59-68, 1994.
[44] K. Waters, A Muscle Model for Animating Three-Dimensional Facial Expression Proc. SIGGRAPH '87, vol. 21, pp. 17-24, July 1987.
[45] P.L. Williams, R. Warwick, M. Dyson, and L.H. Bannister, Gray's Anatomy, 37th ed. London: Churchill Livingstone, 1989.
[46] L. Williams, Performance-Driven Facial Animation Proc. SIGGRAPH '90, vol. 24, pp. 235-242, Aug. 1990.
[47] Y. Wu, N.M. Thalmann, and D. Thalmann, A Dynamic Wrinkle Model in Facial Animation and Skin Aging J. Visualization and Computer Animation, vol. 6, pp. 195-202, 1998.
[48] Y. Zhang, E.C. Prakash, and E. Sung, Animation of Facial Expressions by Physical Modeling Proc. EUROGRAPHICS 2001, short presentations, pp. 335-345, 2001.
[49] D. Zorin, P. Schroder, and W. Sweldens, Interpolating Subdivision for Meshes with Arbitrary Topology Proc. SIGGRAPH '96, vol. 30, pp. 189-192, Aug. 1996.

Index Terms:
Facial expression animation, physical model, multilayer structure, dynamic deformation, adaptive mesh.
Yu Zhang, Edmond C. Prakash, Eric Sung, "A New Physical Model with Multilayer Architecture for Facial Expression Animation Using Dynamic Adaptive Mesh," IEEE Transactions on Visualization and Computer Graphics, vol. 10, no. 3, pp. 339-352, May-June 2004, doi:10.1109/TVCG.2004.1272733
Usage of this product signifies your acceptance of the Terms of Use.