The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.09 - Sept. (2012 vol.18)
pp: 1511-1519
R. Goecke , Fac. of Inf. Sci. & Eng., Univ. of Canberra, Canberra, ACT, Australia
ABSTRACT
The issue of transferring facial performance from one person's face to another's has been an area of interest for the movie industry and the computer graphics community for quite some time. In recent years, deformable face models, such as the Active Appearance Model (AAM), have made it possible to track and synthesize faces in real time. Not surprisingly, deformable face model-based approaches for facial performance transfer have gained tremendous interest in the computer vision and graphics community. In this paper, we focus on the problem of real-time facial performance transfer using the AAM framework. We propose a novel approach of learning the mapping between the parameters of two completely independent AAMs, using them to facilitate the facial performance transfer in a more realistic manner than previous approaches. The main advantage of modeling this parametric correspondence is that it allows a "meaningful” transfer of both the nonrigid shape and texture across faces irrespective of the speakers' gender, shape, and size of the faces, and illumination conditions. We explore linear and nonlinear methods for modeling the parametric correspondence between the AAMs and show that the sparse linear regression method performs the best. Moreover, we show the utility of the proposed framework for a cross-language facial performance transfer that is an area of interest for the movie dubbing industry.
INDEX TERMS
solid modelling, cinematography, image texture, regression analysis, movie dubbing industry, parametric correspondence, computer graphics community, active appearance model, deformable face model-based approaches, computer vision, nonrigid shape, nonrigid texture, sparse linear regression method, cross-language facial performance transfer, Face, Shape, Computational modeling, Active appearance model, Training, Deformable models, Solid modeling, face modeling and animation., Active appearance models, facial performance transfer
CITATION
R. Goecke, "Facial Performance Transfer via Deformable Models and Parametric Correspondence", IEEE Transactions on Visualization & Computer Graphics, vol.18, no. 9, pp. 1511-1519, Sept. 2012, doi:10.1109/TVCG.2011.157
17 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool