The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.10 - October (2011 vol.33)
pp: 2115-2121
Shu-Fan Wang , National Tsing Hua University, Hsinchu
Shang-Hong Lai , National Tsing-Hua University, Hsinchu
ABSTRACT
Facial expression modeling is central to facial expression recognition and expression synthesis for facial animation. In this work, we propose a manifold-based 3D face reconstruction approach to estimating the 3D face model and the associated expression deformation from a single face image. With the proposed robust weighted feature map (RWF), we can obtain the dense correspondences between 3D face models and build a nonlinear 3D expression manifold from a large set of 3D facial expression models. Then a Gaussian mixture model in this manifold is learned to represent the distribution of expression deformation. By combining the merits of morphable neutral face model and the low-dimensional expression manifold, a novel algorithm is developed to reconstruct the 3D face geometry as well as the facial deformation from a single face image in an energy minimization framework. Experimental results on simulated and real images are shown to validate the effectiveness and accuracy of the proposed algorithm.
INDEX TERMS
3D face reconstruction, expression modeling, manifold analysis, surface registration.
CITATION
Shu-Fan Wang, Shang-Hong Lai, "Reconstructing 3D Face Model with Associated Expression Deformation from a Single Face Image via Constructing a Low-Dimensional Expression Deformation Manifold", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.33, no. 10, pp. 2115-2121, October 2011, doi:10.1109/TPAMI.2011.88
372 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool