This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Orthogonal-Blendshape-Based Editing System for Facial Motion Capture Data
November/December 2008 (vol. 28 no. 6)
pp. 76-82
Qing Li, University of Houston
Zhigang Deng, University of Houston
The authors present a novel data-driven 3D facial motion capture data editing system using automated construction of an orthogonal blendshape face model and constrained weight propagation, aiming to bridge the popular facial motion capture technique and blendshape approach. In this work, a 3D facial-motion-capture-editing problem is transformed to a blendshape-animation-editing problem. Given a collected facial motion capture data set, we construct a truncated PCA space spanned by the greatest retained eigenvectors and a corresponding blendshape face model for each anatomical region of the human face. As such, modifying blendshape weights (PCA coefficients) is equivalent to editing their corresponding motion capture sequence. In addition, a constrained weight propagation technique allows animators to balance automation and flexible controls.

1. J.P. Lewis et al., "Reducing Blendshape Interference by Selected Motion Attenuation," Proc. ACM Siggraph Symp. Interactive 3D Graphics and Games (I3DG 05), ACM Press, 2005, pp. 25–29.
2. C. Busso et al., "Natural Head Motion Synthesis Driven by Acoustic Prosody Features," Computer Animation and Virtual Worlds, vol. 16, nos. 3–4, 2005, pp. 283–290.
3. Q. Zhang et al., "Geometry-Driven Photorealistic Facial Expression Synthesis," Proc. Symp. Computer Animation, Eurographics Assoc., 2003, pp. 177–186.
4. P. Joshi et al., "Learning Controls for Blendshape Based Realistic Facial Animation," Proc. Symp. Computer Animation, Eurographics Assoc., 2003, pp. 35–42.
5. S. Kshirsagar, S. Garchery, and N.M. Thalmann, "Feature Point Based Mesh Deformation Applied to MPEG-4 Facial Animation," Proc. Deform 2000, Kluwer, 2000, pp. 23–34.
1. J.P. Lewis et al., "Reducing Blendshape Interference by Selected Motion Attenuation," Proc. ACM Siggraph Symp. Interactive 3D Graphics and Games, ACM Press, 2005, pp. 25–29.
2. Z. Deng et al., "Animating Blendshape Faces by Cross Mapping Motion Capture Data," Proc. ACM Siggraph Symp. Interactive 3D Graphics and Games, ACM Press, 2006, pp. 43–48.
3. Q. Zhang et al., "Geometry-Driven Photorealistic Facial Expression Synthesis," Proc. Symp. Computer Animation, Eurographics Assoc., 2003, pp. 177–186.
4. E.S. Chuang, H. Deshpande, and C. Bregler, "Facial Expression Space Learning," Proc. Pacific Graphics 2002, IEEE CS Press 2002, pp. 68–76.
5. D. Vlasic et al, "Face Transfer with Multilinear Models," ACM Trans. Graphics, vol. 24, no. 3, 2005, pp. 426–433.
6. Y. Cao, P. Faloutsos, and F. Pighin, "Unsupervised Learning for Speech Motion Editing," Proc. Symp. Computer Animation, Eurographics Assoc., 2003, pp. 225–231.
7. P. Joshi et al., "Learning Controls for Blend Shape Based Realistic Facial Animation," Proc. Symp. Computer Animation, Eurographics Assoc., 2003, pp. 35–42.
8. E. Chang and O.C. Jenkins, "Sketching Articulation and Pose for Facial Animation," Proc. Symp. Computer Animation, Eurographics Assoc., 2006, pp. 271–280.

Index Terms:
Motion editing, blendshape animation, facial animation, motion capture, data-driven, motion propagation
Citation:
Qing Li, Zhigang Deng, "Orthogonal-Blendshape-Based Editing System for Facial Motion Capture Data," IEEE Computer Graphics and Applications, vol. 28, no. 6, pp. 76-82, Nov.-Dec. 2008, doi:10.1109/MCG.2008.120
Usage of this product signifies your acceptance of the Terms of Use.