The Community for Technology Leaders
RSS Icon
Issue No.04 - Oct.-Dec. (2013 vol.20)
pp: 18-27
Darren Cosker , University of Bath, UK
Peter Eisert , Humboldt University Berlin
Oliver Grau , Intel Visual Computing Institute
Peter J.B. Hancock , University of Stirling, UK
Jonathan McKinnell , BBC R&D, London
Eng-Jon Ong , Surrey University, UK
Facial expressions play an important role in day-by-day communication as well as media production. This article surveys automatic facial analysis and modeling methods using computer vision techniques and their applications for media production. The authors give a brief overview of the psychology of face perception and then describe some of the applications of computer vision and pattern recognition applied to face recognition in media production. This article also covers the automatic generation of face models, which are used in movie and TV productions for special effects in order to manipulate people's faces or combine real actors with computer graphics.
Production, Face recognition, Shape analysis, Training, Media,facial composite systems, multimedia, facial recognition, facial tracking, automated lip-reading, computer graphics, 3D video processing
Darren Cosker, Peter Eisert, Oliver Grau, Peter J.B. Hancock, Jonathan McKinnell, Eng-Jon Ong, "Applications of Face Analysis and Modeling in Media Production", IEEE MultiMedia, vol.20, no. 4, pp. 18-27, Oct.-Dec. 2013, doi:10.1109/MMUL.2012.61
1. C. Donner et al., “A Layered, Heterogeneous Reflectance Model for Acquiring and Rendering Human Skin,” ACM Trans. Graphics (Proc. SIGGRAPH Asia 2008), vol. 27, no. 5, 2008, pp. 140:1-140:12.
2. V. Bruce and A. Young, Face Perception, Psychology Press, 2011.
3. A. Calder et al., eds., Oxford Handbook of Face Perception, Oxford Univ. Press, 2011.
4. G. Hole and V. Bourne, Face Processing: Psychological, Neuropsychological and Applied Perspectives, Oxford Univ. Press, 2010.
5. W. Ma et al., “Rapid Acquisition of Specular and Diffuse Normal Maps from Polarized Spherical Gradient Illumination,” Proc. Eurographics Symp. Rendering, Eurographics Assoc., 2007, pp. 183-194.
6. G. Borshukov et al., “Universal Capture: Image-Based Facial Animation for The Matrix Reloaded,” SIGGRAPH Course Notes, ACM, 2005, article no. 16.
7. T. Beeler et al., “High-Quality Single-Shot Capture of Facial Geometry,” ACM Trans. Graphics (Proc. ACM SIGGRAPH 2010), vol. 29, no. 4, 2010, article no. 40.
8. K. Ward et al., “A Survey on Hair Modeling: Styling, Simulation and Rendering,” IEEE Trans. Visualization and Computer Graphics, vol. 13, no. 2, 2007, pp. 213-234.
9. T. Lokovic and E. Veach, “Deep Shadow Maps,” Proc. 27th Ann. Conf. Computer Graphics and Interactive Techniques (SIGGRAPH), ACM, 2000, pp. 385-392.
10. D.C. Schneider et al., “Deformable Image Alignment as a Source of Stereo Correspondences on Portraits,” Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CVPR 2011), IEEE CS, 2011, pp. 41-52.
11. B. Bickel et al., “Multi-scale Capture of Facial Geometry and Motion,” ACM Trans. Graphics (Proc. ACM SIGGRAPH 2010), vol. 30, no. 3, 2011, article no. 33.
12. D. Bradley et al., “High Resolution Passive Facial Performance Capture,” ACM Trans. Graphics (Proc. ACM SIGGRAPH 2010), vol. 29, no. 4, 2011, article no. 41.
13. T. Beeler et al., “High-Quality Passive Facial Performance Capture Using Anchor Frames,” ACM Trans. Graphics (Proc. SIGGRAPH 2011), vol. 30, no. 3, 2011, article no. 75.
14. O. Alexander et al., “The Digital Emily Project: Achieving a Photoreal Digital Actor,” IEEE Computer Graphics & Applications, vol. 30, no. 4, 2010, pp. 20-31.
15. PF. Pighin and J.P. Lewis, “Performance Driven Facial Animation,” SIGGRAPH Course Notes, ACM, 2006.
16. T. Weise et al., “Realtime Performance Based Facial Animation,” ACM Trans. Graphics (Proc. ACM SIGGRAPH 2011), vol. 30, no. 4, 2011, article no. 77.
17. J. Tena, F. De la Torre, and I. Matthews, “Interactive Region-Based Linear 3D Face Models, ACM Trans. Graphics (Proc. ACM SIGGRAPH 2011), vol. 30, no. 4, 2011, article no. 76.
18. E. Ong et al., “Robust Facial Feature Tracking Using Selected Multi-resolution Linear Predictors,” Proc. 12th Int'l Conf. Computer Vision, IEEE CS, 2009, pp. 1483-1490.
19. G. Zhao, M. Barnard, and M. Pietikainen, “Lipreading with Local Spatiotemporal Descriptors,” IEEE Trans. Multimedia, vol. 11, no. 7, 2009, pp. 1254-1265.
20. E. Ong and R. Bowden, “Learning Sequential Patterns for Lipreading,” Proc. British Machine Vision Conf. (BMVC), 2011, paper no. 55; paper55.pdf.
128 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool