This Article 
 Bibliographic References 
 Add to: 
Reconstruction of Partially Damaged Face Images Based on a Morphable Face Model
March 2003 (vol. 25 no. 3)
pp. 365-372
Bon-Woo Hwang, IEEE Computer Society
Seong-Whan Lee, IEEE Computer Society

Abstract—This paper proposes a method for reconstructing partially damaged faces based on a morphable face model. Faces are modeled by linear combinations of prototypes of shape and texture. With the shape and texture information from an undamaged region only, we can estimate optimal coefficients for linear combinations of prototypes of shape and texture by simple projection for least-square minimization (LSM). Our experimental results show that reconstructed faces are very natural and plausible like real photos.

[1] D. Beymer, A. Shashua, and T. Poggio, "Example Based Image Analysis and Synthesis," M.I.T. A.I. Memo No. 1431, 1993.
[2] D. Beymer and T. Poggio, “Image Representation for Visual Learning,” Science, vol. 272, pp. 1905-1909, 1996.
[3] V. Blanz and T. Vetter, "A Morphable Model for the Synthesis of 3D Faces," Proc. Siggraph 99, ACM Press, 1999, pp. 187-194.
[4] B.-W. Hwang, V. Blanz, T. Vetter, and S.-W. Lee, “Face Reconstruction From a Small Number of Feature Points,” Proc. Int'l Conf. Pattern Recognition, vol. 2, pp. 842-845, Sept. 2000.
[5] M.J. Jones, P. Sinha, T. Vetter, and T. Poggio, “Top-Down Learning of Low-Level Vision Tasks [Brief Communication],” Current Biology, vol. 7, pp. 991-994, 1997.
[6] M.J. Jones and T. Poggio, “Multidimensional Morphable Models: A Framework for Representing and Matching Object Classes,” Int'l J. Computer Vision, vol. 2, no. 29, pp. 107-131, 1998.
[7] P.M. Narendra, “A Separable Median Filter for Image Noise Smoothing,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 3, no. 1, pp. 20-29, 1981.
[8] T. Poggio and T. Vetter, “Recognition and Structure from One 2D Model View: Observations on Prototypes, Object Classes and Symmetries,” Artificial Intelligence Memo 1347/CBIP Paper 69, Mass. Inst. of Tech nology, Feb. 1992.
[9] Y. Saito, Y. Kenmochi, and K. Kotani, “Estimation of Eyeglassless Facial Images Using Principal Component Analysis,” Proc. Int'l Conf. Image Processing, vol. 4, pp. 197-201, Oct. 1999.
[10] G. Strang, Linear Algebra and Its Applications. Harcourt Brace Jovanovich College Publishers, pp. 442-451, 1988.
[11] M. Turk and A. Pentland, “Eigenfaces for Recognition,” J. Cognitive Neuroscience, vol. 3, no. 1, pp. 71-86, 1991.
[12] T. Vetter and N.E. Troje, “Separation of Texture and Shape in Images of Faces for Image Coding and Synthesis,” J. Optical Soc. Am. A, vol. 14, no. 9, pp. 2152-2161, 1997.
[13] P.S. Windyga, “Fast Impulsive Noise Removal,” IEEE Trans. Image Processing, vol. 10, no. 1, pp. 173-178, 2001.

Index Terms:
Face reconstruction, face synthesis, morphable face model, least-square minimization, damaged face.
Bon-Woo Hwang, Seong-Whan Lee, "Reconstruction of Partially Damaged Face Images Based on a Morphable Face Model," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 3, pp. 365-372, March 2003, doi:10.1109/TPAMI.2003.1182099
Usage of this product signifies your acceptance of the Terms of Use.