This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Glasses Removal from Facial Image Using Recursive Error Compensation
May 2005 (vol. 27 no. 5)
pp. 805-811
In this paper, we propose a new method of removing glasses from a human frontal facial image. We first detect the regions occluded by the glasses and generate a natural looking facial image without glasses by recursive error compensation using PCA reconstruction. The resulting image has no trace of the glasses frame or of the reflection and shade caused by the glasses. The experimental results show that the proposed method provides an effective solution to the problem of glasses occlusion and we believe that this method can also be used to enhance the performance of face recognition systems.

[1] R. Chellappa, C.L. Wilson, and S. Sirohey, “Human and Machine Recognition of Faces: A Survey,” Proc. IEEE, vol. 83, no. 5, pp. 705-740, May 1995.
[2] B.-W. Hwang and S.-W. Lee, “Reconstruction of Partially Damaged Face Images Based on a Morphable Face Model,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 3, pp. 365-372, Mar. 2003.
[3] A.M. Martinez, “Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample per Class,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 6, pp. 748-763, June 2002.
[4] A. Lanitis, C.J. Taylor, and T.F. Cootes, “Automatic Interpretation and Coding of Face Images Using Flexible Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 743-756, July 1997.
[5] X. Jiang, M. Binkert, B. Achermann, and H. Bunke, “Towards Detection of Glasses in Facial Images,” Proc. Int'l Conf. Pattern Recognition, pp. 1071-1073, Nov. 1998.
[6] Y. Saito, Y. Kenmochi, and K. Kotani, “Estimation of Eyeglassless Facial Images Using Principal Component Analysis,” Proc. Int'l Conf. Image Processing, vol. 4, pp. 197-201, Oct. 1999.
[7] Z. Jing and R. Mariani, “Glasses Detection and Extraction by Deformable Contour,” Proc. Int'l Conf. Pattern Recognition, pp. 933-936, Aug. 2000.
[8] H. Wu et al., “Glasses Frame Detection with 3D Hough Transform,” Proc. Int'l Conf. Pattern Recognition, pp. 346-349, Aug. 2002.
[9] Y. Xiao and H. Yan, “Extraction of Glasses in Human Face Image,” Proc. First Int'l Conf. Biometric Authentication, pp. 214-220, July 2004.
[10] J.-S. Park, Y.-H. Oh, S.-C. Ahn, and S.-W. Lee, “Glasses Removal from Facial Image Using Recursive PCA Reconstruction,” Proc. Int'l Conf. Audio- and Video-based Biometric Person Authentication, pp. 369-376, June 2003.
[11] B.-W. Hwang, J.-S. Park, and S.-W. Lee, “Synthesis of High-Resolution Facial Image Based on Top-Down Learning,” Proc. Int'l Conf. Audio- and Video-based Biometric Person Authentication, pp. 377-384, June 2003.
[12] B.-W. Hwang, M.-C. Roh, and S.-W. Lee, “Performance Evaluation of Face Recognition Algorithms on Asian Face Recognition,” Proc. Sixth IEEE Int'l Conf. Automatic Face and Gesture Recognition, pp. 278-283, May 2004.

Index Terms:
Kernel methods, one class SVM, clustering algorithms, EM algorithm, K-Means.
Citation:
Jeong-Seon Park, You Hwa Oh, Sang Chul Ahn, Seong-Whan Lee, "Glasses Removal from Facial Image Using Recursive Error Compensation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 5, pp. 805-811, May 2005, doi:10.1109/TPAMI.2005.103
Usage of this product signifies your acceptance of the Terms of Use.