Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings. (2004)
May 17, 2004 to May 19, 2004
Yuxiao Hu , Microsoft Research, Asia, Beijing, China
Dalong Jiang , Chinese Academy of Sci., Beijing, China
Shuicheng Yan , Peking University, Beijing, China
Lei Zhang , Microsoft Research, Asia, Beijing, China
Hongjiang Zhang , Microsoft Research, Asia, Beijing, China
An analysis-by-synthesis framework for face recognition with variant pose, illumination and expression (PIE) is proposed in this paper. First, an efficient 2D-to-3D integrated face reconstruction approach is introduced to reconstruct a personalized 3D face model from a single frontal face image with neutral expression and normal illumination; Then, realistic virtual faces with different PIE are synthesized based on the personalized 3D face to characterize the face subspace; Finally, face recognition is conducted based on these representative virtual faces. Compared with other related works, this framework has the following advantages: 1) only one single frontal face is required for face recognition, which avoids the burdensome enrollment work; 2) the synthesized face samples provide the capability to conduct recognition under difficult conditions like complex PIE; and 3) the proposed 2D-to-3D integrated face reconstruction approach is fully automatic and more efficient. The extensive experimental results show that the synthesized virtual faces significantly improve the accuracy of face recognition with variant PIE.
D. Jiang, L. Zhang, H. Zhang, Y. Hu and S. Yan, "Automatic 3D Reconstruction for Face Recognition," Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings.(FG), Seoul, Korea, 2004, pp. 843.