Issue No. 07 - July (2004 vol. 26)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TPAMI.2004.27
Ruigang Yang , IEEE
Zhengyou Zhang , IEEE
<p><b>Abstract</b>—The lack of eye contact in desktop video teleconferencing substantially reduces the effectiveness of video contents. While expensive and bulky hardware is available on the market to correct eye gaze, researchers have been trying to provide a practical software-based solution to bring video-teleconferencing one step closer to the mass market. This paper presents a novel approach: Based on stereo analysis combined with rich domain knowledge (a personalized face model), we synthesize, using graphics hardware, a virtual video that maintains eye contact. A 3D stereo head tracker with a <it>personalized</it> face model is used to compute initial correspondences across two views. More correspondences are then added through template and feature matching. Finally, all the correspondence information is fused together for view synthesis using view morphing techniques. The combined methods greatly enhance the accuracy and robustness of the synthesized views. Our current system is able to generate an eye-gaze corrected video stream at five frames per second on a commodity 1 GHz PC.</p>
Stereoscopic vision, eye-gaze correction, model-based tracking, head tracking, pose determination.
R. Yang and Z. Zhang, "Eye Gaze Correction with Stereovision for Video-Teleconferencing," in IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 26, no. , pp. 956-960, 2004.