Mar. 13, 2001 to Mar. 17, 2001
Sumedha Kshirsagar , MIRALab -University of Geneva
Won-Sook Lee , MIRALab -University of Geneva
Nadia Magnenat-Thalmann , MIRALab -University of Geneva
We present our system for personalized face and speech communication over the Internet. The overall system consists of three parts: The cloning of real human faces to use as their presentative avatars, the Networked Virtual Environment System performing the basic tasks of network and device management, and the speech system, which includes a text-to-speech engine and a real-time phoneme extraction engine from natural speech. The combination of these three elements provides a system to allow real humans, represented by their virtual counterparts, to communicate with each other even when they are geographically remote. In addition to this, all elements present use MPEG-4 as a common communication and animation standard and were designed and tested on the Windows Operating System (OS). The paper presents the main aim of the work, the methodology and the resulting communication system.
Facial communication, Network Virtual Environment, speech communication, facial cloning, Internet, MPEG-4
Sumedha Kshirsagar, Won-Sook Lee, Nadia Magnenat-Thalmann, "Personalized Face and Speech Communication over the Internet", VR, 2001, Virtual Reality Conference, IEEE, Virtual Reality Conference, IEEE 2001, pp. 37, doi:10.1109/VR.2001.913768