Issue No.05 - September/October (2003 vol.23)
Barnab? Tak?cs , Digital Elite
Bernadette Kiss , VerAnim
<p>This article presents a multimodal human-computer interface that employs photorealistic virtual humans that can talk, emote, and act adaptively and intelligently in response to the actions of a user in front of a computer screen. The authors implemented this virtual human interface (VHI) system in a high-performance real-time, visual environment. This article describes novel 3D facial modeling and animation techniques used to design virtual faces capable of delivering fine details of metacommunication and supporting verbal content. It also introduces an artificial expression space representation to control the emotions and expressions of the animated digital human characters. The article describes the use of intelligent sensory mechanisms-such as vision, hearing, and touching-and presents special purpose sensory modules-such as face recognition and expression analysis. Experimental results of the VHI environment and practical application areas, including the first holographic virtual human, are discussed.</p>
virtual human, autonomous agents, human-computer interaction (HCI), real-time animation, vision and perception, behavior control, user interfaces, face tracking and recognition.
Barnab? Tak?cs, Bernadette Kiss, "The Virtual Human Interface: A Photorealistic Digital Human", IEEE Computer Graphics and Applications, vol.23, no. 5, pp. 38-45, September/October 2003, doi:10.1109/MCG.2003.1231176