The Community for Technology Leaders
Green Image
Issue No. 05 - September/October (2003 vol. 23)
ISSN: 0272-1716
pp: 38-45
Barnab? Tak?cs , Digital Elite
Bernadette Kiss , VerAnim
ABSTRACT
<p>This article presents a multimodal human-computer interface that employs photorealistic virtual humans that can talk, emote, and act adaptively and intelligently in response to the actions of a user in front of a computer screen. The authors implemented this virtual human interface (VHI) system in a high-performance real-time, visual environment. This article describes novel 3D facial modeling and animation techniques used to design virtual faces capable of delivering fine details of metacommunication and supporting verbal content. It also introduces an artificial expression space representation to control the emotions and expressions of the animated digital human characters. The article describes the use of intelligent sensory mechanisms-such as vision, hearing, and touching-and presents special purpose sensory modules-such as face recognition and expression analysis. Experimental results of the VHI environment and practical application areas, including the first holographic virtual human, are discussed.</p>
INDEX TERMS
virtual human, autonomous agents, human-computer interaction (HCI), real-time animation, vision and perception, behavior control, user interfaces, face tracking and recognition.
CITATION
Barnab? Tak?cs, Bernadette Kiss, "The Virtual Human Interface: A Photorealistic Digital Human", IEEE Computer Graphics and Applications, vol. 23, no. , pp. 38-45, September/October 2003, doi:10.1109/MCG.2003.1231176
94 ms
(Ver )