The Community for Technology Leaders
Green Image
Issue No. 05 - September/October (2005 vol. 25)
ISSN: 0272-1716
pp: 40-48
Barnab? Tak?cs , Digital Elite
ABSTRACT
A special education and rehabilitation system employs real-time interactive computer graphics and photorealistic virtual humans that use gaze and facial gestures as guides to focus the learner's attention. By incorporating appropriate emotional responses while providing both verbal and nonverbal feedback, the solution implements an emotional modulation technique that increases learning efficiency. The model is based on a closed-loop interaction paradigm in which the learner's internal state is continuously monitored by sensors, and the responses as well as strategies of the animated tutoring system are adjusted accordingly. Sensors include a video camera for facial tracking and facial expression analysis, an eye tracker for measuring gaze, a biofeedback device to gauge stress levels, and other input/output devices for VR. The system has been used to develop many novel practical solutions. Case studies include applications for autistic children, cybertherapy, and cognitive rehabilitation.
INDEX TERMS
ACE, virtual-human interface, rehabilitation, human-computer interaction (HCI), real-time animation, vision and perception, behavior control
CITATION
Barnab? Tak?cs, "Special Education and Rehabilitation: Teaching and Healing with Interactive Graphics", IEEE Computer Graphics and Applications, vol. 25, no. , pp. 40-48, September/October 2005, doi:10.1109/MCG.2005.113
99 ms
(Ver )