The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.04 - April (2013 vol.19)
pp: 711-720
E. Bekele , EECS Dept., Vanderbilt Univ., Nashville, TN, USA
Zhi Zheng , Electr. Eng. & Comput. Sci. Dept., Vanderbilt Univ., Nashville, TN, USA
A. Swanson , Treatment & Res. in Autism Disorders (TRIAD), Vanderbilt Univ., Nashville, TN, USA
J. Crittendon , Dept. of Pediatrics & Psychiatry, Vanderbilt Univ., Nashville, TN, USA
Z. Warren , Dept. of Pediatrics & Psychiatry, Vanderbilt Univ., Nashville, TN, USA
N. Sarkar , Mech. Eng. Dept., Vanderbilt Univ., Nashville, TN, USA
ABSTRACT
Autism Spectrum Disorders (ASD) are characterized by atypical patterns of behaviors and impairments in social communication. Among the fundamental social impairments in the ASD population are challenges in appropriately recognizing and responding to facial expressions. Traditional intervention approaches often require intensive support and well-trained therapists to address core deficits, with many with ASD having tremendous difficulty accessing such care due to lack of available trained therapists as well as intervention costs. As a result, emerging technology such as virtual reality (VR) has the potential to offer useful technology-enabled intervention systems. In this paper, an innovative VR-based facial emotional expression presentation system was developed that allows monitoring of eye gaze and physiological signals related to emotion identification to explore new efficient therapeutic paradigms. A usability study of this new system involving ten adolescents with ASD and ten typically developing adolescents as a control group was performed. The eye tracking and physiological data were analyzed to determine intragroup and intergroup variations of gaze and physiological patterns. Performance data, eye tracking indices and physiological features indicated that there were differences in the way adolescents with ASD process and recognize emotional faces compared to their typically developing peers. These results will be used in the future for an online adaptive VR-based multimodal social interaction system to improve emotion recognition abilities of individuals with ASD.
INDEX TERMS
Variable speed drives, Biomedical monitoring, Monitoring, Animation, Emotion recognition, Physiology, Autism,vr-based response systems., 3D Interaction, multimodal interaction, psychology, usability
CITATION
E. Bekele, Zhi Zheng, A. Swanson, J. Crittendon, Z. Warren, N. Sarkar, "Understanding How Adolescents with Autism Respond to Facial Expressions in Virtual Reality Environments", IEEE Transactions on Visualization & Computer Graphics, vol.19, no. 4, pp. 711-720, April 2013, doi:10.1109/TVCG.2013.42
REFERENCES
[1] Diagnostic and Statistical Manual of Mental Disorders: Quick reference to the diagnostic criteria from DSM-IV-TR, Washington, DC: American Psychiatric Association, Amer Psychiatric Pub Incorporated, 2000.
[2] J. Baio, Autism,D. D. M. Network, C. f. D. Control,, and Prevention,Prevalence of Autism Spectrum Disorders — Autism and Developmental Disabilities Monitoring Network, 14 Sites, United States, 2008: National Center on Birth Defects and Developmental Disabilities, Centers for Disease Control and Prevention (CDC), US Department of Health and Human Services, 2012.
[3] G. S. Chasson, G. E. Harris, and W. J. Neely, “Cost comparison of early intensive behavioral intervention and special education for children with autism,” Journal of Child and Family Studies, vol. 16, no. 3, pp. 401-413, 2007.
[4] M. L. Ganz, “The lifetime distribution of the incremental societal costs of autism,” Archives of Pediatrics and Adolescent Medicine, Am Med Assoc, vol. 161, no. 4, pp. 343-349, 2007.
[5] C. J. Newschaffer and L. K. Curran, “Autism: an emerging public health problem,” Public Health Reports, vol. 118, no. 5, pp. 393-399, 2003.
[6] R. Adolphs, L. Sears, and J. Piven, “Abnormal processing of social information from faces in autism,” Journal of Cognitive neuroscience, vol. 13, no. 2, pp. 232-240, 2001.
[7] F. Castelli, “Understanding emotions from standardized facial expressions in autism and normal development,” Autism, vol. 9, no. 4, pp. 428-449, 2005.
[8] G. Dawson, S. J. Webb, and J. McPartland, “Understanding the nature of face processing impairment in autism: Insights from behavioral and electrophysiological studies,” Developmental neuropsychology, vol. 27, no. 3, pp. 403-424, 2005.
[9] L. Capps, N. Yirmiya, and M. Sigman, “Understanding of Simple and Complex Emotions in Non-retarded Children with Autism,” Journal of Child Psychology and Psychiatry, vol. 33, no. 7, pp. 1169-1182, 1992.
[10] S. J. Weeks and R. P. Hobson, “The salience of facial expression for autistic children,” Journal of Child Psychology and Psychiatry, vol. 28, no. 1, pp. 137-152, 1987.
[11] R. P. Hobson, “The autistic child's appraisal of expressions of emotion,” Journal of Child Psychology and Psychiatry, vol. 27, no. 3, pp. 321-342, 1986.
[12] N. Bauminger, “The facilitation of social-emotional understanding and social interaction in high-functioning children with autism: Intervention outcomes,” Journal of autism and developmental disorders, vol. 32, no. 4, pp. 283-298, 2002.
[13] M. S. Goodwin, “Enhancing and Accelerating the Pace of Autism Research and Treatment,” Focus on Autism and Other Developmental Disabilities, vol. 23, no. 2, pp. 125-128, 2008.
[14] U. Lahiri, E. Bekele, E. Dohrmann, Z. Warren, and N. Sarkar, “Design of a Virtual Reality based Adaptive Response Technology for Children with Autism,” IEEE transactions on neural systems and rehabilitation engineering: a publication of the IEEE Engineering in Medicine and Biology Society, vol. PP (early access), no. 99, pp. 1, 2012.
[15] P. J. Standen, Brown,D. J., “Virtual reality in the rehabilitation of people with intellectual disabilities: review,” Cyberpsychology & behavior, vol. 8, no. 3, pp. 272-282, 2005.
[16] A. Tartaro, Cassell,J., “Using virtual peer technology as an intervention for children with autism,” in Towards Universal Usability: Designing Computer Interfaces for Diverse User Populations., Chichester, UK, 2006, pp. 231-262.
[17] P. Kenny, T. Parsons, J. Gratch, A. Leuski, and A. Rizzo, “Virtual patients for clinical therapist skills training,” in Intelligent Virtual Agents, 2007, pp. 197-210.
[18] P. Mitchell, Parsons,S., Leonard,A., “Using virtual environments for teaching social understanding to 6 adolescents with autistic spectrum disorders,” Journal of autism and developmental disorders, vol. 37, no. 3, pp. 589-600, 2007.
[19] C. Liu, Conn,K., Sarkar,N., Stone,W., “Physiology-based affect recognition for computer-assisted intervention of children with Autism Spectrum Disorder,” International Journal of Human-Computer Studies, Elsevier, vol. 66, no. 9, pp. 662-677, 2008.
[20] C. Liu, K. Conn, N. Sarkar, and W. Stone, “Online affect detection and robot behavior adaptation for intervention of children with autism,” Robotics, IEEE Transactions on, vol. 24, no. 4, pp. 883-896, 2008.
[21] U. Lahiri, Warren,Z., Sarkar,N., “Design of a Gaze-Sensitive Virtual Social Interactive System for Children With Autism,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 19, no. 4, pp. 443-452, 2011.
[22] S. Parsons and S. Cobb, “State-of-the-art of Virtual Reality technologies for children on the autism spectrum,” European Journal of Special Needs Education, vol. 26, no. 3, pp. 355-366, 2011.
[23] N. Josman, H. M. Ben-Chaim, S. Friedrich, and P. L. Weiss, “Effectiveness of virtual reality for teaching street-crossing skills to children and adolescents with autism,” International Journal on Disability and Human Development, vol. 7, no. 1, pp. 49-56, 2011.
[24] C. Schmidt and M. Schmidt, “Three-dimensional virtual learning environments for mediating social skills acquisition among individuals with autism spectrum disorders,” in Proceedings of the 7th international conference on Interaction design and children, 2008, pp. 85-88.
[25] M. Wang and D. Reid, “Virtual Reality in Pediatric Neurorehabilitation: Attention Deficit Hyperactivity Disorder, Autism and Cerebral Palsy,” Neuroepidemiology, vol. 36, no. 1, pp. 2-18, 2011.
[26] M. Fabri, S. Y. A. Elzouki, and D. Moore, “Emotionally expressive avatars for chatting, learning and therapeutic intervention,” in Human-Computer Interaction. HCI Intelligent Multimodal Interaction Environments, 2007, pp. 275-285.
[27] E. Gal, N. Bauminger, D. Goren-Bar, F. Pianesi, O. Stock, M. Zancanaro, and P. L. Weiss, “Enhancing social communication of children with high-functioning autism through a co-located interface,” AI & Society, vol. 24, no. 1, pp. 75-84, 2009.
[28] N. Bauminger, D. Goren-Bar, E. Gal, P. Weiss, J. Kupersmitt, F. Pianesi, O. Stock, and M. Zancanaro, “Enhancing social communication in high-functioning children with autism through a co-located interface,” in Multimedia Signal Processing. IEEE 9th Workshop on, 2007, pp. 18-21.
[29] L. A. Ruble and D. M. Robson, “Individual and environmental determinants of engagement in autism,” Journal of autism and developmental disorders, vol. 37, no. 8, pp. 1457-1468, 2007.
[30] K. C. Welch, Lahiri,U., Warren,Z., Sarkar,N., “An approach to the design of socially acceptable robots for children with autism spectrum disorders,” International Journal of Social Robotics, vol. 2, no. 4, pp. 391-403, 2010.
[31] C. J. Anderson, J. Colombo, and D. J. Shaddy, “Visual scanning and pupillary responses in young children with autism spectrum disorder,” Journal of Clinical and Experimental Neuropsychology, vol. 28, no. 7, pp. 1238-1256, 2006.
[32] D. D. Salvucci and J. H. Goldberg, “Identifying fixations and saccades in eye-tracking protocols,” in Proceedings of the 2000 symposium on Eye tracking research & applications, 2000, pp. 71-78.
[33] J. Groden, M. S. Goodwin, M. G. Baron, G. Groden, W. F. Velicer, L. P. Lipsitt, S. G. Hofmann, and B. Plummer, “Assessing cardiovascular responses to stressors in individuals with autism spectrum disorders,” Focus on Autism and Other Developmental Disabilities, vol. 20, no. 4, pp. 244-252, 2005.
[34] J. T. Cacioppo, L. G. Tassinary, and G. G. Berntson,Handbook of psychophysiology: Cambridge Univ Pr, 2007.
[35] P. Ekman, “Facial expression and emotion,” American Psychologist, vol. 48, no. 4, pp. 384, 1993.
[36] H. Shiffman, “Fundamental visual functions and phenomena” sensation and perception: An Integrated Approach, pp. 89-115 : John Welsly and Sons, New York, 2001.
[37] K. Gotham, S. Risi, A. Pickles, and C. Lord, “The Autism Diagnostic Observation Schedule: revised algorithms for improved diagnostic validity,” Journal of Autism and Developmental Disorders, vol. 37, no. 4, pp. 613-627, 2007.
[38] J. Constantino and C. Gruber, “The social responsiveness scale,” Los Angeles: Western Psychological Services, 2002.
[39] M. Rutter, A. Bailey, C. Lord, and S. Berument, “Social communication questionnaire,” Los Angeles, CA: Western Psychological Services, 2003.
[40] D. Wechsler,Wechsler Abbreviated Scale of Intelligence® — Fourth Edition (WASI®-IV), San Antonio, TX: Harcourt Assessment, The Psychological Corporation, 2008.
[41] A. Klin, W. Jones, R. Schultz, F. Volkmar, and D. Cohen, “Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism,” Archives of general psychiatry, vol. 59, no. 9, pp. 809, 2002.
[42] L. L. Sears, P. R. Finn, and J. E. Steinmetz, “Abnormal classical eye-blink conditioning in autism,” Journal of autism and developmental disorders, vol. 24, no. 6, pp. 737-751, 1994.
[43] R. Landry and S. E. Bryson, “Impaired disengagement of attention in young children with autism,” Journal of Child Psychology and Psychiatry, vol. 45, no. 6, pp. 1115-1122, 2004.
[44] K. Harris and D. Reid, “The influence of virtual reality play on children's motivation,” Canadian Journal of Occupational Therapy, vol. 72, no. 1, pp. 21-30, 2005.
52 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool