• Publication
  • 2012
  • Issue No. 7 - July
  • Abstract - Real-Time Evaluation and Visualization of Learner Performance in a Mixed-Reality Environment for Clinical Breast Examination
 This Article 
 Bibliographic References 
 Add to: 
Real-Time Evaluation and Visualization of Learner Performance in a Mixed-Reality Environment for Clinical Breast Examination
July 2012 (vol. 18 no. 7)
pp. 1101-1114
D. S. Lind, Dept. of Surg., Med. Coll. of Georgia, Augusta, GA, USA
A. Kotranza, Dept. of Comput. & Inf. Sci. & Eng., Univ. of Florida, Gainesville, FL, USA
B. Lok, Dept. of Comput. & Inf. Sci. & Eng., Univ. of Florida, Gainesville, FL, USA
We investigate the efficacy of incorporating real-time feedback of user performance within mixed-reality environments (MREs) for training real-world tasks with tightly coupled cognitive and psychomotor components. This paper presents an approach to providing real-time evaluation and visual feedback of learner performance in an MRE for training clinical breast examination (CBE). In a user study of experienced and novice CBE practitioners (n = 69), novices receiving real-time feedback performed equivalently or better than more experienced practitioners in the completeness and correctness of the exam. A second user study (n = 8) followed novices through repeated practice of CBE in the MRE. Results indicate that skills improvement in the MRE transfers to the real-world task of CBE of human patients. This initial case study demonstrates the efficacy of MREs incorporating real-time feedback for training real-world cognitive-psychomotor tasks.

[1] A.C. Boud, D.J. Haniff, C. Baber, and S.J. Steiner, “Virtual Reality and Augmented Reality as a Training Tool for Assembly Tasks,” Proc. IEEE Int'l Conf. Information Visualization, pp. 32-36, 1999.
[2] E.A. Bilodeau and I.M. Bilodeau, “Motor Skills Learning,” Ann. Rev. of Psychology, vol. 13, pp. 243-280, 1962.
[3] C. Pilgrim, C. Lannon, R.P. Harris, W. Cogburn, and S.W Fletcher, “Improving Clinical Breast Examination Training in a Medical School: A Randomized Controlled Trial,” J. General Internal Medicine, vol. 8, no. 12, pp. 685-688, Dec. 1993.
[4] H.H.A. Latchman and S.M. Latchman, “Lectures on Demand in ALN-Enhancing the Online Learning Experience,” J. Asynchronous Learning Networks, vol. 5, no. 1, pp. 85-98, June 2001.
[5] T. Sielhorst, T. Blum, and N. Navab, “Synchronizing 3D Movements for Quantitative Comparison and Simultaneous Visualization of Actions,” Proc. Fourth IEEE and ACM Int'l Symp. Mixed and Augmented Reality, pp. 38-47, Oct. 2005.
[6] G. Lacey, D. Ryan, D. Cassidy, and D. Young, “Mixed-Reality Simulation of Minimally Invasive Surgeries,” IEEE Multimedia, vol. 14, no. 4, pp. 76-87, Oct.-Dec. 2007.
[7] A. Kotranza, B. Lok, A. Deladisma, C.M. Pugh, and D.S. Lind, “Mixed Reality Humans: Evaluating Behavior, Usability, and Acceptability,” IEEE Trans. Visualization and Computer Graphics, vol. 15, no. 3, pp. 369-382, May/June 2009.
[8] K. Patel, S. Jung, R. Diankov, R. Bajcsy, and J.N. Bailenson, “The Effects of Fully Immersive Virtual Reality on the Learning of Physical Tasks,” Proc. Ninth Ann. Int'l Workshop Presence, pp. 87-94, Aug. 2006.
[9] E. Todorov, R. Shadmer, and E. Bizzi, “Augmented Feedback Presented in a Virtual Environment Accelerates Learning of a Difficult Motor Task,” J. Motor Behavior, vol. 29, pp. 147-158, 1997.
[10] X. Wang, A. Kotranza, J. Quarles, B. Lok, and D. Allen, “A Pipeline for Rapidly Incorporating Real Objects into a Mixed Environment,” Proc. Fourth IEEE and ACM Int'l Symp. Mixed and Augmented Reality, pp. 170-173, 2005.
[11] S. Henderson and S. Feiner, “Evaluating the Benefits of Augmented Reality for Task Localization in Maintenance of an Armored Personnel Carrier Turret,” Proc. Eighth ACM/IEEE Int'l Symp. Mixed and Augmented Reality, pp. 135-144, Oct. 2009.
[12] D. Saslow et al., “Clinical Breast Examination: Practical Recommendations for Optimizing Performance and Reporting,” Cancer J. for Clinicians, vol. 54, pp. 327-344, 2004.
[13] M.B. Barton, R. Harris, and S.W. Fletcher, “Does This Patient Have Breast Cancer? The Screening Clinical Breast Examination: Should It Be Done? How?,” J. Am. Medical Assoc., vol. 282, no. 13, pp. 1270-1280, Oct. 1999.
[14] A. Tang, C. Owen, F. Biocca, and W. Mou, “Comparative Effectiveness of Augmented Reality in Object Assembly,” Proc. SIGCHI Conf. Human Factors in Computing Systems (CHI '03), pp. 73-80, Apr. 2003.
[15] S.J. Kim and A.K. Dey, “Simulated Augmented Reality Windshield Display as a Cognitive Mapping Aid for Elder Driver Navigation,” Proc. SIGCHI Conf. Human Factors in Computing Systems (CHI '09), pp. 133-142, Apr. 2009.
[16] J. Quarles, S. Lampotang, I. Fischler, P. Fishwick, and B. Lok, “A Mixed Reality System for Enabling Collocated after Action Review,” Proc. Seventh IEEE and ACM Int'l Symp. Mixed and Augmented Reality (ISMAR '08), pp. 107-116, Sept. 2008.
[17] M. Tonnis, C. Sandor, G. Klinker, C. Lange, and H. Bubb, “Experimental Evaluation of an Augmented Reality Visualization for Directing a Car Driver's Attention,” Proc. Fourth IEEE/ACM Int'l Symp. Mixed and Augmented Reality, pp. 56-59, Oct. 2005.
[18] M.K. Holden, “Virtual Environments for Motor Rehabilitation: Review,” Cyberpsychology and Behavior, vol. 8, no. 3, pp. 187-211, June 2005.
[19] L.A. Govatos, “Motor Skill Learning,” Rev. of Educational Research, vol. 37, no. 5, pp. 583-598, Dec. 1967.
[20] J. Westberg and H. Jason, Fostering Reflection and Providing Feedback: Helping Others Learn from Experience. Springer, 2001.
[21] A. Kotranza, K. Johnsen, J. Cendan, B. Miller, D.S. Lind, and B. Lok, “Virtual Multitools for Hand and Tool-Based Interaction with Life-Size Virtual Human Agents,” Proc. IEEE Symp. 3D User Interfaces, pp. 23-30, Mar. 2009.
[22] A. Rizzo and G.J. Kim, “A SWOT Analysis of the Field of Virtual-reality Rehabilitation and Therapy,” Presence: Teleoperators and Virtual Environments, vol. 14, no. 2, pp. 119-146, 2005.
[23] A. Kotranza, D.S. Lind, C.M. Pugh, and B. Lok, “Real-Time In-Situ Visual Feedback of Task Performance in Mixed Environments for Learning Joint Psychomotor-Cognitive Tasks,” Proc. Eighth IEEE/ACM Int'l Symp. Mixed and Augmented Reality, pp. 125-134, Oct. 2009.
[24] A.K. Madan et al., “Education of Medical Students in Clinical Breast Examination during Surgical Clerkship,” Am. J. Surgery, vol. 184, no. 6, pp. 637-640, 2002.
[25] C.M. Pugh and L.H. Salud, “Fear of Missing a Lesion: Use of Simulated Breast Models to Decrease Student Anxiety when Learning Clinical Breast Examinations,” Am. J. Surgery, vol. 193, no. 6, pp. 766-770, 2007.
[26] S. McDonald, D. Saslow, and M.H. Alciati, “Performance and Reporting of Clinical Breast Examination: A Review of the Literature,” CA Cancer J. for Clinicians, vol. 54, no. 6, pp. 345-361, 2004.
[27] P.E. Kann and D.S. Lane, “Breast Cancer Screening Knowledge and Skills of Students upon Entering and Exiting a Medical School,” Academic Medicine, vol. 73, no. 8, pp. 904-906, Aug. 1998.
[28] D.A. Sloan, M.B. Donnelly, R.W. Schwartz, L.C. Munch, M.D. Wells, S.B. Johnson, and W.E. Strodel, “Assessing Medical Students' and Surgery Residents' Clinical Competence in Problem Solving in Surgical Oncology,” Annals of Surgical Oncology, vol. 1, no. 3, pp. 204-212, May 1994.
[29] J. Chalabian and G. Dunnington, “Do Our Current Assessments Assure Competency in Clinical Breast Evaluation Skills?,” Am. J. Surgery, vol. 175, pp. 497-502, 1998.
[30] R. Balkissoon, K. Blossfield, L. Salud, D. Ford, and C. Pugh, “Lost in Translation: Unfolding Medical Students' Misconceptions of How to Perform a Clinical Digital Rectal Examination,” Am. J. Surgery, vol. 197, no. 4, pp. 525-532, Apr. 2009.
[31] H.L. Lujan and S.E. DiCarlo, “First-Year Medical Students Prefer Multiple Learning Styles,” Advances in Physiology Education, vol. 30, pp. 13-16, 2006.
[32] S.W. Fletcher, M.S. O'Malley, J.L. Earp, T.M. Morgan, S. Lin, and D. Degnan, “How Best to Teach Women Breast Self-Examination,” Annals of Internal Medicine, vol. 112, no. 10, pp. 772-779, May 1990.
[33] L.A. Breslow, T.J. Gregory, and R.M. Ratwani, “A Perceptual Process Approach to Selecting Color Scales for Complex Visualizations,” J. Experimental Psychology: Applied, vol. 15, no. 1, pp. 25-34, Mar. 2009.
[34] D.H Merwin and C.D. Wickens, “Comparison of Eight Color and Gray Scales for Displaying Continuous Data,” Proc. Human Factors and Ergonomics Soc. Ann. Meeting, vol. 2, pp. 1330-1334, 1993.
[35] S.V. Barrett, J.G. Zapka, K.M. Mazor, and R.S. Luckmann, “Assessing Third-Year Medical Students' Breast Cancer Screening Skills,” Academic Medicine, vol. 77, no. 9, pp. 905-910, Sept. 2002.

Index Terms:
virtual reality,biomedical education,computer based training,data visualisation,medical computing,patient diagnosis,real-world cognitive-psychomotor tasks,real-time evaluation,learner performance visualization,mixed-reality environment,clinical breast examination,real-time user performance feedback,real-world tasks training,tightly coupled cognitive components,psychomotor components,visual feedback,MRE,human patients,Breast,Sensors,Real time systems,Visualization,Training,Data models,Humans,life and medical sciences.,Mixed and augmented reality,information visualization
D. S. Lind, A. Kotranza, B. Lok, "Real-Time Evaluation and Visualization of Learner Performance in a Mixed-Reality Environment for Clinical Breast Examination," IEEE Transactions on Visualization and Computer Graphics, vol. 18, no. 7, pp. 1101-1114, July 2012, doi:10.1109/TVCG.2011.132
Usage of this product signifies your acceptance of the Terms of Use.