The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.03 - July-September (2011 vol.4)
pp: 199-209
Timothy R. Coles , Bangor University, Bangor and Istituto Italiano di Technologia, Genova
Nigel W. John , Bangor University, Bangor
Derek A. Gould , Royal Liverpool University Hospital, Liverpool
Darwin G. Caldwell , Italiano di Technologia, Genova
ABSTRACT
This paper presents a virtual environment for training femoral palpation and needle insertion, the opening steps of many interventional radiology procedures. A novel augmented reality simulation called PalpSim has been developed that allows the trainees to feel a virtual patient using their own hands. The palpation step requires both force and tactile feedback. For the palpation haptics effect, two off-the-shelf force feedback devices have been linked together to provide a hybrid device that gives five degrees of force feedback. This is combined with a custom built hydraulic interface to provide a pulse like tactile effect. The needle interface is based on a modified PHANTOM Omni end effector that allows a real interventional radiology needle to be mounted and used during simulation. While using the virtual environment, the haptics hardware is masked from view using chroma-key techniques. The trainee sees a computer generated patient and needle, and interacts using their own hands. This simulation provides a high level of face validity and is one of the first medical simulation devices to integrate haptics with augmented reality.
INDEX TERMS
Haptics, force feedback, tactile display, medical simulation, graphic rendering, virtual reality, augmented reality.
CITATION
Timothy R. Coles, Nigel W. John, Derek A. Gould, Darwin G. Caldwell, "Integrating Haptics with Augmented Reality in a Femoral Palpation and Needle Insertion Training Simulation", IEEE Transactions on Haptics, vol.4, no. 3, pp. 199-209, July-September 2011, doi:10.1109/TOH.2011.32
REFERENCES
[1] I.A. Scott, "Errors in Clinical Reasoning: Causes and Remedial Strategies," BMJ, vol. 338, p. b1860, 2009.
[2] D.A. Gould and J.A. Reekers, "The Role of Simulation in Training Endovascular Interventions," European J. Vascular and Endovascular Surgery, vol. 35, no. 6, pp. 633-636, June 2008.
[3] S.I. Seldinger, "Catheter Replacement of the Needle in Percutaneous Arteriography: A New Technique," Acta Radiologica, vol. 39, no. 5, pp. 368-376, May 1953.
[4] V. Luboz, C. Hughes, D. Gould, N. John, and F. Bello, "Real-Time Seldinger Technique Simulation in Complex Vascular Models," Int'l J. Computer Assisted Radiology and Surgery, vol. 4, no. 6, pp. 589-596, 2009.
[5] N.A. Langrana, G. Burdea, K. Lange, D. Gomez, and S. Deshpande, "Dynamic Force Feedback in a Virtual Knee Palpation," Artificial Intelligence in Medicine, vol. 6, no. 4, pp. 321-333, Aug. 1994.
[6] M.O. Gastal, M. Henry, A.R. Beker, E.L. Gastal, N. Langrana, G. Burdea, J. Ladeji, and M. Dinsmore, "Human Performance Using Virtual Reality Tumor Palpation Simulation," Computers and Graphics, vol. 21, pp. 451-458, 1997.
[7] M.O. Alhalabi, V. Daniulaitis, H. Kawasaki, and T. Hori, "Medical Training Simulation for Palpation of Subsurface Tumor Using Hiro," Proc. First Joint Eurohaptics Conf. and Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 623-624, 2005.
[8] E. Takahiro, "Five-Fingered Haptic Interface Robot: HIRO III," Proc. World Haptics Conf., pp. 458-463, 2009.
[9] J. Stalfors, T. Kling-Petersen, M. Rydmark, and T. Westin, "Haptic Palpation of Head and Neck Cancer Patients-Implication for Education and Telemedicine," Studies in Health Technology and Informatics, vol. 81, pp. 471-474, 2001.
[10] S. Ullrich, J. Mendoza, A. Ntouba, R. Rossaint, and T. Kuhlen, "Haptic Pulse Simulation for Virtual Palpation," Proc. Bildverarbeitung für die Medizin, pp. 187-191, 2008.
[11] G. Burdea, G. Patounakis, V. Popescu, and R.E. Weiss, "Virtual Reality-Based Training for the Diagnosis of Prostate Cancer," IEEE Trans. Biomedical Eng., vol. 46, no. 10, pp. 1253-1260, Oct. 1999.
[12] I. Robert, L. Williams, M. Srivastava, J.N. Howell, J. Robert, R. Conatser, D.C. Eland, J.M. Burns, and A.G. Chila, "The Virtual Haptic Back for Palpatory Training," Proc. Sixth Int'l Conf. Multimodal Interfaces (ICMI '04), 2004.
[13] R. Balaniuk, F. Burbagli, and J.K. Sailsbury, "Video: Multi-Point Haptic Interaction for Breast Palpation Exam," http://robotics.stanford.edu/~barbagli/videos mp_03.wmv, 2003.
[14] A. Kotranza and B. Lok, "Virtual Human $+$ Tangible Interface ${=}$ Mixed Reality Human an Initial Exploration with a Virtual Breast Exam Patient," Proc. IEEE Virtual Reality Conf. (VR '08), pp. 99-106, 2008.
[15] S. Baillie, A. Crossan, S. Brewster, D. Mellor, and S. Reid, "Validation of a Bovine Rectal Palpation Simulator for Training Veterinary Students," Studies in Health Technology and Informatics, vol. 111, pp. 33-36, 2005.
[16] A. Crossan, S. Brewster, S. Reid, and D. Mellor, "A Horse Ovary Palpation Simulator for Veterinary Training," Haptic Human-Computer Interaction, Lectures Notes in Computer Science, S. Brewster and R. Murray-Smith, eds., vol. 2058, pp. 157-164, Springer Berlin/Heidelberg, 2001.
[17] R. Parkes, N. Neil Forrest, and S. Baillie, "A Mixed Reality Simulator for Feline Abdominal Palpation Training in Veterinary Medicine," Studies in Health Technology and Informatics, vol. 142, pp. 244-246, 2009.
[18] R.L. Cunningham, P.G. Feldman, B. Feldman, and G.L. Merril, "Interface Device and Method for Interfacing Instruments to Vascular Access Simulation Systems" US Patent 6470302 B1, 1999.
[19] Z. Mayooran, L. Watterson, P. Withers, J. Line, W. Arnett, and R. Horley, "Mediseus Epidural: Full-Procedure Training Simulator for Epidural Analgesia in Labour," Proc. SimTecT Healthcare Simulation Conf., 2006.
[20] J.B. Ra, S.M. Kwon, J.K. Kim, J. Yi, K.H. Kim, H.W. Park, K.U. Kyung, D.S. Kwon, H.S. Kang, S.T. Kwon, L. Jiang, J. Zeng, K. Geary, and S.K. Mun, "Spine Needle Biopsy Simulator Using Visual and Force Feedback," Computer Aided Surgery, vol. 7, no. 6, pp. 353-363, 2002.
[21] P.A. Heng, T.T. Wong, R. Yang, Y.P. Chui, Y.M. Xie, K.S. Leung, and P.C. Leung, "Intelligent Inferencing and Haptic Simulation for Chinese Acupuncture Learning and Training," IEEE Trans. Information Technology in Biomedicine, vol. 10, no. 1, pp. 28-41, Jan. 2006.
[22] C.K. Chui, J.S.K. Ong, Z.Y. Lian, Z. Wang, J. Teo, J. Zhang, C.H. Yan, S.H. Ong, S.C. Wang, H.K. Wong, C.L. Teo, and S.H. Teoh, "Haptics in Computer-Mediated Simulation: Training in Vertebroplasty Surgery," Simulation Gaming, vol. 37, no. 4, pp. 438-451, Dec. 2006.
[23] C. Forest, O. Comas, C. Vaysiere, L. Soler, and J. Marescaux, "Ultrasound and Needle Insertion Simulators Built on Real Patient-Based Data," Studies in Health Technology and Informatics, vol. 125, pp. 136-139, 2007.
[24] F.P. Vidal, N.W. John, A.E. Healey, and D.A. Gould, "Simulation of Ultrasound Guided Needle Puncture Using Patient Specific Data with 3D Textures and Volume Haptics," Computer Animation and Virtual Worlds, vol. 19, no. 2, pp. 111-127, 2008.
[25] M. Färber, J. Heller, F. Hummel, C. Gerloff, and H. Handels, "Virtual Reality Based Training of Lumbar Punctures Using a 6DoF Haptic Device," Proc. Advances in Medical Eng., pp. 236-240, 2007.
[26] C. Sandor, S. Uchiyama, and H. Yamamoto, "Visuo-Haptic Systems: Half-Mirrors Considered Harmful," Proc. Second Joint EuroHaptics Conf., and Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics, pp. 292-297, 2007.
[27] J. Zhai, R. Zvavanjanja, A. Fisher, D. Gould, and T. How, "Pulse Force Measurement during Interventional Radiological Procedures," Poster Presentation in BSIR, 2010.
[28] T.R. Coles, G. Sofia, N.W. John, D.A. Gould, and D.G. Caldwell, "Modification of Commercial Force Feedback Hardware for Needle Insertion Simulation," Studies in Health Technology and Informatics, vol. 163, pp. 135-137, 2011.
[29] A. Formaglio, M. Fei, S. Mulatto, M. De Pascale, and D. Prattichizzo, "Autocalibrated Gravity Compensation for 3DoF Impedance Haptic Devices," Proc. Sixth Int'l Conf. Haptics: Perception, Devices and Scenarios (EuroHaptics' 08), pp. 43-52, 2008.
[30] S. Johnson, H. Woolnough, C. Hunt, D. Gould, A. England, M. Crawshaw, and W. Lewandowski, "Simulator Training in Interventional Radiology: The Role of Task Analysis," Proc. APA Ann. Conf., 2008.
26 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool