The Community for Technology Leaders
RSS Icon
Issue No.01 - Jan.-March (2012 vol.5)
pp: 77-84
Seokhee Jeon , Pohang University of Science and Technology (POSTECH), Pohang
Seungmoon Choi , Pohang University of Science and Technology (POSTECH), Pohang
Matthias Harders , ETH Zürich, Zürich
Haptic augmented reality (AR) is an emerging research area, which targets the modulation of haptic properties of real objects by means of virtual feedback. In our research, we explore the feasibility of using this technology for medical training systems. As a possible demonstration example, we currently examine the use of augmentation in the context of breast tumor palpation. The key idea in our prototype system is to augment the real feedback of a silicone breast mock-up with simulated forces stemming from virtual tumors. In this paper, we introduce and evaluate the underlying algorithm to provide these force augmentations. This includes a method for the identification of the contact dynamics model via measurements on real sample objects. The performance of our augmentation is examined quantitatively as well as in a user study. Initial results show that the haptic feedback of indenting a real silicone tumor with a rod can be approximated reasonably well with our algorithm. The advantage of such an augmentation approach over physical training models is the ability to create a nearly infinite variety of palpable findings.
Haptic rendering, augmented reality, mixed reality, medical simulation, palpation, tumor.
Seokhee Jeon, Seungmoon Choi, Matthias Harders, "Rendering Virtual Tumors in Real Tissue Mock-Ups Using Haptic Augmented Reality", IEEE Transactions on Haptics, vol.5, no. 1, pp. 77-84, Jan.-March 2012, doi:10.1109/TOH.2011.40
[1] S. Jeon and S. Choi, "Haptic Augmented Reality: Taxonomy and an Example of Stiffness Modulation," Presence: Teleoperators and Virtual Environments, vol. 18, no. 5, pp. 387-408, 2009.
[2] S. Jeon and S. Choi, "Stiffness Modulation for Haptic Augmented Reality: Extension to 3D Interaction," Proc. IEEE Haptics Symp., pp. 273-280, 2010.
[3] C. Basdogan, M. Sedef, M. Harders, and S. Wesarg, "VR-Based Simulators for Training in Minimally Invasive Surgery," IEEE Computer Graphics and Applications, vol. 27, no. 2, pp. 54-66, Mar./Apr. 2007.
[4] E.P.W. van der Putten, R.H.M. Goossens, J.J. Jakimowicz, and J. Dankelman, "Haptics in Minimally Invasive Surgery—A Review," Minimally Invasive Therapy and Allied Technologies, vol. 17, no. 1, pp. 3-16, 2008.
[5] T. Coles, D. Meglan, and N. John, "The Role of Haptics in Medical Training Simulators: A Survey of the State-of-the-Art," IEEE Trans. Haptics, vol. 4, no. 1, pp. 51-66, Jan.-Mar. 2011.
[6] N. Langrana, G. Burdea, K. Lange, D. Gomez, and S. Deshpande, "Dynamic Force Feedback in a Virtual Knee Palpation," Artificial Intelligence in Medicine, vol. 6, no. 4, pp. 321-333, 1994.
[7] M. Dinsmore, N. Langrana, G. Burdea, and J. Ladeji, "Virtual Reality Training Simulation for Palpation of Subsurface Tumors," Proc. IEEE Ann. Int'l Symp. Virtual Reality, pp. 54-60, 1997.
[8] G. Burdea, G. Patounakis, V. Popescu, and R.E. Weiss, "Virtual Reality-Based Training for the Diagnosis of Prostate Cancer," IEEE Trans. Biomedical Eng., vol. 46, no. 10, pp. 1253-1260, Oct. 1999.
[9] J. Stalfors, T. Kling-Petersen, M. Rydmark, and T. Westin, "Haptic Palpation of Head and Neck Cancer Patients-Implication for Education and Telemedicine," Studies in Health Technology and Informatics, vol. 81, pp. 471-474, 2001.
[10] M. Alhalabi, V. Daniulaitis, H. Kawasaki, and T. Hori, "Medical Training Simulation for Palpation of Subsurface Tumor Using HIRO," Proc. First Joint Eurohaptics Conf. and Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 623-624, 2005.
[11] H. Chen, W. Wu, H. Sun, and P.-A. Heng, "Dynamic Touch-Enabled Virtual Palpation," Computer Animation and Virtual Worlds, vol. 18, pp. 339-348, 2007.
[12] S.-Y. Kim, K.-U. Kyung, J. Park, and D.-S. Kwon, "Real-Time Area-Based Haptic Rendering and the Augmented Tactile Display Device for a Palpation Simulator," Advanced Robotics, vol. 21, no. 9, pp. 961-981, 2007.
[13] S.M.B.I. Botden and J.J. Jakimowicz, "What is Going on in Augmented Reality Simulation in Laparoscopic Surgery?" Surgical Endoscopy, vol. 23, no. 8, pp. 1693-1700, 2008.
[14] M. Harders, G. Bianchi, B. Knoerlein, and G. Székely, "Calibration, Registration, and Synchronization for High Precision Augmented Reality Haptics," IEEE Trans. Visualization and Computer Graphics, vol. 15, no. 1, pp. 138-149, Jan./Feb. 2009.
[15] S.M.B.I. Botden, S.N. Buzink, M.P. Schijven, and J.J. Jakimowicz, "ProMIS Augmented Reality Training of Laparoscopic Procedures Face Validity," Simulation in Healthcare: J. Soc. for Simulation in Healthcare, vol. 3, no. 2, pp. 97-102, 2008.
[16] S.M.B.I. Botden, S.N. Buzink, M.P. Schijven, and J.J. Jakimowicz, "Augmented versus Virtual Reality Laparoscopic Simulation: What Is the Difference?" World J. Surgery, vol. 31, pp. 764-772, 2007.
[17] R. Lapeer, M. Chen, and J. Villagrana, "An Augmented Reality Based Simulation of Obstetric Forceps Delivery," Proc. IEEE ACM Third Int'l Symp. Mixed and Augmented Reality, pp. 274-275, 2004.
[18] T. Sielhorst, T. Obst, R. Burgkart, R. Riener, and N. Navab, "An Augmented Reality Delivery Simulator for Medical Training," Proc. Int'l Workshop Augmented Environments for Medical Imaging, pp. 11-20, 2004.
[19] R. Parkes, N.N. Forrest, and S. Baillie, "A Mixed Reality Simulator for Feline Abdominal Palpation Training in Veterinary Medicine," Studies in Health Technology and Informatics, vol. 142, pp. 244-246, 2009.
[20] G.J. Gerling and G.W. Thomas, "Augmented, Pulsating Tactile Feedback Facilitates Simulator Training of Clinical Breast Examinations," Human Factors, vol. 47, no. 3, pp. 670-681, 2005.
[21] K. Hunt and F. Crossley, "Coefficient of Restitution Interpreted as Damping in Vibroimpact," ASME J. Applied Mechanics, vol. 42, pp. 440-445, 1975.
[22] T. Yamamoto, B. Vagvolgyi, K. Balaji, L.L. Whitcomb, and A.M. Okamura, "Tissue Property Estimation and Graphical Display for Teleoperated Robot-Assisted Surgery," Proc. IEEE Int'l Conf. Robotics and Automation, pp. 3117-3123, 2009.
[23] F. Janabi-Sharifi, V. Hayward, and C.S.J. Chen, "Discrete-Time Adaptive Windowing for Velocity Estimation," IEEE Trans. Control Systems Technology, vol. 8, no. 6, pp. 1003-1009, Nov. 2000.
[24] A. Haddadi and K. Hashtrudi-Zaad, "A New Method for Online Parameter Estimation of Hunt-Crossley Environment Dynamic Models," Proc. IEEE/RSJ Int'l Conf. Intelligent Robots and Systems, pp. 981-986, 2008.
[25] C.G. Christou and A.M. Wing, "Friction and Curvature Judgment," Proc. EuroHaptics, pp. 36-40, 2001.
[26] P. Kammermeier, A. Kron, J. Hoogen, and G. Schmidt, "Display of Holistic Haptic Sensations by Combined Tactile and Kinesthetic Feedback," Presence: Teleoperators and Virtual Environments, vol. 13, no. 1, pp. 1-15, 2004.
[27] R.M. Friedman, K.D. Hester, B.G. Green, and R.H. LaMotte, "Magnitude Estimation of Softness," Experimental Brain Research, vol. 191, no. 2, pp. 133-142, 2008.
67 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool