Issue No.04 - April (2013 vol.19)
pp: 626-633
Jonas Spillmann , Comput. Vision Lab., ETH Zurich, Zurich, Switzerland
M. Harders , Comput. Vision Lab., ETH Zurich, Zurich, Switzerland
Passive haptics, also known as tactile augmentation, denotes the use of a physical counterpart to a virtual environment to provide tactile feedback. Employing passive haptics can result in more realistic touch sensations than those from active force feedback, especially for rigid contacts. However, changes in the virtual environment would necessitate modifications of the physical counterparts. In recent work space warping has been proposed as one solution to overcome this limitation. In this technique virtual space is distorted such that a variety of virtual models can be mapped onto one single physical object. In this paper, we propose as an extension adaptive space warping; we show how this technique can be employed in a mixed-reality surgical training simulator in order to map different virtual patients onto one physical anatomical model. We developed methods to warp different organ geometries onto one physical mock-up, to handle different mechanical behaviors of the virtual patients, and to allow interactive modifications of the virtual structures, while the physical counterparts remain unchanged. Various practical examples underline the wide applicability of our approach. To the best of our knowledge this is the first practical usage of such a technique in the specific context of interactive medical training.
Haptic interfaces, Avatars, Bones, Geometry, Joints, Surgery, Shape,surgical training simulation., Virtual reality, passive haptics
Jonas Spillmann, S. Tuchschmid, M. Harders, "Adaptive Space Warping to Enhance Passive Haptics in an Arthroscopy Surgical Simulator", IEEE Transactions on Visualization & Computer Graphics, vol.19, no. 4, pp. 626-633, April 2013, doi:10.1109/TVCG.2013.23
[1] M. Agus, A. Giachetti, E. Gobbetti, G. Zanetti, A. Zorcolo, B. Picasso,, and S. Franceschini., A haptic model of a bone-cutting burr. Studies in Health Technology and Informatics, pages 4-10, 2003.
[2] Y. Ban, T. Kajinami, T. Narumi, T. Tanikawa,, and M. Hirose., Modifying an identified curved surface shape using pseudo-haptic effect. In Proc. IEEE Haptics Symposium, pages 211-216, 2012.
[3] F. Barbagli, K. Salisbury, C. Ho, C. Spence,, and H. Tan., Haptic discrimination of force direction and the influence of visual information. ACM Transactions on Applied Perception (TAP), 3(2): 125-135, 2006.
[4] A. Bolopion, B. Cagneau, D. Haliyo,, and S. Régnier., Analysis of stability and transparency for nanoscale force feedback in bilateral coupling. Journal of Micro-Nano Mechatronics, 4(4): 145-158, 2008.
[5] M. Boshra and H. Zhang., Use of tactile sensors in enhancing the efficiency of vision-based object localization. In Multisensor Fusion and Integration for Intelligent Systems, pages 243-250. IEEE, 1994.
[6] E. Burns, S. Razzaque, A. Panter, M. Whitton, M. McCallus,, and F. Brooks Jr., The hand is slower than the eye: A quantitative exploration of visual dominance over proprioception. In Proc. IEEE Virtual Reality, pages 3-10, 2005.
[7] T. Coles, D. Meglan,, and N. John., The role of haptics in medical training simulators: A survey of the state-of-the-art. IEEE Transactions on Haptics, (99): 1-1, 2011.
[8] L. Dominjon, A. Lecuyer, J. Burkhardt, G. Andrade-Barroso,, and S. Richir., The bubble technique: Interacting with large virtual environments using haptic devices with limited workspace. In World Haptics, pages 639-640, 2005.
[9] W. Durfee, C. Hendrix, P. Cheng,, and G. Varughese., Influence of haptic and visual displays on the estimation of virtual environment stiffness. In Proc. ASME Dyn Syst Control Div, page 139144, 1997.
[10] M. Ernst and M. Banks., Humans integrate visual and haptic information in a statistically optimal fashion. Nature, 415(6870): 429-433, 2002.
[11] J. Gibson and M. Radner., Adaptation, Adaptation, after-effect and contrast in the perception of tilted lines. i. quantitative studies. Journal of Experimental Psychology, 20(5):453, 1937.
[12] H. Helbig and M. Ernst., Optimal integration of shape information from vision and touch. Experimental Brain Research, 179(4): 595-606, 2007.
[13] H. Hoffman., Physically touching virtual objects using tactile augmentation enhances the realism of virtual environments. In Proc. Virtual Reality Annual International Symposium, pages 59-63, 1998.
[14] H. Hoffman, J. Groen, S. Rousseau, A. Hollander, W. Winn, M. Wells,, and T. Furness., Tactile augmentation: Enhancing presence in virtual reality with tactile feedback from real objects. American Psychological Society, 1996.
[15] B. Insko., Passive haptics significantly enhances virtual environments. PhD thesis, University of North Carolina, 2001.
[16] J. Keijser, S. Carpendale, M. Hancock,, and T. Isenberg., Exploring 3d interaction in alternate control-display space mappings. In IEEE Symposium on 3D User Interfaces, 2007.
[17] L. Kohli., Exploiting perceptual illusions to enhance passive haptics. In Proc. of IEEE VR Workshop on Perceptual Illusions in Virtual Environments, pages 22-24, 2009.
[18] L. Kohli., Redirected touching: Warping space to remap passive haptics. In IEEE Symposium on 3D User Interfaces, pages 129-130. IEEE, 2010.
[19] L. Kohli, E. Burns, D. Miller,, and H. Fuchs., Combining passive haptics with redirected walking. In Proc. Augmented tele-existence, pages 253-254. ACM, 2005.
[20] L. Kohli, M. Whitton,, and F. Brooks., Redirected touching: The effect of warping space on task performance. In IEEE Symposium on 3D User Interfaces, pages 105-112. IEEE, 2012.
[21] E. Kwon, G. Kim,, and S. Lee., Effects of sizes and shapes of props in tangible augmented reality. In IEEE International Symposium on Mixed and Augmented Reality, pages 201-202, 2009.
[22] R. Lapeer, M. Chen,, and J. Villagrana., An augmented reality based simulation of obstetric forceps delivery. In IEEE and ACM Intl. Symposium on Mixed and Augmented Reality, pages 274-275, 2004.
[23] A. Lécuyer,J. Burkhardt,, and L. Etienne., Feeling bumps and holes without a haptic interface: the perception of pseudo-haptic textures. In Proc. SIGCHI conference on Human factors in computing systems, pages 239-246, 2004.
[24] A. Lecuyer, S. Cuquillart,, and P. Coiffet., Simulating haptic information with haptic illusions in virtual environments. Technical report, DTIC Document, 2001.
[25] Y. Matsuoka, S. Allin,, and R. Klatzky., The tolerance for visual feedback distortions in a virtual environment. Physiology & behavior, 77(4): 651-655, 2002.
[26] A. McCarthy, L. Moody, A. Waterworth,, and D. Bickerstaff., Passive haptics in a knee arthroscopy simulator: is it valid for core skills training? Clinical orthopaedics and related research, 442:13, 2006.
[27] M. Meehan, B. Insko, M. Whitton,, and F. Brooks Jr., Physiological measures of presence in stressful virtual environments. In ACM Transactions on Graphics, volume 21, pages 645-652, 2002.
[28] P. Milgram and F. Kishino., A taxonomy of mixed reality visual displays. IEICE Trans. on Information and Systems, (12):1321, 1994.
[29] L. Moody, A. Waterworth, J. Arthur, A. McCarthy, P. Harley,, and R. Smallwood., Beyond the visuals: tactile augmentation and sensory enhancement in an arthroscopy simulator. Virtual Reality, 13(1): 59-68, 2009.
[30] L. Moody, A. Waterworth, A. McCarthy, P. Harley,, and R. Smallwood., The feasibility of a mixed reality surgical training environment. Virtual Reality, 12(2): 77-86, 2008.
[31] B. Petzold, M. Zaeh, B. Faerber, B. Deml, H. Egermeier, J. Schilp,, and S. Clarke., A study on visual, auditory, and haptic feedback for assembly tasks. Presence: Teleoperators & Virtual Environments, 13(1): 16-21, 2004.
[32] N. Phoolchund, Y. Tenzer, B. Davies,, and F. Rodriguez y Baena., Extracting material stiffness from the vibration signal of an arthroscopic hooked probe. In Annual Conference of The International Society for Computer Assisted Orthopaedic Surgery, 2011. accepted.
[33] S. Razzaque, Z. Kohn,, and M. Whitton., Redirected walking. In Proc. EUROGRAPHICS, pages 289-294, 2001.
[34] G. Robles-De-La-Torre and V. Hayward., Force can overcome object geometry in the perception of shape through active touch. Nature, 412(6845): 445-448, 2001.
[35] I. Rock and J. Victor., Vision and touch: An experimentally created conflict between the two senses. Science, 143(3606): 594-596, 1964.
[36] L. Schultz and J. Petersik., Visual-haptic relations in a two-dimensional size-matching task. Perceptual and motor skills, 78(2): 395-402, 1994.
[37] M. Seiler, D. Steinemann, J. Spillmann,, and M. Harders., Robust interactive cutting based on an adaptive octree simulation mesh. The Visual Computer, pages 1-11, 2011.
[38] T. Sielhorst, T. Obst, R. Burgkart, R. Riener,, and N. Navab., An augmented reality delivery simulator for medical training. In International Workshop on Augmented Environments for Medical Imaging-MICCAI Satellite Workshop, volume 141, 2004.
[39] M. Srinivasan, G. Beauregard,, and D. Brock., The impact of visual information on the haptic perception of stiffness in virtual environments. In ASME Winter Annual Meeting, volume 58, pages 555-559, 1996.
[40] D. Steinemann, M. Harders, M. Gross,, and G. Szekely., Hybrid cutting of deformable solids. In Proc. IEEE Virtual Reality, pages 35-42, 2006.
[41] F. Steinicke, G. Bruder, T. Ropinski,, and K. Hinrichs., Moving towards generally applicable redirected walking. In Proc. Virtual Reality International Conference, pages 15-24, 2008.
[42] Y. Tenzer,D. B.L.,, and F. Rodriguez y Baena., Investigation into the effectiveness of vibrotactile feedback to improve the haptic realism of an arthroscopy training simulator. In Studies in health technology and informatics, volume 132, pages 517-522, 2008.
[43] Y. Wang and C. MacKenzie., The role of contextual haptic and visual constraints on object manipulation in virtual environments. In Proc. SIGCHI conference on Human factors in computing systems, pages 532-539, 2000.
[44] R. Webster, D. Zimmerman, B. Mohler, M. Melkonian,, and R. Haluck., A prototype haptic suturing simulator. Studies in health technology and informatics, pages 567-569, 2001.