The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.03 - July-September (2011 vol.4)
pp: 175-187
Igor Peterlík , INRIA Nord Europe, Lille
Mourad Nouicer , INI Algiers, Algeria
Christian Duriez , INRIA Nord Europe, Lille
Stéphane Cotin , INRIA Nord Europe, Lille
Abderrahmane Kheddar , CNRS-UM2 LIRMM, Montpellier and CNRS-AIST Joint Robotics Laboratory (JRL), Tsukuba
ABSTRACT
The paper is dedicated to haptic rendering of complex physics-based environment in the context of surgical simulation. A new unified formalism for modeling the mechanical interactions between medical devices and anatomical structures and for computing accurately the haptic force feedback is presented. The approach deals with the mechanical interactions using appropriate force and/or motion transmission models named compliant mechanisms. These mechanisms are formulated as a constraint-based problem that is solved in two separate threads running at different frequencies. The first thread processes the whole simulation including the soft-tissue deformations, whereas the second one only deals with computer haptics. This method builds a bridge between the so-called virtual mechanisms (that were proposed for haptic rendering of rigid bodies) and intermediate representations (used for rendering of complex simulations). With this approach, it is possible to describe the specific behavior of various medical devices while relying on a unified method for solving the mechanical interactions between deformable objects and haptic rendering. The technique is demonstrated in interactive simulation of flexible needle insertion through soft anatomical structures with force feedback.
INDEX TERMS
Haptic rendering, deformable, heterogeneous constraints, contact modeling, physically-based simulation, needle simulation, laparoscopic simulation, compliance, multithread, multirate, virtual mechanisms, intermediate representation.
CITATION
Igor Peterlík, Mourad Nouicer, Christian Duriez, Stéphane Cotin, Abderrahmane Kheddar, "Constraint-Based Haptic Rendering of Multirate Compliant Mechanisms", IEEE Transactions on Haptics, vol.4, no. 3, pp. 175-187, July-September 2011, doi:10.1109/TOH.2011.41
REFERENCES
[1] A.G. Gallagher, A.B. Lederman, K. McGlade, R.M. Satava, and C.D. Smith, "Discriminative Validity of the Minimally Invasive Surgical Trainer in Virtual Reality (MIST-VR) Using Criteria Levels Based on Expert Performance," Surgical Endoscopy, vol. 18, pp. 660-665, 2004.
[2] T.S. Desser, "Simulation-Based Training: The Next Revolution in Radiology Education?" J. Am. College of Radiology, vol. 4, no. 11, pp. 816-824, 2007.
[3] H. Courtecuisse, H. Jung, J. Allard, C. Duriez, D.Y. Lee, and S. Cotin, "GPU-Based Real-Time Soft Tissue Deformation with Cutting and Haptic Feedback," "Progress in Biophysics and Molecular Biology, special issue on soft tissue modelling, to appear.
[4] Z. Taylor, O. Comas, M. Cheng, J. Passenger, D. Hawkes, D. Atkinson, and S. Ourselin, "Modelling Anisotropic Viscoelasticity for Real-Time Soft Tissue Simulation," Proc. Medical Image Computing and Computer-Assisted Intervention (MICCAI '08X), pp. 703-710, 2008.
[5] S. Marchesseau, T. Heimann, S. Chatelin, R. Willinger, and H. Delingette, "Multiplicative Jacobian Energy Decomposition Method for Fast Porous Visco-Hyperelastic Soft Tissue Model," Proc. Medical Image Computing and Computer Assisted Intervention (MICCAI '10), Sept. 2010.
[6] J. Colgate, M. Stanley, and J. Brown, "Issues in the Haptic Display of Tool Use," Proc. IEEE/RSJ Int'l Conf. Intelligent Robots and Systems, vol. 3, p. 3140, 1995.
[7] C.B. Zilles and J.K. Salisbury, "A Constraint-Based God-Object Method for Haptic Display," IROS '95: Proc. Int'l Conf. Intelligent Robots and Systems, vol. 3, p. 3146, 1995.
[8] D.C. Ruspini, K. Kolarov, and O. Khatib, "The Haptic Display of Complex Graphical Environments," SIGGRAPH '97: Proc. 24th Ann. Conf. Computer Graphics and Interactive Techniques, pp. 345-352, 1997.
[9] R.J. Adams, M.R. Moreyra, and B. Hannaford, "Stability and Performance of Haptic Displays: Theory and Experiments," Proc. ASME Int'l Mechanical Eng. Congress and Exhibition, pp. 227-234, 1998.
[10] R.J. Adams, B. Hannaford, M. Ieee, and M. Ieee, "Control Law Design for Haptic Interfaces to Virtual Reality," IEEE Trans. Control Systems Technology, vol. 10, pp. 3-13, 2002.
[11] M. Ortega, S. Redon, and S. Coquillart, "A Six Degree-of-Freedom God-Object Method for Haptic Display of Rigid Bodies with Surface Properties," IEEE Trans. Visualization and Computer Graphics, vol. 13, no. 3, pp. 458-469, 2007.
[12] A. Nahvi, D.D. Nelson, J.M. Hollerbach, and D.E. Johnson, "Haptic Manipulation of Virtual Mechanisms from Mechanical CAD Designs," Proc. IEEE Conf. Robotics and Automation, pp. 375-380, 1998.
[13] D. Constantinescu, S.E. Salcudean, and E.A. Croft, "Haptic Manipulation of Serial-Chain Virtual Mechanisms," J. Dynamic Systems, Measurement, and Control, vol. 128, no. 1, pp. 65-74, 2006.
[14] L.D. Joly and C. Andriot, "Imposing Motion Constraints to a Force Reflecting Telerobot through Real-Time Simulation of a Virtual Mechanism," Proc. IEEE Int'l Conf. Robotics and Automation, vol. 1, pp. 357-362, 1995.
[15] K. Kosuge, T. Itoh, T. Fukuda, and M. Otsuka, "Tele-Manipulation System Based on Task-Oriented Virtual Tool," Proc. IEEE Conf. Int'l Robotics and Automation, vol. 1, pp. 351-356, 1995.
[16] M. Beenakkers, D. Constantinescu, and M. Steinbuch, "Haptic Manipulation of Virtual Linkages with Kinematic Loops," Proc. IEEE/ASME Int'l Conf. Advanced Intelligent Mechatronics, pp. 1-6, 2007.
[17] X. Merlhiot, "Une Contribution Algorithmique aux outils de Simulation Mcanique Interactive Pour la Maquette Numrique Industrielle," PhD dissertation, Université Pierre et Marie Curie, written in English, 2009.
[18] M. Bro-Nielsen and S. Cotin, "Real-Time Volumetric Deformable Models for Surgery Simulation Using Finite Elements and Condensation," Computer Graphics Forum, vol. 15, no. 3, pp. 57-66, 1996.
[19] S. Cotin, H. Delingette, and N. Ayache, "Real-Time Elastic Deformations of Soft Tissues for Surgery Simulation," IEEE Trans. Visualization and Computer Graphics, vol. 5, no. 1, pp. 62-73, Jan.-Mar. 1999.
[20] D.C. Popescu and M. Compton, "A Model for Efficient and Accurate Interaction with Elastic Objects in Haptic Virtual Environments," GRAPHITE '03: Proc. First Int'l Conf. Computer Graphics and Interactive Techniques in Australasia and South East Asia, pp. 245-250, 2003.
[21] M. Sedef, E. Samur, and C. Basdogan, "Real-Time Finite-Element Simulation of Linear Viscoelastic Tissue Behavior Based on Experimental Data," IEEE Computer Graphics and Applications, vol. 26, pp. 58-68, 2006.
[22] I. Peterlík, M. Sedef, C. Basdogan, and L. Matyska, "Real-Time Visio-Haptic Interaction with Static Soft Tissue Models Having Geometric and Material Nonlinearity," Computers & Graphics, vol. 34, no. 1, pp. 43-54, 2010.
[23] D.L. James and D.K. Pai, "A Unified Treatment of Elastostatic Contact Simulation for Real Time Haptics," Proc. SIGGRAPH '05: ACM SIGGRAPH 2005 Courses, p. 141, 2005.
[24] J. Barbic and D.L. James, "Six-DoF Haptic Rendering of Contact between Geometrically Complex Reduced Deformable Models," IEEE Trans. Haptics, vol. 1, no. 1, pp. 39-52, Jan.-Mar. 2008.
[25] C. Duriez, F. Dubois, A. Kheddar, and C. Andriot, "Realistic Haptic Rendering of Interacting Deformable Objects in Virtual Environments," IEEE Trans. Visualization and Computer Graphics, vol. 12, no. 1, pp. 36-47, 2006.
[26] Y. Adachi, T. Kumano, and K. Ogino, "Intermediate Representation for Stiff Virtual Objects," Proc. Virtual Reality Ann. Int'l Symp. (VRAIS '95), pp. 203-210, 1995.
[27] W.R. Mark, S.C. Randolph, M. Finch, J.M. Van Verth, and R.M. TaylorII, "Adding Force Feedback to Graphics Systems: Issues and Solutions," Proc. Conf. Computer Graphics and Interactive Techniques, pp. 447-452 1996.
[28] C. Garre and M.A. Otaduy, "Haptic Rendering of Complex Deformations through Handle-Space Force Linearization," Proc. World Haptics Conf., pp. 422-427, 2009.
[29] C. Forest, H. Delingette, and N. Ayache, "Surface Contact and Reaction Force Models for Laparoscopic Simulation," Medical Simulation, Lecture Notes in Computer Science, S. Cotin and D. Metaxas, eds., vol. 3078, pp. 168-176, Springer, 2004.
[30] M.A. Otaduy and M. Gross, "Transparent Rendering of Tool Contact with Compliant Environments," WHC '07: Proc. Second Joint EuroHaptics Conf. and Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 225-230, 2007.
[31] C. Garre and M.A. Otaduy, "Toward Haptic Rendering of Full-Hand Touch," Proc. CEIG (Spanish Computer Graphics Conf.), 2009.
[32] G. Saupin, C. Duriez, and S. Cotin, "Contact Model for Haptic Medical Simulations," ISBMS '08: Proc. Fourth Int'l Symp. Biomedical Simulation, pp. 157-165, 2008.
[33] C. Duriez, C. Guébert, M. Marchal, S. Cotin, and L. Grisoni, "Interactive Simulation of Flexible Needle Insertions Based on Constraint Models," Proc. Int'l Conf. Medical Image Computing and Computer-Assisted Intervention (MICCAI '09), pp. 291-299, 2009.
[34] S.P. DiMaio and S.E. Salcudean, "Needle Steering and Model-Based Trajectory Planning," Proc. Int'l Conf. Medical Image Computing and Computer-Assisted Intervention (MICCAI '03), pp. 33-40, 2003.
[35] J.S. Przemieniecki, Theory of Matrix Structural Analysis. McGraw Hill, 1968, 1985.
[36] C. Duriez, S. Cotin, J. Lenoir, and P.F. Neumann, "New Approaches to Catheter Navigation for Interventional Radiology Simulation," Computer Aided Surgery, vol. 11, pp. 300-308, 2006.
[37] D. Baraff and A. Witkin, "Large Steps in Cloth Simulation," Proc. ACM SIGGRAPH '98, 1998.
[38] C. Duriez, C. Guébert, M. Marchal, S. Cotin, and L. Grisoni, "Interactive Simulation of Flexible Needle Insertions Based on Constraint Models," Proc. Int'l Conf. Medical Image Computing and Computer-Assisted Intervention (MICCAI '09), pp. 291-299, Sept 2009.
[39] E. Dehghan, X. Wen, R. Zahiri-Azar, M. Marchal, and S. Salcudean, "Needle-Tissue Interaction Modeling Using Ultrasound-Based Motion Estimation: Phantom Study," Computer Aided Surgery, vol. 13, no. 5, pp. 265-280, 2008.
18 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool