The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.03 - July-September (2011 vol.4)
pp: 210-220
Jamie Gewirtz , University of Pennsylvania, Philadelphia
Dorsey Standish , University of Pennsylvania, Philadelphia
Paul Martin , University of Pennsylvania, Philadelphia
Jacquelyn A. Kunkel , University of Pennsylvania, Philadelphia
Magalie Lilavois , University of Pennsylvania, Philadelphia
Alexei Wedmid , University of Pennsylvania, Philadelphia
David I. Lee , University of Pennsylvania, Philadelphia
William McMahan , University of Pennsylvania, Philadelphia
ABSTRACT
Minimally invasive telerobotic surgical systems enable surgeons to perform complicated procedures without large incisions. Unfortunately, these systems typically do not provide the surgeon with sensory feedback aside from stereoscopic vision. We have, thus, developed VerroTouch, a sensing and actuating device that can be added to Intuitive Surgical's existing da Vinci S Surgical System to provide auditory and vibrotactile feedback of tool contact accelerations. These cues let the surgeon feel and hear contact with rough textures as well as the making and breaking of contact with objects and other tools. To evaluate the merits of this approach, we had 11 surgeons use an augmented da Vinci S to perform three in vitro manipulation tasks under four different feedback conditions: with no acceleration feedback, with audio feedback, with haptic feedback, and with both audio and haptic. Subjects expressed a significant preference for the inclusion of tool contact acceleration feedback, although they disagreed over which sensory modality was best. Other survey responses and qualitative written comments indicate that the feedback may have improved the subject's concentration and situational awareness by strengthening the connection between the surgeon and the surgical instruments. Analysis of quantitative task metrics shows that the feedback neither improves nor impedes the performance of the chosen tasks.
INDEX TERMS
Vibrotactile feedback, robot-assisted surgery, telemanipulation, surgical robotics.
CITATION
Jamie Gewirtz, Dorsey Standish, Paul Martin, Jacquelyn A. Kunkel, Magalie Lilavois, Alexei Wedmid, David I. Lee, William McMahan, "Tool Contact Acceleration Feedback for Telerobotic Surgery", IEEE Transactions on Haptics, vol.4, no. 3, pp. 210-220, July-September 2011, doi:10.1109/TOH.2011.31
REFERENCES
[1] J.W. Randolph Chitwood, L.W. Nifong, W.H.H. Chapman, J.E. Felger, B.M. Bailey, T. Ballint, K.G. Mendleson, V.B. Kim, J.A. Young, and R.A. Albrecht, "Robotic Surgical Training in an Academic Institution," Annals of Surgery, vol. 234, no. 4, pp. 475-486, 2001.
[2] K.T. den Boer, J.L. Herder, W. Sjoerdsma, D.W. Meijer, D.J. Gouma, and H.G. Stassen, "Sensitivity of Laparoscopic Dissectors," Surgical Endoscopy, vol. 13, no. 9, pp. 869-873, 1999.
[3] G. Picod, A.C. Jambon, D. Vinatier, and P. Dubois, "What Can the Operator Actually Feel when Performing a Laparoscopy?" Surgical Endoscopy, vol. 19, pp. 95-100, 2005.
[4] J.K. Salisbury, "The Heart of Microsurgery," Mechanical Eng. Magazine, vol. 120, no. 12, pp. 47-51, Dec. 1998.
[5] R. Kumar and A.K. Hemal, "Emerging Role of Robotics in Urology," J. Minimal Access Surgery, vol. 1, no. 4, pp. 202-210, 2005.
[6] G.S. Guthart and J.K. Salisbury, "The Intuitive Trade; Telesurgery System: Overview and Application," Proc. IEEE Conf. Robotics and Automation, pp. 618-621, 2000.
[7] R.S. Johansson and J.R. Flanagan, "Coding and Use of Tactile Signals from the Fingertips in Object Manipulation Tasks," Nature Rev. Neuroscience, vol. 10, pp. 345-359, May 2009.
[8] G.T. Sung and I.S. Gill, "Robotic Laparoscopic Surgery: A Comparison of the da Vinci and Zeus Systems," Urology, vol. 58, no. 6, pp. 893-898, 2001.
[9] R. Costi, J. Himpens, J. Bruyns, and G.B. Cadière, "Robotic Fundoplication: From Theoretic Advantages to Real Problems," J. Am. College of Surgeons, vol. 197, no. 3, pp. 500-507, Sept. 2003.
[10] M.A. Talamini, S. Chapman, S. Horgan, and W.S. Melvin, "A Prospective Analysis of 211 Robotic-Assisted Surgical Procedures," Surgical Endoscopy, vol. 17, no. 10, pp. 1521-1524, Oct. 2003.
[11] A.R. Lanfranco, A.E. Castellanos, J.P. Desai, and W.C. Meyers, "Robotic Surgery: A Current Perspective," Annals of Surgery, vol. 239, no. 1, pp. 14-21, Jan. 2004.
[12] B.T. Bethea, A.M. Okamura, M. Kitagawa, T.P. Fitton, S.M. Cattaneo, V.L. Gott, W.A. Baumgartner, and D.D. Yuh, "Application of Haptic Feedback to Robotic Surgery," J. Laparoendoscopic and Advanced Surgical Techniques, vol. 14, no. 3, pp. 191-196, June 2004.
[13] J.B. Basillote, T.E. Ahlering, D.W. Skarecky, D.I. Lee, and R.V. Clayman, "Laparoscopic Radical Prostatectomy," Surgical Endoscopy, vol. 18, pp. 1694-1711, 2004.
[14] R.D. Howe and Y. Matsuoka, "Robotics for Surgery," Ann. Rev. of Biomedical Eng., vol. 1, pp. 211-240, 1999.
[15] C.A. Grimbergen and J.E.N. Jaspers, "Robotics in Minimally Invasive Surgery," Proc. IEEE Int'l Conf. Systems, Man and Cybernetics, pp. 2486-2491, Oct. 2004.
[16] M. Kitagawa, A.M. Okamura, B.T. Bethea, V.L. Gott, and W.A. Baumgartner, "Analysis of Suture Manipulation Forces for Teleoperation with Force Feedback," Proc. Fifth Int'l Conf. Medical Image Computing and Computer Assisted Intervention, Sept. 2002.
[17] H.S. Vitense, J.A. Jacko, and V.K. Emery, "Multimodal Feedback: An Assessment of Performance and Mental Workload," Ergonomics, vol. 46, nos. 1-3, pp. 68-87, Jan. 2003.
[18] K.J. Kuchenbecker, J. Gewirtz, W. McMahan, D. Standish, P. Martin, J. Bohren, P.J. Mendoza, and D.I. Lee, "VerroTouch: High-Frequency Acceleration Feedback for Telerobotic Surgery," Haptics: Generating and Perceiving Tangible Sensations, Part II: Seventh Int'l Conf. EuroHaptics, A.M.L. Kappers, J.B.F. van Erp, W.M.B. Tiest, and F.C.T. van der Helm, eds., pp. 189-196, Springer, July 2010.
[19] Y. Yokokohji and T. Yoshikawa, "Bilateral Control of Master-Slave Manipulators for Ideal Kinesthetic Coupling-Formulation and Experiment," IEEE Trans. Robotics and Automation, vol. 10, no. 5, pp. 605-620, Oct. 1994.
[20] C.R. Wagner, N. Stylopoulus, and R.D. Howe, "The Role of Force Feedback in Surgery: Analysis of Blunt Dissection," Proc. 10th Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems, Mar. 2002.
[21] A.J. Madhani, G. Niemeyer, and J.K. Salisbury, "The Black Falcon: A Teleoperated Surgical Instrument for Minimally Invasive Surgery," Proc. IEEE/RSJ Int'l Conf. Intelligent Robotic Systems, vol. 2, pp. 936-944, 1998.
[22] M.C. Çavuşoğlu, A. Sherman, and F. Tendick, "Bilateral Controller Design for Telemanipulation in Soft Environments," IEEE Trans. Robotics and Automation, vol. 18, no. 4, pp. 641-647, Aug. 2002.
[23] C. Preusche, T. Ortmaier, and G. Herzinger, "Teleoperation Concepts in Minimal Invasive Surgery," Control Eng. Practice, vol. 10, pp. 1245-1250, 2002.
[24] M. Mahvash and A.M. Okamura, "Friction Compensation for Enhancing Transparency of a Teleoperator with Compliant Transmission," IEEE Trans. Robotics, vol. 23, no. 6, pp. 1240-1246, Dec. 2007.
[25] M. Mahvash and A.M. Okamura, "Enhancing Transparency of a Position-Exchange Teleoperator," Proc. IEEE World Haptics Conf., pp. 470-475, 2007.
[26] M. Mahvash, J. Gwilliam, R. Agarwal, B. Vagvolgi, L. Su, D.D. Yuh, and A.M. Okamura, "Force-Feedback Surgical Teleoperator: Controller Design and Palpation Experiments," Proc. IEEE Haptics Symp., pp. 465-471, Mar. 2008.
[27] Q. Lindsey, N. Tenenholtz, D.I. Lee, and K.J. Kuchenbecker, "Image-Enabled Force Feedback for Robotic Teleoperation of a Flexible Tool," Proc. IASTED Int'l Conf. Robotics and Applications, pp. 224-233, Nov. 2009.
[28] M. Tavakoli, R.V. Patel, and M. Moallem, "Haptic Interaction in Robot-Assisted Endoscopic Surgery: A Sensorized End-Effector," Int'l J. Medical Robotics and Computer Assisted Surgery, vol. 1, no. 2, pp. 53-63, 2005.
[29] C.E. Reiley, T. Akinbiyi, D. Burschka, D.C. Chang, A.M. Okamura, and D.D. Yuh, "Effects of Visual Force Feedback on Robot-Assisted Surgical Task Performance," J. Thoracic and Cardiovascular Surgery, vol. 135, pp. 196-202, 2008.
[30] J. Rosen, J.D. Brown, M. Barreca, L. Chang, B. Hannaford, and M. Sinanan, "The Blue DRAGON—A System for Monitoring the Kinematics and the Dynamics of Endoscopic Tools in Minimally Invasive Surgery for Objective Laparoscopic Skill Assessment," Studies in Health Technology and Informatics—Medicine Meets Virtual Reality, pp. 412-418, IOS Press, Jan. 2002.
[31] W. Semere, M. Kitagawa, and A.M. Okamura, "Teleoperation with Sensor/Actuator Asymmetry: Task Performance with Partial Force Feedback," Proc. 12th Symp. Haptic Interfaces for Virtual Environments and Teleoperator Systems, pp. 121-127, Mar. 2004.
[32] J. Peirs, J. Clijnen, D. Reynaerts, H.V. Brussel, P. Herijgers, B. Corteville, and S. Boone, "A Micro Optical Force Sensor for Force Feedback during Minimally Invasive Robotic Surgery," Sensors and Actuators A: Physical, vol. 115, pp. 447-455, 2004.
[33] C.-H. King, M.O. Culjat, M.L. Franco, J.W. Bisley, G.P. Carman, E.P. Dutson, and W.S. Grundfest, "A Multielement Tactile Feedback System for Robot-Assisted Minimally Invasive Surgery," IEEE Trans. Haptics, vol. 2, no. 1, pp. 52-56, Jan.-Mar. 2009.
[34] N.A. Tanner and G. Niemeyer, "Improving Perception in Time-Delayed Telerobotics," Int'l J. Robotics Research, vol. 24, no. 8, pp. 631-644, 2005.
[35] D.A. Kontarinis and R.D. Howe, "Tactile Display of Vibratory Information in Teleoperation and Virtual Environments," Presence: Teleoperators and Virtual Environments, vol. 4, no. 4, pp. 387-402, Aug. 1995.
[36] W. McMahan and K.J. Kuchenbecker, "Haptic Display of Realistic Tool Contact via Dynamically Compensated Control of a Dedicated Actuator," Proc. IEEE/RSJ Int'l Conf. Intelligent Robots and Systems, pp. 3171-3177, Oct. 2009.
[37] W. McMahan, J.M. Romano, A.M.A. Rahuman, and K.J. Kuchenbecker, "High Frequency Acceleration Feedback Significantly Increases the Realism of Haptically Rendered Textured Surfaces," Proc. IEEE Haptics Symp., pp. 141-148, Mar. 2010.
[38] J. Bell, S. Bolanowski, and M.H. Holmes, "The Structure and Function of Pacinian Corpuscles: A Review," Progress in Neurobiology, vol. 42, no. 1, pp. 79-128, Jan. 1994.
[39] N. Landin, J.M. Romano, W. McMahan, and K.J. Kuchenbecker, "Dimensional Reduction of High-Frequency Accelerations for Haptic Rendering," Haptics: Generating and Perceiving Tangible Sensations, Seventh Int'l Conf. EuroHaptics, Part II, A.M.L. Kappers, J.B.F. van Erp, W.M.B. Tiest, and F. C.T. van der Helm, eds., pp. 79-86, Springer, July 2010.
[40] A.M. Derossis, G.M. Fried, M. Abrahamowicz, H.H. Sigman, J.S. Barkun, and J.L. Meakins, "Development of a Model for Training and Evaluation of Laparoscopic Skills," The Am. J. Surgery, vol. 175, no. 6, pp. 482-487, 1998.
[41] da Vinci Surgical Community "Intuitive Surgical Residency Training: System Skill Practicum, Participant's Guide," http:/www.davincisurgerycommunity.com, Jan. 2011.
[42] B.G. Witmer and M.J. Singer, "Measuring Presence in Virtual Environments: A Presence Questionnaire," Presence: Teleoperators and Virtual Environments, vol. 7, no. 3, pp. 225-240, June 1998.
6 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool