This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Mixed-Reality Simulation of Minimally Invasive Surgeries
October-December 2007 (vol. 14 no. 4)
pp. 76-87
Gerard Lacey, Trinity College Dublin
Donncha Ryan, Haptica
Derek Cassidy, Haptica
Derek Young, Haptica
Our mixed-reality platform helps train surgeons in minimally invasive surgery and objectively assesses their performance. The platform uses multicamera stereo inside a patient manikin to measure the 3D positions of unmodified surgical instruments. It uses this information to drive a mixed-reality, computer-mediated learning system and provide objective measures of surgical skill.

1. R. Smith, "All Changed, Changed Utterly," British Medical J., vol. 316, no. 7149, 1998, pp. 1917–1918.
2. L.T. Kohn, J.M. Corrigan, and M.S. Donaldson, To Err Is Human: Building a Safer Health System, Committee on Quality of Health Care in Am., Inst. of Medicine, Nat'l Academy of Sciences, 2000.
3. R.M. Satava, "Virtual Reality Surgical Simulator," Surgical Endoscopy, vol. 7, no. 3, 1993, pp. 203–205.
4. N.E. Seymour et al., "Virtual Reality Training Improves Operating Room Performance: Results of a Randomized, Double-Blinded Study," Annals of Surgery, vol. 4, no. 236, 2002, pp. 458–464.
5. A.G. Gallagher and C.U. Cates, "MD Approval of Virtual Reality Training for Carotid Stenting: What This Means for Procedural-Based Medicine," J. Am. Medical Assoc., vol. 292, no. 24, 2004, pp. 3024–3026.
6. R. Kneebone, "Simulation in Surgical Education: Educational Issues and Practical Implications," Medical Education, vol. 37, no. 3, 2003, pp. 267–277.
7. G.M. Fried et al., "Proving the Value of Simulation in Laparoscopic Surgery," Annals of Surgery, vol. 3, no. 240, 2004, pp. 518–528.
8. J.H. Peters et al., "Development and Validation of a Comprehensive Program of Education and Assessment of the Basic Fundamentals of Laparoscopic Surgery," Surgery, vol. 135, no. 1, 2004, pp. 21–27.
9. F.J. Carter et al., "Consensus Guidelines for Validation of Virtual Reality Surgical Simulators," Surgical Endoscopy, vol. 19, no. 12, 2005, pp. 1523–1532.
10. C.Y. Ro et al., "The Impact of Haptic Expectations on Initial Lapsim Performance: Prior Laparoscopic Experience Does Not Predict Performance," Proc. Sages 2005, Soc. Am. Gastrointestinal and Endoscopic Surgeons, 2005.
11. Z. Zhang, "A Flexible New Technique for Camera Calibration," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 11, 2000, pp. 1330–1334.
12. R.B. Fisher and D.K. Naidu, "A Comparison of Algorithms for Subpixel Peak Detection," Advances in Image Processing, Multimedia and Machine Vision, Springer-Verlag, 1996, pp. 168–169.
13. G.R. Bradski, "Real Time Face and Object Tracking as a Component of a Perceptual User Interface," Proc. 4th IEEE Workshop on Applications of Computer Vision (WACV 98), IEEE CS Press, 1998, pp. 214–219.
14. H. Kato and M. Billinghurst, "Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System," Proc. 2nd Int'l Workshop on Augmented Reality (IWAR 99), IEEE CS Press, 1999, pp. 85–94.
15. H. Faulkner et al., "Validation of and Objective Structured Assessment of Technical Skills for Surgical Residents," Academic Medicine, vol. 71, no. 12, 1996, pp. 1363–1365.
16. N. Taffinder et al., "Objective Measurement of Surgical Dexterity—Validation of the Imperial College Surgical Assessment Device," Minimally Invasive Surgery and Allied Techniques, vol. 7, suppl. 1, 1998, p. 11.
17. V. Datta et al., "The Use of Electromagnetic Motion Tracking Analysis to Objectively Measure Open Surgical Skill in the Laboratory-Based Model," J. Am. College of Surgeons, vol. 193, no. 5, 2001, pp. 479–485.
18. D. Broe et al., "Construct Validation of a Novel Hybrid Surgical Simulator," Surgical Endoscopy, vol. 20, no. 6, 2006, pp. 900–904.
19. K. Van Sickle et al., "Construct Validation of the ProMIS Simulator Using a Novel Laparoscopic Suturing Task," Surgical Endoscopy, vol. 19, no. 9, 2005, pp. 1227–1231.
20. J. Hance et al., "Evaluation of a Laparoscopic Video Trainer with In-Built Measures of Performance," Proc. 13th Int'l Congress and Ann. General Meeting Soc. Laparoendoscopic Surgeons, Soc. Laparoendoscopic Surgeons, 2004.
21. E.M. Ritter et al., "Concurrent Validity of Augmented Reality Metrics Applied to the Fundamentals of Laparoscopic Surgery (FLS)," Proc. Sages 2006, Soc. Am. Gastrointestinal and Endoscopic Surgeons, 2006, pp. 104–105.
22. A.L. McCluney et al., "Validation of the ProMIS Hybrid Simulator Using a Standard Set of Laparoscopic Tasks," Proc. Sages 2006, Soc. Am. Gastrointestinal and Endoscopic Surgeons, 2006, p. 194.
23. E. Fellinger et al., "Complex Laparoscopic Task Performance on Two New Computer Based Skills Training Devices," Proc. Sages 2006 Education/Outcomes, Soc. Am. Gastrointestinal and Endoscopic Surgeons, 2006, pp. 190–191.
24. V.K. Narula et al., "A Computerized Analysis of Robotic Versus Laparoscopic Task Performance," Proc. Sages 2006 Scientific Sessions, Soc. Am. Gastrointestinal and Endoscopic Surgeons, 2006, pp. 248–249.
25. L.N. Vuong, S. Schwaitzberg, and C.G. Cao, "What Can Motion Derivatives Tell Us about Skill Performance?" Proc. Sages 2006 Scientific Sessions, Soc. Am. Gastrointestinal and Endoscopic Surgeons, 2006, p. 105.
26. M. Pellen, J. Barton, and F. Horgan, "Laparoscopic Skills Acquisition: Is Psychometric Motion Analysis a Valid Assessment Tool?" Proc. Int'l Congress of the European Assoc. for Endoscopic Surgery (EAES 2006), 2006.
1. A.C. Boud et al., "Virtual Reality and Augmented Reality as a Training Tool for Assembly Tasks," Proc. IEEE Int'l Conf. Information Visualization, IEEE CS Press, 1999, pp. 32–36.
2. T. Haritos and N.D. Macchiarella, "A Mobile Application of Augmented Reality for Aerospace Maintenance Training," Proc. 24th Digital Avionics Systems Conf. (DASC 2005), vol. 1, IEEE Press, 2005, pp. 5.B.3–5.1–9.
3. C. Nakajima and N. Itho, "A Support System for Maintenance Training by Augmented Reality," Proc. 12th Int'l Conf. Image Analysis and Processing (ICIAP 03), IEEE Press, 2003, pp. 158–163.
4. J. Fischer et al., "Medical Augmented Reality Based on Commercial Image Guided Surgery," Proc. Eurographics Symp. Virtual Environments, Eurographics, 2004, pp. 83–86.
5. M. Rosenthal et al., "Augmented Reality Guidance for Needle Biopsies: An Initial Randomized, Controlled Trial in Phantoms," Medical Image Analysis, vol. 6, no. 3, 2002, pp. 313–320.
6. P. Brodeur et al., "A Points-to-Surfaces Matching Technique for the Application of Augmented Reality during Spine Surgery," Proc. IEEE 17th Ann. Conf. Eng. in Medicine and Biology, vol. 2, IEEE Press, 1995, pp. 1197–1198.
7. Y. Sato et al., "Image Guidance of Breast Cancer Surgery Using 3-D Ultrasound Images and Augmented Reality Visualization," IEEE Trans. Medical Imaging, vol. 17, no. 5, 1998, pp. 681–693.
8. S. Nicolau et al., "An Augmented Reality System to Guide Radio-Frequency Tumour Ablation," Computer Animation and Virtual Worlds, vol. 16, no. 1, 2005, pp. 1–10.
9. J. Marescaux et al., "Augmented-Reality-Assisted Laparoscopic Adrenalectomy," J. Am. Medical Assoc., vol. 292, no. 18, 2004, pp. 2214–2215.
10. G. Welch et al., "Immersive Electronic Books for Surgical Training," IEEE MultiMedia, vol. 12, no. 3, 2005, pp. 22–35.
11. F.D. McKenzie et al., "Augmented Standardized Patients now Virtually a Reality," Proc. 3rd IEEE and ACM Int'l Symp. Mixed and Augmented Reality (ISMAR 04), IEEE CS Press, 2004, pp. 270–271.
12. T. Sielhorst, T. Blum, and N. Navab, "Synchronizing 3D Movements for Quantitative Comparison and Simultaneous Visualization of Actions," Proc. 4th IEEE and ACM Int'l Symp. Mixed and Augmented Reality, IEEE CS Press, 2005, pp. 38–47.
13. N. Taffinder et al., "Objective Measurement of Surgical Dexterity—Validation of the Imperial College Surgical Assessment Device," Minimally Invasive Surgery and Allied Techniques, vol. 7, no. 1, 1998.

Index Terms:
Augmented reality, surgical training, virtual reality, and psychomotor skills assessment.
Citation:
Gerard Lacey, Donncha Ryan, Derek Cassidy, Derek Young, "Mixed-Reality Simulation of Minimally Invasive Surgeries," IEEE Multimedia, vol. 14, no. 4, pp. 76-87, Oct.-Dec. 2007, doi:10.1109/MMUL.2007.79
Usage of this product signifies your acceptance of the Terms of Use.