Augmented Reality-Based Navigation System for Wrist Arthroscopy: Feasibility

Abstract

Purpose In video surgery, and more specifically in arthroscopy, one of the major problems is positioning the camera and instruments within the anatomic environment. The concept of computer-guided video surgery has already been used in ear, nose, and throat (ENT), gynecology, and even in hip arthroscopy. These systems, however, rely on optical or mechanical sensors, which turn out to be restricting and cumbersome. The aim of our study was to develop and evaluate the accuracy of a navigation system based on electromagnetic sensors in video surgery.

Methods We used an electromagnetic localization device (Aurora, Northern Digital Inc., Ontario, Canada) to track the movements in space of both the camera and the instruments. We have developed a dedicated application in the Python language, using the VTK library for the graphic display and the OpenCV library for camera calibration.

Results A prototype has been designed and evaluated for wrist arthroscopy. It allows display of the theoretical position of instruments onto the arthroscopic view with useful accuracy.

Discussion The augmented reality view represents valuable assistance when surgeons want to position the arthroscope or locate their instruments. It makes the maneuver more intuitive, increases comfort, saves time, and enhances concentration.

Keywords

arthroscopy - augmented reality - computer-guided surgery - wrist

• References

• 1 Bainville E, Chaffanjon P, Cinquin P. Computer generated visual assistance during retroperitoneoscopy. Comput Biol Med 1995; 25 (2) 165-171
• 2 Wagner A, Undt G, Watzinger F , et al. Principles of computer-assisted arthroscopy of the temporomandibular joint with optoelectronic tracking technology. Oral Surg Oral Med Oral Pathol Oral Radiol Endod 2001; 92 (1) 30-37
• 3 Monahan E, Shimada K. Computer-aided navigation for arthroscopic hip surgery using encoder linkages for position tracking. Int J Med Robot 2006; 2 (3) 271-278
• 4 Nicolau S, Soler L, Mutter D, Marescaux J. Augmented reality in laparoscopic surgical oncology. Surg Oncol 2011; 20 (3) 189-201
• 5 Fontès D. Wrist arthroscopy. Current indications and results [in French]. Chir Main 2004; 23 (6) 270-283
• 6 del Piñal F, García-Bernal FJ, Pisani D, Regalado J, Ayala H, Studer A. Dry arthroscopy of the wrist: surgical technique. J Hand Surg Am 2007; 32 (1) 119-123
• 7 Yaniv Z, Wilson E, Lindisch D, Cleary K. Electromagnetic tracking in the clinical environment. Med Phys 2009; 36 (3) 876-892
• 8 Sanner MF. Python: a programming language for software integration and development. J Mol Graph Model 1999; 17 (1) 57-61
• 9 Schroeder W, Martin KW, Lorensen B. The Visualization Toolkit. 2nd ed. Upper Saddle River, NJ: Prentice Hall PTR; 1998: 1-645
• 10 Bradski GR, Kaehler A. Learning OpenCV: Computer vision with the OpenCV library. Sebastopol, CA: O'Reilly; 2008: 1-555
• 11 Kevin C. IGSTK: The Book. Gaithersburg, MD: Signature Book Printing; 1997: 184-190
• 12 Tsai R. A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. http://www.vision.caltech.edu/bouguetj/calib_doc/papers/Tsai.pdf
• 13 Caudell TP, Mizell DW. Augmented reality: an application of heads-up display technology to manual manufacturing processes. Proceedings of 25th HICSS 1992 2. 659-669
• 14 Berryman DR. Augmented reality: a review. Med Ref Serv Q 2012; 31 (2) 212-218
• 15 Dario P, Carrozza MC, Marcacci M , et al. A novel mechatronic tool for computer-assisted arthroscopy. IEEE Trans Inf Technol Biomed 2000; 4 (1) 15-29
• 16 Freysinger W, Gunkel AR, Thumfart WF. Image-guided endoscopic ENT surgery. Eur Arch Otorhinolaryngol 1997; 254 (7) 343-346
• 17 Nakamoto M, Ukimura O, Faber K, Gill IS. Current progress on augmented reality visualization in endoscopic surgery. Curr Opin Urol 2012; 22 (2) 121-126
• 18 Edwards PJ, King AP, Hawkes DJ , et al. Stereo augmented reality in the surgical microscope. Stud Health Technol Inform 1999; 62: 102-108
• 19 Geist E, Shimada K. Position error reduction in a mechanical tracking linkage for arthroscopic hip surgery. Int J CARS 2011; 6 (5) 693-698
• 20 Ohhashi G, Kamio M, Abe T, Otori N, Haruna S. Endoscopic transnasal approach to the pituitary lesions using a navigation system (InstaTrak system): technical note. Minim Invasive Neurosurg 2002; 45 (2) 120-123
• 21 Ricci WM, Russell TA, Kahler DM, Terrill-Grisoni L, Culley P. A comparison of optical and electromagnetic computer-assisted navigation systems for fluoroscopic targeting. J Orthop Trauma 2008; 22 (3) 190-194
• 22 Frantz DD, Wiles AD, Leis SE, Kirsch SR. Accuracy assessment protocols for electromagnetic tracking systems. Phys Med Biol 2003; 48 (14) 2241-2251
• 23 Fischer GS, Taylor RH. Electromagnetic tracker measurement error simulation and tool design. Med Image Comput Comput Assist Interv 2005; 8 (Pt 2) 73-80
• 24 Cleary K, Zhang H, Glossop N, Levy E, Wood B, Banovac F. Electromagnetic tracking for image-guided abdominal procedures: overall system and technical issues. Conf Proc IEEE Eng Med Biol Soc 2005; 7: 6748-6753
• 25 Fischer GS. Electromagnetic tracker characterization and optimal tool design [master's thesis]. Baltimore, MD: Johns Hopkins University; 2005
• 26 Wu C, Jaramaz B. An easy calibration for oblique-viewing endoscopes. ICRA 2008; 1424-1429