Preliminary Study on the Clinical Application of Augmented Reality Neuronavigation

Abstract

Objective To develop an augmented reality (AR) neuronavigation system with Web cameras and examine its clinical utility.

Methods The utility of the system was evaluated in three patients with brain tumors. One patient had a glioblastoma and two patients had convexity meningiomas. Our navigation system comprised the open-source software 3D Slicer (Brigham and Women's Hospital, Boston, Massachusetts, USA), the infrared optical tracking sensor Polaris (Northern Digital Inc., Waterloo, Canada), and Web cameras. We prepared two different types of Web cameras: a handheld type and a headband type. Optical markers were attached to each Web camera. We used this system for skin incision planning before the operation, during craniotomy, and after dural incision.

Results We were able to overlay these images in all cases. In Case 1, accuracy could not be evaluated because the tumor was not on the surface, though it was generally suitable for the outline of the external ear and the skin. In Cases 2 and 3, the augmented reality error was ∼2 to 3 mm.

Conclusion AR technology was examined with Web cameras in neurosurgical operations. Our results suggest that this technology is clinically useful in neurosurgical procedures, particularly for brain tumors close to the brain surface.

Keywords

neuronavigation - augmented reality - camera devices - superimposition - tractography

• References

• 1 Kockro RA, Tsai YT, Ng I , et al. Dex-ray: augmented reality neurosurgical navigation with a handheld video probe. Neurosurgery 2009; 65: 795-807 , discussion 807–808
• 2 Grunert P, Darabi K, Espinosa J, Filippi R. Computer-aided navigation in neurosurgery. Neurosurg Rev 2003; 26: 73-99 , discussion 100–101
• 3 Enchev Y. Neuronavigation: geneology, reality, and prospects. Neurosurg Focus 2009; 27: E11
• 4 Masutani Y, Dohi T, Yamane F, Iseki H, Takakura K. Augmented reality visualization system for intravascular neurosurgery. Comput Aided Surg 1998; 3: 239-247
• 5 Sielhorst T, Feuerstein M, Navab N. Advanced medical displays: a literature review of augmented reality. J Disp Technol 2008; 4: 451-467
• 6 Shuhaiber JH. Augmented reality in surgery. Arch Surg 2004; 139: 170-174
• 7 King AP, Edwards PJ, Maurer Jr CR , et al. A system for microscope-assisted guided interventions. Stereotact Funct Neurosurg 1999; 72: 107-111
• 8 Kawamata T, Iseki H, Shibasaki T, Hori T. Endoscopic augmented reality navigation system for endonasal transsphenoidal surgery to treat pituitary tumors: technical note. Neurosurgery 2002; 50: 1393-1397
• 9 Paul P, Fleig O, Jannin P. Augmented virtuality based on stereoscopic reconstruction in multimodal image-guided neurosurgery: methods and performance evaluation. IEEE Trans Med Imaging 2005; 24: 1500-1511
• 10 Zhang Z. Flexible camera calibration by viewing a plane from unknown orientations. International Conference on Computer Vision 1999; 1: 666-673
• 11 Hong J, Hashizume M. An effective point-based registration tool for surgical navigation. Surg Endosc 2010; 24: 944-948
• 12 Lovo EE, Quintana JC, Puebla MC , et al. A novel, inexpensive method of image coregistration for applications in image-guided surgery using augmented reality. Neurosurgery 2007; 60: 366-371 , discussion 371–372
• 13 Cho B, Oka M, Matsumoto N , et al. Augmented reality of surgical microscope for otologic surgery. In: Proceedings of CARS, Berlin, Germany, 2011; 6: S245-S246
• 14 Kim S, Hong J, Joung S , et al. Dual surgical navigation using augmented and virtual environment techniques. Int J Optomechatronics 2011; 5: 155-169