EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Augmented Reality Surgical Navigation System Integrated with Deep Learning

Shin-Yan Chiou iD, Li-Sheng Liu, Chia-Wei Lee, Dong-Hyun Kim, Mohammed A Al-Masni iD, Hao-Li Liu iD, Kuo-Chen Wei iD, Jiun-Lin Yan, Pin-Yuan Chen

Bioengineering · 20.05.2023 · 10 (5) · 617

DOI: 10.3390/bioengineering10050617 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Bioengineering, online erschienen am 20.05.2023. Verfasst von Shin-Yan Chiou und 8 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical Engineering, College of Engineering, Chang Gung University, Kwei-Shan, Taoyuan 333, Taiwan. Die Arbeit wurde bisher 22-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science and Technology Council, Taiwan, Chang Gung Memorial Hospital, Ministry of Science and Technology.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Most current surgical navigation methods rely on optical navigators with images displayed on an external screen. However, minimizing distractions during surgery is critical and the spatial information displayed in this arrangement is non-intuitive. Previous studies have proposed combining optical navigation systems with augmented reality (AR) to provide surgeons with intuitive imaging during surgery, through the use of planar and three-dimensional imagery. However, these studies have mainly focused on visual aids and have paid relatively little attention to real surgical guidance aids. Moreover, the use of augmented reality reduces system stability and accuracy, and optical navigation systems are costly. Therefore, this paper proposed an augmented reality surgical navigation system based on image positioning that achieves the desired system advantages with low cost, high stability, and high accuracy. This system also provides intuitive guidance for the surgical target point, entry point, and trajectory. Once the surgeon uses the navigation stick to indicate the position of the surgical entry point, the connection between the surgical target and the surgical entry point is immediately displayed on the AR device (tablet or HoloLens glasses), and a dynamic auxiliary line is shown to assist with incision angle and depth. Clinical trials were conducted for EVD (extra-ventricular drainage) surgery, and surgeons confirmed the system’s overall benefit. A “virtual object automatic scanning” method is proposed to achieve a high accuracy of 1 ± 0.1 mm for the AR-based system. Furthermore, a deep learning-based U-Net segmentation network is incorporated to enable automatic identification of the hydrocephalus location by the system. The system achieves improved recognition accuracy, sensitivity, and specificity of 99.93%, 93.85%, and 95.73%, respectively, representing a significant improvement from previous studies.

Schlagwörter

Stichwörter der Autor:innen

EVD surgeryaugmented realityautomatic scanningdeep learningmixed realityneurosurgerysurgical navigation

Autor:innen und Institutionen

  • Department of Electrical Engineering, College of Engineering, Chang Gung University, Kwei-Shan, Taoyuan 333, Taiwan.
  • Department of Nuclear Medicine, Linkou Chang Gung Memorial Hospital, Taoyuan 333, Taiwan.
  • Department of Neurosurgery, Keelung Chang Gung Memorial Hospital, Keelung 204, Taiwan.
  • Department of Electrical and Electronic Engineering, College of Engineering, Yonsei University, Seodaemun-gu, Seoul 03722, Republic of Korea.
  • Department of Artificial Intelligence, College of Software & Convergence Technology, Daeyang AI Center, Sejong University, Seoul 05006, Republic of Korea.
  • Department of Electrical Engineering, National Taiwan University, Taipei 106, Taiwan.

ORCID-Profile: Shin-Yan Chiou, Mohammed A Al-Masni, Hao-Li Liu, Kuo-Chen Wei

Förderung

  • National Science and Technology Council, Taiwan
  • Chang Gung Memorial Hospital
  • Ministry of Science and Technology
  • CGMH project

Zitieren

APA

Chiou, S. Y., Liu, L. S., Lee, C. W., Kim, D. H., Al-Masni, M. A., Liu, H. L., Wei, K. C., Yan, J. L., & Chen, P. Y. (2023). Augmented Reality Surgical Navigation System Integrated with Deep Learning. Bioengineering, 10(5), 617. https://doi.org/10.3390/bioengineering10050617

Vancouver

Chiou SY, Liu LS, Lee CW, Kim DH, Al-Masni MA, Liu HL, et al. Augmented Reality Surgical Navigation System Integrated with Deep Learning. Bioengineering. 2023;10(5):617. doi:10.3390/bioengineering10050617

BibTeX
@article{Chiou2023,
  author = {Chiou, Shin-Yan and Liu, Li-Sheng and Lee, Chia-Wei and Kim, Dong-Hyun and Al-Masni, Mohammed A and Liu, Hao-Li and Wei, Kuo-Chen and Yan, Jiun-Lin and Chen, Pin-Yuan},
  title = {Augmented Reality Surgical Navigation System Integrated with Deep Learning},
  journal = {Bioengineering},
  year = {2023},
  volume = {10},
  number = {5},
  pages = {617},
  doi = {10.3390/bioengineering10050617}
}
Kostenlos starten →