Development of a Machine Learning–Enabled Virtual Reality Tool for Preoperative Planning of Functional Endoscopic Sinus Surgery
Journal of Neurological Surgery Reports · 01.07.2024 · 85 (03) · e118-e123
DOI: 10.1055/a-2358-8928 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Neurological Surgery Reports, erschienen am 01.07.2024. Verfasst von Varun Gudapati und 6 weiteren Autor:innen. Beteiligte Einrichtung: David Geffen School of Medicine, UCLA, Los Angeles, California, United States. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: I01, K99, NIH.
Abstract (Originalsprache)
Objectives
Virtual reality (VR) is an increasingly valuable teaching tool, but current simulators are not typically clinically scalable due to their reliance on inefficient manual segmentation. The objective of this project was to leverage a high-throughput and accurate machine learning method to automate data preparation for a patient-specific VR simulator used to explore preoperative sinus anatomy.
Methods
An endoscopic VR simulator was designed in Unity to enable interactive exploration of sinus anatomy. The Saak transform, a data-efficient machine learning method, was adapted to accurately segment sinus computed tomography (CT) scans using minimal training data, and the resulting data were reconstructed into three-dimensional (3D) patient-specific models that could be explored in the simulator.
Results
Using minimal training data, the Saak transform–based machine learning method offers accurate soft-tissue segmentation. When explored with an endoscope in the VR simulator, the anatomical models generated by the algorithm accurately capture key sinus structures and showcase patient-specific variability in anatomy.
Conclusion
By offering an automatic means of preparing VR models from a patient's raw CT scans, this pipeline takes a key step toward clinical scalability. In addition to preoperative planning, this system also enables virtual endoscopy—a tool that is particularly useful in the COVID-19 era. As VR technology inevitably continues to develop, such a foundation will help ensure that future innovations remain clinically accessible.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- David Geffen School of Medicine, UCLA, Los Angeles, California, United States.
- Ming-Hsieh Department of Electrical Engineering, USC, Los Angeles, California, United States.
ORCID-Profile: Varun Gudapati
Förderung
- I01
- K99
- NIH
Zitieren
APA
Gudapati, V., Chen, A., Meyer, S., Jay Kuo, C. C., Ding, Y., Hsiai, T. K., & Wang, M. (2024). Development of a Machine Learning–Enabled Virtual Reality Tool for Preoperative Planning of Functional Endoscopic Sinus Surgery. Journal of Neurological Surgery Reports, 85(03), e118-e123. https://doi.org/10.1055/a-2358-8928
Vancouver
Gudapati V, Chen A, Meyer S, Jay Kuo CC, Ding Y, Hsiai TK, et al. Development of a Machine Learning–Enabled Virtual Reality Tool for Preoperative Planning of Functional Endoscopic Sinus Surgery. Journal of Neurological Surgery Reports. 2024;85(03):e118-e123. doi:10.1055/a-2358-8928
BibTeX
@article{Gudapati2024,
author = {Gudapati, Varun and Chen, Alexander and Meyer, Scott and Jay Kuo, Chung-Chieh and Ding, Yichen and Hsiai, Tzung K and Wang, Marilene},
title = {Development of a Machine Learning–Enabled Virtual Reality Tool for Preoperative Planning of Functional Endoscopic Sinus Surgery},
journal = {Journal of Neurological Surgery Reports},
year = {2024},
volume = {85},
number = {03},
pages = {e118--e123},
doi = {10.1055/a-2358-8928}
}
EUVIMED