Interactive Surgical Training in Neuroendoscopy: Real-Time Anatomical Feature Localization Using Natural Language Expressions
IEEE Transactions on Biomedical Engineering · 2024
DOI: 10.1109/tbme.2024.3405814 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Biomedical Engineering, 2024. Verfasst von Nevin M Matasyoh und 4 weiteren Autor:innen. Hauptthemen laut MEDLINE: Neuroendoscopy, Natural Language Processing. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 44 Literaturangaben. Gefördert von: German Academic Exchange Program.
Abstract (Originalsprache)
OBJECTIVE: This study addresses challenges in surgical education, particularly in neuroendoscopy, where the demand for optimized workflow conflicts with the need for trainees' active participation in surgeries. To overcome these challenges, we propose a framework that accurately identifies anatomical structures within images guided by language descriptions, facilitating authentic and interactive learning experiences in neuroendoscopy. METHODS: Utilizing the encoder-decoder architecture of a conventional transformer, our framework processes multimodal inputs (images and language descriptions) to identify and localize features in neuroendoscopic images. We curate a dataset from recorded endoscopic third ventriculostomy (ETV) procedures for training and evaluation. Utilizing evaluation metrics, including "R@n," "IoU= θ," "mIoU," and top-1 accuracy, we systematically benchmark our framework against state-of-the-art methodologies. RESULTS: The framework demonstrates excellent generalization, surpassing the compared methods with 93.67 % accuracy and 76.08 % mIoU on unseen data. It also exhibits better computational speed compared with other methods. Qualitative results affirms the framework's effectiveness in precise localization of referred anatomical features within neuroendoscopic images. CONCLUSION: The framework's adeptness at localizing anatomical features using language descriptions positions it as a valuable tool for integration into future interactive clinical learning systems, enhancing surgical training in neuroendoscopy. SIGNIFICANCE: The exemplary performance reinforces the framework's potential in enhancing surgical education, leading to improved skills and outcomes for trainees in neuroendoscopy.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- German Academic Exchange Program
Zitieren
APA
Matasyoh, N. M., Schmidt, R., Zeineldin, R. A., Spetzger, U., & Mathis-Ullrich, F. (2024). Interactive Surgical Training in Neuroendoscopy: Real-Time Anatomical Feature Localization Using Natural Language Expressions. IEEE Transactions on Biomedical Engineering. https://doi.org/10.1109/tbme.2024.3405814
Vancouver
Matasyoh NM, Schmidt R, Zeineldin RA, Spetzger U, Mathis-Ullrich F. Interactive Surgical Training in Neuroendoscopy: Real-Time Anatomical Feature Localization Using Natural Language Expressions. IEEE Transactions on Biomedical Engineering. 2024. doi:10.1109/tbme.2024.3405814
BibTeX
@article{Matasyoh2024,
author = {Matasyoh, Nevin M and Schmidt, Rudiger and Zeineldin, Ramy A and Spetzger, Uwe and Mathis-Ullrich, Franziska},
title = {Interactive Surgical Training in Neuroendoscopy: Real-Time Anatomical Feature Localization Using Natural Language Expressions},
journal = {IEEE Transactions on Biomedical Engineering},
year = {2024},
doi = {10.1109/tbme.2024.3405814}
}
EUVIMED