EUVIMEDEUVIMED entdecken
Crossref

Interactive Surgical Training in Neuroendoscopy: Real-Time Anatomical Feature Localization Using Natural Language Expressions

Nevin M Matasyoh, Rudiger Schmidt, Ramy A Zeineldin, Uwe Spetzger, Franziska Mathis-Ullrich

IEEE Transactions on Biomedical Engineering · 2024

DOI: 10.1109/tbme.2024.3405814 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Biomedical Engineering, 2024. Verfasst von Nevin M Matasyoh und 4 weiteren Autor:innen. Hauptthemen laut MEDLINE: Neuroendoscopy, Natural Language Processing. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 44 Literaturangaben. Gefördert von: German Academic Exchange Program.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

OBJECTIVE: This study addresses challenges in surgical education, particularly in neuroendoscopy, where the demand for optimized workflow conflicts with the need for trainees' active participation in surgeries. To overcome these challenges, we propose a framework that accurately identifies anatomical structures within images guided by language descriptions, facilitating authentic and interactive learning experiences in neuroendoscopy. METHODS: Utilizing the encoder-decoder architecture of a conventional transformer, our framework processes multimodal inputs (images and language descriptions) to identify and localize features in neuroendoscopic images. We curate a dataset from recorded endoscopic third ventriculostomy (ETV) procedures for training and evaluation. Utilizing evaluation metrics, including "R@n," "IoU= θ," "mIoU," and top-1 accuracy, we systematically benchmark our framework against state-of-the-art methodologies. RESULTS: The framework demonstrates excellent generalization, surpassing the compared methods with 93.67 % accuracy and 76.08 % mIoU on unseen data. It also exhibits better computational speed compared with other methods. Qualitative results affirms the framework's effectiveness in precise localization of referred anatomical features within neuroendoscopic images. CONCLUSION: The framework's adeptness at localizing anatomical features using language descriptions positions it as a valuable tool for integration into future interactive clinical learning systems, enhancing surgical training in neuroendoscopy. SIGNIFICANCE: The exemplary performance reinforces the framework's potential in enhancing surgical education, leading to improved skills and outcomes for trainees in neuroendoscopy.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

NeuroendoscopyNatural Language ProcessingHumansVentriculostomyImage Processing, Computer-Assisted

Förderung

  • German Academic Exchange Program

Zitieren

APA

Matasyoh, N. M., Schmidt, R., Zeineldin, R. A., Spetzger, U., & Mathis-Ullrich, F. (2024). Interactive Surgical Training in Neuroendoscopy: Real-Time Anatomical Feature Localization Using Natural Language Expressions. IEEE Transactions on Biomedical Engineering. https://doi.org/10.1109/tbme.2024.3405814

Vancouver

Matasyoh NM, Schmidt R, Zeineldin RA, Spetzger U, Mathis-Ullrich F. Interactive Surgical Training in Neuroendoscopy: Real-Time Anatomical Feature Localization Using Natural Language Expressions. IEEE Transactions on Biomedical Engineering. 2024. doi:10.1109/tbme.2024.3405814

BibTeX
@article{Matasyoh2024,
  author = {Matasyoh, Nevin M and Schmidt, Rudiger and Zeineldin, Ramy A and Spetzger, Uwe and Mathis-Ullrich, Franziska},
  title = {Interactive Surgical Training in Neuroendoscopy: Real-Time Anatomical Feature Localization Using Natural Language Expressions},
  journal = {IEEE Transactions on Biomedical Engineering},
  year = {2024},
  doi = {10.1109/tbme.2024.3405814}
}
Kostenlos starten →