NeuroLens: organ localization using natural language commands for anatomical recognition in surgical training
International Journal of Computer Assisted Radiology and Surgery · 2025
DOI: 10.1007/s11548-025-03463-5 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, 2025. Verfasst von Nevin M Matasyoh und 4 weiteren Autor:innen. Beteiligte Einrichtung: Surgical Planning and Robotic Cognition Laboratory (SPARC), Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Univ…. Hauptthemen laut MEDLINE: Ventriculostomy, Deep Learning, Natural Language Processing. Die Arbeit nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Friedrich-Alexander-Universität Erlangen-Nürnberg.
Abstract (Originalsprache)
Purpose
This study introduces NeuroLens, a multimodal system designed to enhance anatomical recognition by integrating video with textual and voice inputs. It aims to provide an interactive learning platform for surgical trainees.
Methods
NeuroLens employs a multimodal deep learning localization model trained on an Endoscopic Third Ventriculostomy dataset. It processes neuroendoscopic videos with textual or voice descriptions to identify and localize anatomical structures, displaying them as labeled bounding boxes. Usability was evaluated through a questionnaire by five participants, including surgical students and practicing surgeons. The questionnaire included both quantitative and qualitative sections. The quantitative part covered the System Usability Scale (SUS) and assessments of system appearance, functionality, and overall usability, while the qualitative section gathered user feedback and improvement suggestions. The localization model’s performance was assessed using accuracy and mean Intersection over Union (mIoU) metrics.
Results
The system demonstrates strong usability, with an average SUS score of 71.5, exceeding the threshold for acceptable usability. The localization achieves a predicted class accuracy of 100%, a localization accuracy of 79.69%, and a mIoU of 67.10%. Participant feedback highlights the intuitive design, organization, and responsiveness while suggesting enhancements like 3D visualization.
Conclusion
NeuroLens integrates multimodal inputs for accurate anatomical detection and localization, addressing limitations of traditional training. Its strong usability and technical performance make it a valuable tool for enhancing anatomical learning in surgical training. While NeuroLens shows strong usability and performance, its small sample size limits generalizability. Further evaluation with more students and enhancements like 3D visualization will strengthen its effectiveness.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Surgical Planning and Robotic Cognition Laboratory (SPARC), Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-University Erlangen-Nuremberg, Nürnberger Str. 74, 91052, Erlangen, Bavari…
- Neurosurgical Clinic, University Hospital Erlangen, Schwabachanlage 6, 91054, Erlangen, Bavaria, Germany.
- Faculty of Electronic Engineering (FEE), Menoufia University, El-Gaish St, Menouf, 32952, Menoufia, Egypt.
Förderung
- Friedrich-Alexander-Universität Erlangen-Nürnberg
Zitieren
APA
Matasyoh, N. M., Delev, D., Masalha, W., Mathis-Ullrich, F., & Zeineldin, R. A. (2025). NeuroLens: organ localization using natural language commands for anatomical recognition in surgical training. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-025-03463-5
Vancouver
Matasyoh NM, Delev D, Masalha W, Mathis-Ullrich F, Zeineldin RA. NeuroLens: organ localization using natural language commands for anatomical recognition in surgical training. International Journal of Computer Assisted Radiology and Surgery. 2025. doi:10.1007/s11548-025-03463-5
BibTeX
@article{Matasyoh2025,
author = {Matasyoh, Nevin M and Delev, Daniel and Masalha, Waseem and Mathis-Ullrich, Franziska and Zeineldin, Ramy A},
title = {NeuroLens: organ localization using natural language commands for anatomical recognition in surgical training},
journal = {International Journal of Computer Assisted Radiology and Surgery},
year = {2025},
doi = {10.1007/s11548-025-03463-5}
}
EUVIMED