EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Automated MRI protocoling in neuroradiology in the era of large language models

Lara Noelle Reiner, Moudather Chelbi, Leonard Fetscher, Juliane C Stöckel, Christoph Csapó-Schmidt, Shakhnaz Guseynova, Fares Al Mohamad, Keno Kyrill Bressem, Jawed Nawabi, Eberhard Siebert, Mike P Wattjes, Michael Scheel und 1 weitere

La radiologia medica · 11.07.2025 · 130 (9) · 1472-1482

DOI: 10.1007/s11547-025-02040-9 ↗

Kurz gefasst

Fachartikel in der Zeitschrift La radiologia medica, online erschienen am 11.07.2025. Verfasst von Lara Noelle Reiner und 12 weiteren Autor:innen. Beteiligte Einrichtung: Department of Neuroradiology, Charité-Universitätsmedizin Berlin, Augustenburger Platz 1, 13353, Berlin, Germany. lara.reiner@charite.de. Hauptthemen laut MEDLINE: Magnetic Resonance Imaging, Neuroimaging, Clinical Protocols. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Charité - Universitätsmedizin Berlin.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

This study investigates the automation of MRI protocoling, a routine task in radiology, using large language models (LLMs), comparing an open-source (LLama 3.1 405B) and a proprietary model (GPT-4o) with and without retrieval-augmented generation (RAG), a method for incorporating domain-specific knowledge. Material and Methods This retrospective study included MRI studies conducted between January and December 2023, along with institution-specific protocol assignment guidelines. Clinical questions were extracted, and a neuroradiologist established the gold standard protocol. LLMs were tasked with assigning MRI protocols and contrast medium administration with and without RAG. The results were compared to protocols selected by four radiologists. Token-based symmetric accuracy, the Wilcoxon signed-rank test, and the McNemar test were used for evaluation.

Results

Data from 100 neuroradiology reports (mean age = 54.2 years ± 18.41, women 50%) were included. RAG integration significantly improved accuracy in sequence and contrast media prediction for LLama 3.1 (Sequences: 38% vs. 70%, P < .001, Contrast Media: 77% vs. 94%, P < .001), and GPT-4o (Sequences: 43% vs. 81%, P < .001, Contrast Media: 79% vs. 92%, P = .006). GPT-4o outperformed LLama 3.1 in MRI sequence prediction (81% vs. 70%, P < .001), with comparable accuracies to the radiologists (81% ± 0.21, P = .43). Both models equaled radiologists in predicting contrast media administration (LLama 3.1 RAG: 94% vs. 91% ± 0.2, P = .37, GPT-4o RAG: 92% vs. 91% ± 0.24, P = .48).

Conclusion

Large language models show great potential as decision-support tools for MRI protocoling, with performance similar to radiologists. RAG enhances the ability of LLMs to provide accurate, institution-specific protocol recommendations.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Magnetic Resonance ImagingNeuroimagingClinical ProtocolsHumansRetrospective StudiesFemaleMiddle AgedMaleContrast MediaAutomationAdultAgedLanguageLarge Language Models

Stichwörter der Autor:innen

Artificial intelligenceAutomationClinicalDecision-support systemsLarge language modelsMagnetic resonance imagingNatural language processingNeuroradiology

Substanzen

Contrast Media

Autor:innen und Institutionen

  • Department of Neuroradiology, Charité-Universitätsmedizin Berlin, Augustenburger Platz 1, 13353, Berlin, Germany. lara.reiner@charite.de.
  • Department of Neuroradiology, Charité-Universitätsmedizin Berlin, Augustenburger Platz 1, 13353, Berlin, Germany.
  • Department of Radiology, Technical University Munich, Klinikum Rechts Der Isar, Ismaninger Str. 22, 81675, Munich, Germany.
  • Department or Radiology and Nuclear Medicine, Technical University Munich, German Heart Center Munich, Lazarethstr. 36, 80636, Munich, Germany.
  • Department of Neuroradiology, Hôpital Maison-Blanche, CHU Reims, Université Reims-Champagne-Ardenne, Reims, France.
  • Berlin Institute of Health at Charité-Universitätsmedizin Berlin, Charitéplatz 1, 10117, Berlin, Germany.

Förderung

  • Charité - Universitätsmedizin Berlin

Zitieren

APA

Reiner, L. N., Chelbi, M., Fetscher, L., Stöckel, J. C., Csapó-Schmidt, C., Guseynova, S., Al Mohamad, F., Bressem, K. K., Nawabi, J., Siebert, E., Wattjes, M. P., Scheel, M., & Meddeb, A. (2025). Automated MRI protocoling in neuroradiology in the era of large language models. La radiologia medica, 130(9), 1472-1482. https://doi.org/10.1007/s11547-025-02040-9

Vancouver

Reiner LN, Chelbi M, Fetscher L, Stöckel JC, Csapó-Schmidt C, Guseynova S, et al. Automated MRI protocoling in neuroradiology in the era of large language models. La radiologia medica. 2025;130(9):1472-1482. doi:10.1007/s11547-025-02040-9

BibTeX
@article{Reiner2025,
  author = {Reiner, Lara Noelle and Chelbi, Moudather and Fetscher, Leonard and Stöckel, Juliane C and Csapó-Schmidt, Christoph and Guseynova, Shakhnaz and Al Mohamad, Fares and Bressem, Keno Kyrill and Nawabi, Jawed and Siebert, Eberhard and Wattjes, Mike P and Scheel, Michael and Meddeb, Aymen},
  title = {Automated MRI protocoling in neuroradiology in the era of large language models},
  journal = {La radiologia medica},
  year = {2025},
  volume = {130},
  number = {9},
  pages = {1472--1482},
  doi = {10.1007/s11547-025-02040-9}
}
Kostenlos starten →