EUVIMEDEUVIMED entdecken
Crossref

Large language models (LLMs) in radiology exams for medical students: Performance and consequences

Jennifer Gotta iD, Quang Anh Le Hong, Vitali Koch, Leon D Gruenewald, Tobias Geyer, Simon S Martin, Jan-Erik Scholtz, Christian Booz, Daniel Pinto Dos Santos, Scherwin Mahmoudi, Katrin Eichler, Tatjana Gruber-Rouh und 7 weitere

RöFo - Fortschritte auf dem Gebiet der Röntgenstrahlen und der bildgebenden Verfahren · 2025-09 · 197 (09) · 1057-1067

DOI: 10.1055/a-2437-2067 ↗

Kurz gefasst

Fachartikel in der Zeitschrift RöFo - Fortschritte auf dem Gebiet der Röntgenstrahlen und der bildgebenden Verfahren, online erschienen am 04.11.2024. Verfasst von Jennifer Gotta und 18 weiteren Autor:innen. Beteiligte Einrichtung: Department of Diagnostic and Interventional Radiology, Goethe University Frankfurt, Frankfurt am Main, Germany. Hauptthemen laut MEDLINE: Radiology, Educational Measurement, Students, Medical, Language. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 9 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The evolving field of medical education is being shaped by technological advancements, including the integration of Large Language Models (LLMs) like ChatGPT. These models could be invaluable resources for medical students, by simplifying complex concepts and enhancing interactive learning by providing personalized support. LLMs have shown impressive performance in professional examinations, even without specific domain training, making them particularly relevant in the medical field. This study aims to assess the performance of LLMs in radiology examinations for medical students, thereby shedding light on their current capabilities and implications. This study was conducted using 151 multiple-choice questions, which were used for radiology exams for medical students. The questions were categorized by type and topic and were then processed using OpenAIʼs GPT-3.5 and GPT- 4 via their API, or manually put into Perplexity AI with GPT-3.5 and Bing. LLM performance was evaluated overall, by question type and by topic. GPT-3.5 achieved a 67.6% overall accuracy on all 151 questions, while GPT-4 outperformed it significantly with an 88.1% overall accuracy (p

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

RadiologyEducational MeasurementStudents, MedicalLanguageHumansCurriculumGermanyLarge Language Models

Autor:innen und Institutionen

  • Department of Diagnostic and Interventional Radiology, Goethe University Frankfurt, Frankfurt am Main, Germany.
  • Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology, Rostock University Medical Center, Rostock, Germany.

ORCID-Profile: Jennifer Gotta, Thomas J Vogl

Zitieren

APA

Gotta, J., Le Hong, Q. A., Koch, V., Gruenewald, L. D., Geyer, T., Martin, S. S., Scholtz, J. E., Booz, C., Pinto Dos Santos, D., Mahmoudi, S., Eichler, K., Gruber-Rouh, T., Hammerstingl, R., Biciusca, T., Juergens, L. J., Höhne, E., Mader, C., Vogl, T. J., & Reschke, P. (2025). Large language models (LLMs) in radiology exams for medical students: Performance and consequences. RöFo - Fortschritte auf dem Gebiet der Röntgenstrahlen und der bildgebenden Verfahren, 197(09), 1057-1067. https://doi.org/10.1055/a-2437-2067

Vancouver

Gotta J, Le Hong QA, Koch V, Gruenewald LD, Geyer T, Martin SS, et al. Large language models (LLMs) in radiology exams for medical students: Performance and consequences. RöFo - Fortschritte auf dem Gebiet der Röntgenstrahlen und der bildgebenden Verfahren. 2025;197(09):1057-1067. doi:10.1055/a-2437-2067

BibTeX
@article{Gotta2025,
  author = {Gotta, Jennifer and Le Hong, Quang Anh and Koch, Vitali and Gruenewald, Leon D and Geyer, Tobias and Martin, Simon S and Scholtz, Jan-Erik and Booz, Christian and Pinto Dos Santos, Daniel and Mahmoudi, Scherwin and Eichler, Katrin and Gruber-Rouh, Tatjana and Hammerstingl, Renate and Biciusca, Teodora and Juergens, Lisa Joy and Höhne, Elena and Mader, Christoph and Vogl, Thomas J and Reschke, Philipp},
  title = {Large language models (LLMs) in radiology exams for medical students: Performance and consequences},
  journal = {RöFo - Fortschritte auf dem Gebiet der Röntgenstrahlen und der bildgebenden Verfahren},
  year = {2025},
  volume = {197},
  number = {09},
  pages = {1057--1067},
  doi = {10.1055/a-2437-2067}
}
Kostenlos starten →