EUVIMEDTutustu EUVIMEDiin
Scoping ReviewOpen access

Trends and Trajectories in the Rise of Large Language Models in Radiology: Scoping Review

Adhari Al Zaabi iD, Rashid Alshibli iD, Abdullah AlAmri iD, Ibrahim AlRuheili iD, Syaheerah Lebai Lutfi iD

JMIR Medical Informatics · 2025-12-09 · 13 · e78041-e78041

DOI: 10.2196/78041 ↗

At a glance

Scoping Review in JMIR Medical Informatics, published online on 2025-12-09. Written by Adhari Al Zaabi and 4 co-authors. Institution: Human and Clinical Anatomy Department, College of Medicine and Health Sciences, Sultan Qaboos University, P.O. Box 35, Al Khodh, Muscat, 123, Oman. Major MEDLINE topics: Radiology, Language. Cited 14 times so far (Crossref); 77 references. The full text is freely available in PubMed Central.

TiivistelmäSubjectsBibliografiset tiedotCiteRelated studies

Abstract (original language)

Background

The use of large language models (LLMs) in radiology is expanding rapidly, offering new possibilities in report generation, decision support, and workflow optimization. However, a comprehensive evaluation of their applications, performance, and limitations across the radiology domain remains limited.

Objective

This review aimed to map current applications of LLMs in radiology, evaluate their performance across key tasks, and identify prevailing limitations and directions for future research.

Methods

A scoping review was conducted in accordance with the framework by Arksey and O’Malley framework and the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines. Three databases—PubMed, ScopusCOPUS, and IEEE Xplore—were searched for peer-reviewed studies published between January 2022 and December 2024. Eligible studies included empirical evaluations of LLMs applied to radiological data or workflows. Commentaries, reviews, and technical model proposals without evaluation were excluded. Two reviewers independently screened studies and extracted data on study characteristics, LLM type, radiological use case, data modality, and evaluation metrics. A thematic synthesis was used to identify key domains of application. No formal risk-of-bias assessment was performed, but a narrative appraisal of dataset representativeness and study quality was included.

Results

A total of 67 studies were included. (n/N, %)GPT-4 was the most frequently used model (n=28, 42%), with text-based corpora as the primary type of data used (n=43, 64%). Identified use cases fell into three thematic domains: (1) decision support (n=39, 58%), (2) report generation and summarization (n=16, 24%), and (3) workflow optimization (n=12, 18%). While LLMs demonstrated strong performance in structured-text tasks (eg, report simplification with >94% accuracy), diagnostic performance varied widely (16%-86%) and was limited by dataset bias, lack of fine tuning, and minimal clinical validation. Most studies (n=53, 79.1%) had single-center, proof-of-concept designs with limited generalizability.

Conclusions

LLMs show strong potential for augmenting radiological workflows, particularly for structured reporting, summarization, and educational tasks. However, their diagnostic performance remains inconsistent, and current implementations lack robust external validation. Future work should prioritize prospective, multicenter validation of domain-adapted and multimodal models to support safe clinical integration.

Subjects

MeSH terms (MEDLINE)

RadiologyLanguageHumansWorkflowLarge Language Models

Author keywords

AIGPT-4artificial intelligenceclinical decision supportlarge language modelsnatural language processingradiologyreport generationscoping reviewworkflow optimization

Authors and institutions

  • Human and Clinical Anatomy Department, College of Medicine and Health Sciences, Sultan Qaboos University, P.O. Box 35, Al Khodh, Muscat, 123, Oman.
  • College of Medicine and Health Sciences, Sultan Qaboos University, Muscat, Oman.
  • Medical Education and Informatics Department, College of Medicine and Health Sciences, Sultan Qaboos University, Muscat, Oman.

ORCID profiles: Adhari Al Zaabi, Rashid Alshibli, Abdullah AlAmri, Ibrahim AlRuheili, Syaheerah Lebai Lutfi

Cite

APA

Al Zaabi, A., Alshibli, R., AlAmri, A., AlRuheili, I., & Lutfi, S. L. (2025). Trends and Trajectories in the Rise of Large Language Models in Radiology: Scoping Review. JMIR Medical Informatics, 13, e78041-e78041. https://doi.org/10.2196/78041

Vancouver

Al Zaabi A, Alshibli R, AlAmri A, AlRuheili I, Lutfi SL. Trends and Trajectories in the Rise of Large Language Models in Radiology: Scoping Review. JMIR Medical Informatics. 2025;13:e78041-e78041. doi:10.2196/78041

BibTeX
@article{AlZaabi2025,
  author = {Al Zaabi, Adhari and Alshibli, Rashid and AlAmri, Abdullah and AlRuheili, Ibrahim and Lutfi, Syaheerah Lebai},
  title = {Trends and Trajectories in the Rise of Large Language Models in Radiology: Scoping Review},
  journal = {JMIR Medical Informatics},
  year = {2025},
  volume = {13},
  pages = {e78041--e78041},
  doi = {10.2196/78041}
}
Start for free →