Implementing Large Language Models in Health Care: Clinician-Focused Review With Interactive Guideline
Journal of Medical Internet Research · 11.07.2025 · 27 · e71916
DOI: 10.2196/71916 ↗Kurz gefasst
Übersichtsarbeit in der Zeitschrift Journal of Medical Internet Research, online erschienen am 11.07.2025. Verfasst von HongYi Li und 2 weiteren Autor:innen. Beteiligte Einrichtung: Center for Data Science, Zhejiang University, Hangzhou, China. Hauptthemen laut MEDLINE: Delivery of Health Care, Language. Die Arbeit wurde bisher 45-mal zitiert (Crossref) und nennt 150 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Large language models (LLMs) can generate outputs understandable by humans, such as answers to medical questions and radiology reports. With the rapid development of LLMs, clinicians face a growing challenge in determining the most suitable algorithms to support their work.
Objective
We aimed to provide clinicians and other health care practitioners with systematic guidance in selecting an LLM that is relevant and appropriate to their needs and facilitate the integration process of LLMs in health care.
Methods
We conducted a literature search of full-text publications in English on clinical applications of LLMs published between January 1, 2022, and March 31, 2025, on PubMed, ScienceDirect, Scopus, and IEEE Xplore. We excluded papers from journals below a set citation threshold, as well as papers that did not focus on LLMs, were not research based, or did not involve clinical applications. We also conducted a literature search on arXiv within the same investigated period and included papers on the clinical applications of innovative multimodal LLMs. This led to a total of 270 studies.
Results
We collected 330 LLMs and recorded their application frequency in clinical tasks and frequency of best performance in their context. On the basis of a 5-stage clinical workflow, we found that stages 2, 3, and 4 are key stages in the clinical workflow, involving numerous clinical subtasks and LLMs. However, the diversity of LLMs that may perform optimally in each context remains limited. GPT-3.5 and GPT-4 were the most versatile models in the 5-stage clinical workflow, applied to 52% (29/56) and 71% (40/56) of the clinical subtasks, respectively, and they performed best in 29% (16/56) and 54% (30/56) of the clinical subtasks, respectively. General-purpose LLMs may not perform well in specialized areas as they often require lightweight prompt engineering methods or fine-tuning techniques based on specific datasets to improve model performance. Most LLMs with multimodal abilities are closed-source models and, therefore, lack of transparency, model customization, and fine-tuning for specific clinical tasks and may also pose challenges regarding data protection and privacy, which are common requirements in clinical settings.
Conclusions
In this review, we found that LLMs may help clinicians in a variety of clinical tasks. However, we did not find evidence of generalist clinical LLMs successfully applicable to a wide range of clinical tasks. Therefore, their clinical deployment remains challenging. On the basis of this review, we propose an interactive online guideline for clinicians to select suitable LLMs by clinical task. With a clinical perspective and free of unnecessary technical jargon, this guideline may be used as a reference to successfully apply LLMs in clinical settings.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Center for Data Science, Zhejiang University, Hangzhou, China.
- School of Mathematical Sciences, Zhejiang University, Hangzhou, China.
- School of Medicine, Children's Hospital of Zhejiang University, Hangzhou, China.
- National Clinical Research Center for Child Health, Hangzhou, China.
- National Regional Center for Children's Health, Hangzhou, China.
- School of Medicine, Zhejiang University, Hangzhou, China.
ORCID-Profile: HongYi Li, Jun-Fen Fu, Andre Python
Zitieren
APA
Li, H., Fu, J. F., & Python, A. (2025). Implementing Large Language Models in Health Care: Clinician-Focused Review With Interactive Guideline. Journal of Medical Internet Research, 27, e71916. https://doi.org/10.2196/71916
Vancouver
Li H, Fu JF, Python A. Implementing Large Language Models in Health Care: Clinician-Focused Review With Interactive Guideline. Journal of Medical Internet Research. 2025;27:e71916. doi:10.2196/71916
BibTeX
@article{Li2025,
author = {Li, HongYi and Fu, Jun-Fen and Python, Andre},
title = {Implementing Large Language Models in Health Care: Clinician-Focused Review With Interactive Guideline},
journal = {Journal of Medical Internet Research},
year = {2025},
volume = {27},
pages = {e71916},
doi = {10.2196/71916}
}
EUVIMED