Refining medical large language models: key insights from instruction tuning
PeerJ Computer Science · 23.09.2025 · 11 · e3216
DOI: 10.7717/peerj-cs.3216 ↗Kurz gefasst
Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 23.09.2025. Verfasst von Muneerah Q. Alqahtani und 2 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 101 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
This literature review introduces a comprehensive summary of the most recent scholarly work on instruction-tuning strategies for medical large language models (Med-LLMs). It begins by reviewing three fundamental approaches to creating an instruction dataset: human-crafted datasets, synthesized datasets generated by LLMs, and datasets that incorporate Retrieval-Augmented Generation (RAG). This article explores the role of medical instruction datasets by reviewing thirteen different medical models, evaluating their effectiveness across multiple clinical tasks, and examining how their utilization can improve outcomes in the medical domain. This research discusses key insights for optimizing instruction-based fine-tuning of language models. It analyzes the effectiveness of the phased instruction method and the benefits of integrating mixed-prompt techniques. Additionally, it assesses the effect of choosing an appropriate backbone model before fine-tuning. Furthermore, it demonstrates how the selection of words when crafting instructions influences a model’s performance. The survey emphasizes that carefully curated instructional data, coupled with well-crafted strategies, can greatly enhance the potential of Med-LLMs in real-world healthcare applications. Nevertheless, several challenges must be addressed to ensure the safe, ethical, and effective deployment of Med-LLMs. This article outlines future research directions, including mitigating racial and gender biases, leveraging external knowledge sources, and reinforcing privacy through robust anonymization of patient information and regulatory adherence ( e.g ., Health Insurance Portability and Accountability Act (HIPAA)). Addressing these challenges will pave the way for reliable, safe, and ethical artificial intelligence (AI)-driven healthcare applications.
Zitieren
APA
Alqahtani, M. Q., Albarakati, A., & Alotaibi, F. (2025). Refining medical large language models: key insights from instruction tuning. PeerJ Computer Science, 11, e3216. https://doi.org/10.7717/peerj-cs.3216
Vancouver
Alqahtani MQ, Albarakati A, Alotaibi F. Refining medical large language models: key insights from instruction tuning. PeerJ Computer Science. 2025;11:e3216. doi:10.7717/peerj-cs.3216
BibTeX
@article{Alqahtani2025,
author = {Alqahtani, Muneerah Q. and Albarakati, Abdullah and Alotaibi, Fahd},
title = {Refining medical large language models: key insights from instruction tuning},
journal = {PeerJ Computer Science},
year = {2025},
volume = {11},
pages = {e3216},
doi = {10.7717/peerj-cs.3216}
}
EUVIMED