A Survey on Medical Competence Evaluation Benchmarks for Large Language Models
Health Care Science · 2026-02 · 5 (1) · 4-18
DOI: 10.1002/hcs2.70050 ↗Kurz gefasst
Übersichtsarbeit in der Zeitschrift Health Care Science, online erschienen am 09.02.2026. Verfasst von Qiting Wang und 5 weiteren Autor:innen. Beteiligte Einrichtung: School of Public Health Guangdong Pharmaceutical University Guangzhou China. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 83 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Large language models (LLMs) show considerable potential to revolutionize healthcare through their performance across diverse clinical applications. Given the inherent constraints of LLMs and the critical nature of medical practice, a rigorous and systematic evaluation of their medical competence is imperative. This study presents a comprehensive review of the established methodologies and benchmarks for evaluating the medical competence of LLMs, encompassing a thorough analysis of current assessment practices across medical knowledge, clinical practice competence, and ethical–safety considerations. By integrating clinician competency assessment frameworks into LLMs evaluation, we propose a structured tri‐dimensional framework that systematically organizes existing evaluation approaches according to medical theoretical knowledge, clinical practice ability, and ethical–safety considerations. Furthermore, this research provides critical insights into future developmental trajectories while establishing foundational frameworks and standardization protocols for the integration of LLMs into medical practice.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Public Health Guangdong Pharmaceutical University Guangzhou China.
- Institute for Healthcare Artificial Intelligence Application The Affiliated Guangdong Second Provincial General Hospital of Jinan University Guangzhou China.
- Key Technologies Research Laboratory, Guangdong Province Hospital for Occupational Disease Prevention and Treatment Guangzhou China.
- Faculty of Health Sciences City University of Macau Macao China.
ORCID-Profile: Qiting Wang, Weibin Cheng
Zitieren
APA
Wang, Q., Zou, H., Zhang, H., Huang, Y., Tian, J., & Cheng, W. (2026). A Survey on Medical Competence Evaluation Benchmarks for Large Language Models. Health Care Science, 5(1), 4-18. https://doi.org/10.1002/hcs2.70050
Vancouver
Wang Q, Zou H, Zhang H, Huang Y, Tian J, Cheng W. A Survey on Medical Competence Evaluation Benchmarks for Large Language Models. Health Care Science. 2026;5(1):4-18. doi:10.1002/hcs2.70050
BibTeX
@article{Wang2026,
author = {Wang, Qiting and Zou, Huiru and Zhang, Haobin and Huang, Yongshun and Tian, Junzhang and Cheng, Weibin},
title = {A Survey on Medical Competence Evaluation Benchmarks for Large Language Models},
journal = {Health Care Science},
year = {2026},
volume = {5},
number = {1},
pages = {4--18},
doi = {10.1002/hcs2.70050}
}
EUVIMED