EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitOpen Access · CC BY-NC-ND 4.0

A Survey on Medical Competence Evaluation Benchmarks for Large Language Models

Qiting Wang iD, Huiru Zou, Haobin Zhang, Yongshun Huang, Junzhang Tian, Weibin Cheng iD

Health Care Science · 2026-02 · 5 (1) · 4-18

DOI: 10.1002/hcs2.70050 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift Health Care Science, online erschienen am 09.02.2026. Verfasst von Qiting Wang und 5 weiteren Autor:innen. Beteiligte Einrichtung: School of Public Health Guangdong Pharmaceutical University Guangzhou China. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 83 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large language models (LLMs) show considerable potential to revolutionize healthcare through their performance across diverse clinical applications. Given the inherent constraints of LLMs and the critical nature of medical practice, a rigorous and systematic evaluation of their medical competence is imperative. This study presents a comprehensive review of the established methodologies and benchmarks for evaluating the medical competence of LLMs, encompassing a thorough analysis of current assessment practices across medical knowledge, clinical practice competence, and ethical–safety considerations. By integrating clinician competency assessment frameworks into LLMs evaluation, we propose a structured tri‐dimensional framework that systematically organizes existing evaluation approaches according to medical theoretical knowledge, clinical practice ability, and ethical–safety considerations. Furthermore, this research provides critical insights into future developmental trajectories while establishing foundational frameworks and standardization protocols for the integration of LLMs into medical practice.

Schlagwörter

Stichwörter der Autor:innen

benchmarklarge language modelmedical competence

Autor:innen und Institutionen

  • School of Public Health Guangdong Pharmaceutical University Guangzhou China.
  • Institute for Healthcare Artificial Intelligence Application The Affiliated Guangdong Second Provincial General Hospital of Jinan University Guangzhou China.
  • Key Technologies Research Laboratory, Guangdong Province Hospital for Occupational Disease Prevention and Treatment Guangzhou China.
  • Faculty of Health Sciences City University of Macau Macao China.

ORCID-Profile: Qiting Wang, Weibin Cheng

Zitieren

APA

Wang, Q., Zou, H., Zhang, H., Huang, Y., Tian, J., & Cheng, W. (2026). A Survey on Medical Competence Evaluation Benchmarks for Large Language Models. Health Care Science, 5(1), 4-18. https://doi.org/10.1002/hcs2.70050

Vancouver

Wang Q, Zou H, Zhang H, Huang Y, Tian J, Cheng W. A Survey on Medical Competence Evaluation Benchmarks for Large Language Models. Health Care Science. 2026;5(1):4-18. doi:10.1002/hcs2.70050

BibTeX
@article{Wang2026,
  author = {Wang, Qiting and Zou, Huiru and Zhang, Haobin and Huang, Yongshun and Tian, Junzhang and Cheng, Weibin},
  title = {A Survey on Medical Competence Evaluation Benchmarks for Large Language Models},
  journal = {Health Care Science},
  year = {2026},
  volume = {5},
  number = {1},
  pages = {4--18},
  doi = {10.1002/hcs2.70050}
}
Kostenlos starten →