EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Clinically grounded evaluation of large language models for traditional Chinese medicine

Chongyun Zhou, Yifan Wang, Chuchu Zhang, Yichen Bai, Huajun Sun, Yang Liu, Haiyan Li

Frontiers in Digital Health · 03.11.2026 · 8

DOI: 10.3389/fdgth.2026.2009170 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Digital Health, online erschienen am 03.11.2026. Verfasst von Chongyun Zhou und 6 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Information on Traditional Chinese Medicine, China Academy of Chinese Medical Sciences, Beijing, China. Die Arbeit nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Medical licensing examination questions provide accessible, standardized benchmarks for evaluating large language models in traditional Chinese medicine. However, examination performance alone cannot establish their ability to support clinical reasoning or improve patient care. This Perspective examines the practical drivers of examination-centered evaluation and four potential sources of bias: the representation of clinical knowledge, coverage of professional competencies, integrity of evaluation data, and compatibility between scoring methods and traditional Chinese medicine practice. These limitations concern the interpretation and scope of benchmark results, rather than the value of standardized knowledge assessment itself. We propose a clinically grounded evaluation framework that combines dynamic clinical scenarios, open-ended generation, multimodal assessment, longitudinal reassessment, and clinical validation. Multi-turn consultations with progressively disclosed information can test reasoning under uncertainty, while prescription generation and multimodal tasks can examine individualized treatment and integration of diagnostic findings. Expert review and automated metrics should assess appropriateness, consistency, and safety, with subsequent evaluation in simulated decision-making and human–AI collaboration. New clinical cases and repeated assessment across model versions should inform updates to evaluation tasks. Recommendation quality, decision efficiency, and patient outcomes should be measured as distinct endpoints. This framework positions examination scores within a broader body of evidence and makes independent clinical validation central to claims of clinical usefulness.

Schlagwörter

Stichwörter der Autor:innen

benchmark evaluationclinical reasoningclinical validationlarge language modelsmedical licensing examinationstraditional Chinese medicine

Autor:innen und Institutionen

  • Institute of Information on Traditional Chinese Medicine, China Academy of Chinese Medical Sciences, Beijing, China.
  • Dongfang Hospital, Beijing University of Chinese Medicine, Beijing, China.
  • Monitoring and Statistical Research Center, National Administration of Traditional Chinese Medicine, Beijing, China.

Zitieren

APA

Zhou, C., Wang, Y., Zhang, C., Bai, Y., Sun, H., Liu, Y., & Li, H. (2026). Clinically grounded evaluation of large language models for traditional Chinese medicine. Frontiers in Digital Health, 8. https://doi.org/10.3389/fdgth.2026.2009170

Vancouver

Zhou C, Wang Y, Zhang C, Bai Y, Sun H, Liu Y, et al. Clinically grounded evaluation of large language models for traditional Chinese medicine. Frontiers in Digital Health. 2026;8. doi:10.3389/fdgth.2026.2009170

BibTeX
@article{Zhou2026,
  author = {Zhou, Chongyun and Wang, Yifan and Zhang, Chuchu and Bai, Yichen and Sun, Huajun and Liu, Yang and Li, Haiyan},
  title = {Clinically grounded evaluation of large language models for traditional Chinese medicine},
  journal = {Frontiers in Digital Health},
  year = {2026},
  volume = {8},
  doi = {10.3389/fdgth.2026.2009170}
}
Kostenlos starten →