EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Large language models vs traditional Chinese medicine clinical reasoning: Analysis of a single migraine case study

Keming Yan, Yuanyuan Li, Yu Liu, Kerun Li, Jiani Wu, Jian Kong

Brain Behavior and Immunity Integrative · 2026-12 · 16 · 100192

DOI: 10.1016/j.bbii.2026.100192 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Brain Behavior and Immunity Integrative, 2026-12. Verfasst von Keming Yan und 5 weiteren Autor:innen. Die Arbeit nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Institutes of Health National Cancer Institute.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Large language models (LLMs) are increasingly used for diagnosis and clinical decision-making; however, their role in Traditional Chinese Medicine (TCM)—with its distinct theoretical framework, remains undetermined. This gap is compounded by growing worldwide interest in TCM and a shortage of highly trained experts.

Objective

This exploratory single-case benchmarking study evaluated how publicly available LLMs performed on diagnostic reasoning and herbal prescribing tasks for one standardized migraine case, compared with two study-elicited TCM physician responses and one published case-reference response.

Methods

Nine LLMs (eight reasoning-enabled “thinking” models and one non-thinking baseline) were prompted through publicly available interfaces using a structured five-task format (Western diagnosis, TCM diagnosis, treatment principle, herbal prescription, and preventive care). No fine-tuning or external knowledge bases were applied. For comparison, two experienced TCM physicians independently generated responses using the same structured format. The original published case-report response was retained as a separate reference response, not as a fully equivalent study-elicited physician comparator. Thirty-two expert raters, blinded to response source, independently scored all outputs across five evaluation dimensions.

Results

In this single standardized migraine case, several LLMs, including GPT o3, Qwen 3, and Gemini 2.5 Pro, received expert ratings comparable to or higher than selected comparator responses in some domains. Aya Expanse 32B received lower ratings; however, this descriptive comparison should not be interpreted as isolating the effect of reasoning mode.

Conclusions

These findings provide an exploratory single-case benchmark of LLM performance in a structured TCM migraine reasoning task. They should not be generalized to broader TCM practice, other diseases, or real-world clinical care without multi-case validation, stronger controls for training-data contamination, and broader physician comparator groups.

Förderung

  • National Institutes of Health National Cancer Institute

Zitieren

APA

Yan, K., Li, Y., Liu, Y., Li, K., Wu, J., & Kong, J. (2026). Large language models vs traditional Chinese medicine clinical reasoning: Analysis of a single migraine case study. Brain Behavior and Immunity Integrative, 16, 100192. https://doi.org/10.1016/j.bbii.2026.100192

Vancouver

Yan K, Li Y, Liu Y, Li K, Wu J, Kong J. Large language models vs traditional Chinese medicine clinical reasoning: Analysis of a single migraine case study. Brain Behavior and Immunity Integrative. 2026;16:100192. doi:10.1016/j.bbii.2026.100192

BibTeX
@article{Yan2026,
  author = {Yan, Keming and Li, Yuanyuan and Liu, Yu and Li, Kerun and Wu, Jiani and Kong, Jian},
  title = {Large language models vs traditional Chinese medicine clinical reasoning: Analysis of a single migraine case study},
  journal = {Brain Behavior and Immunity Integrative},
  year = {2026},
  volume = {16},
  pages = {100192},
  doi = {10.1016/j.bbii.2026.100192}
}
Kostenlos starten →