Large language models vs traditional Chinese medicine clinical reasoning: Analysis of a single migraine case study
Brain Behavior and Immunity Integrative · 2026-12 · 16 · 100192
DOI: 10.1016/j.bbii.2026.100192 ↗Kurz gefasst
Fachartikel in der Zeitschrift Brain Behavior and Immunity Integrative, 2026-12. Verfasst von Keming Yan und 5 weiteren Autor:innen. Die Arbeit nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Institutes of Health National Cancer Institute.
Abstract (Originalsprache)
Background
Large language models (LLMs) are increasingly used for diagnosis and clinical decision-making; however, their role in Traditional Chinese Medicine (TCM)—with its distinct theoretical framework, remains undetermined. This gap is compounded by growing worldwide interest in TCM and a shortage of highly trained experts.
Objective
This exploratory single-case benchmarking study evaluated how publicly available LLMs performed on diagnostic reasoning and herbal prescribing tasks for one standardized migraine case, compared with two study-elicited TCM physician responses and one published case-reference response.
Methods
Nine LLMs (eight reasoning-enabled “thinking” models and one non-thinking baseline) were prompted through publicly available interfaces using a structured five-task format (Western diagnosis, TCM diagnosis, treatment principle, herbal prescription, and preventive care). No fine-tuning or external knowledge bases were applied. For comparison, two experienced TCM physicians independently generated responses using the same structured format. The original published case-report response was retained as a separate reference response, not as a fully equivalent study-elicited physician comparator. Thirty-two expert raters, blinded to response source, independently scored all outputs across five evaluation dimensions.
Results
In this single standardized migraine case, several LLMs, including GPT o3, Qwen 3, and Gemini 2.5 Pro, received expert ratings comparable to or higher than selected comparator responses in some domains. Aya Expanse 32B received lower ratings; however, this descriptive comparison should not be interpreted as isolating the effect of reasoning mode.
Conclusions
These findings provide an exploratory single-case benchmark of LLM performance in a structured TCM migraine reasoning task. They should not be generalized to broader TCM practice, other diseases, or real-world clinical care without multi-case validation, stronger controls for training-data contamination, and broader physician comparator groups.
Förderung
- National Institutes of Health National Cancer Institute
Zitieren
APA
Yan, K., Li, Y., Liu, Y., Li, K., Wu, J., & Kong, J. (2026). Large language models vs traditional Chinese medicine clinical reasoning: Analysis of a single migraine case study. Brain Behavior and Immunity Integrative, 16, 100192. https://doi.org/10.1016/j.bbii.2026.100192
Vancouver
Yan K, Li Y, Liu Y, Li K, Wu J, Kong J. Large language models vs traditional Chinese medicine clinical reasoning: Analysis of a single migraine case study. Brain Behavior and Immunity Integrative. 2026;16:100192. doi:10.1016/j.bbii.2026.100192
BibTeX
@article{Yan2026,
author = {Yan, Keming and Li, Yuanyuan and Liu, Yu and Li, Kerun and Wu, Jiani and Kong, Jian},
title = {Large language models vs traditional Chinese medicine clinical reasoning: Analysis of a single migraine case study},
journal = {Brain Behavior and Immunity Integrative},
year = {2026},
volume = {16},
pages = {100192},
doi = {10.1016/j.bbii.2026.100192}
}
EUVIMED