Comparative Evaluation of ChatGPT, DeepSeek, and Physician-Generated Acupuncture Treatment Protocols Across Chinese and English Language Settings: Cross-Sectional Evaluation Study
JMIR Formative Research · 2026
DOI: 10.2196/95851 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift JMIR Formative Research, 2026. Verfasst von Xin Liu und 1 weiteren Autor:innen. Beteiligte Einrichtung: Thomas College of Business & Economics, University of North Carolina at Pembroke, Pembroke, NC, United States. Hauptthemen laut MEDLINE: Acupuncture Therapy, Physicians, Medicine, Chinese Traditional. Die Arbeit nennt 78 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Traditional Chinese medicine (TCM) has received increasing attention in evidence-based medicine. However, its largely experience-based and practice-oriented nature has slowed modernization and standardization. Advances in AI provide new opportunities for integrating AI with TCM.
Objective
This study evaluates the application of large language models (LLMs), including ChatGPT (OpenAI) and DeepSeek, in generating acupuncture treatment protocols. We compare the validity and clinical effectiveness of physician-generated protocols with those produced by LLMs, examine differences in outputs across language corpora (Chinese and English), and establish a standardized assessment framework for systematically assessing the effectiveness of acupuncture point selection. Ultimately, this research aims to support the standardization of acupoint selection and promote greater consistency, reliability, and evidence-based development in acupuncture practice.
Methods
Qualified acupuncture treatment cases published in Acupuncture in Medicine were identified and translated from English into Chinese to create a bilingual case dataset. Standardized case prompts were independently input into DeepSeek and ChatGPT to generate acupuncture treatment protocols. Ten senior TCM physicians evaluated the AI-generated and physician-generated protocols using 7 criteria: local point selection, distal point selection, syndrome-based point selection, meridian-tracing point selection, neuroanatomical point selection, core acupoint selection, and synergistic effects. Repeated-measures ANOVA with sphericity assessment was used to examine differences across LLMs, language corpora, and protocol groups.
Results
Blinded expert evaluations revealed significant differences among the 5 acupuncture groups for local point selection (P=.006), syndrome-based point selection (P=.005), neuroanatomical point selection (P
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Thomas College of Business & Economics, University of North Carolina at Pembroke, Pembroke, NC, United States.
- Northeast Agricultural University, Harbin, Heilongjiang, China.
ORCID-Profile: Xin Liu, Zining Guo
Zitieren
APA
Liu, X., & Guo, Z. (2026). Comparative Evaluation of ChatGPT, DeepSeek, and Physician-Generated Acupuncture Treatment Protocols Across Chinese and English Language Settings: Cross-Sectional Evaluation Study. JMIR Formative Research. https://doi.org/10.2196/95851
Vancouver
Liu X, Guo Z. Comparative Evaluation of ChatGPT, DeepSeek, and Physician-Generated Acupuncture Treatment Protocols Across Chinese and English Language Settings: Cross-Sectional Evaluation Study. JMIR Formative Research. 2026. doi:10.2196/95851
BibTeX
@article{Liu2026,
author = {Liu, Xin and Guo, Zining},
title = {Comparative Evaluation of ChatGPT, DeepSeek, and Physician-Generated Acupuncture Treatment Protocols Across Chinese and English Language Settings: Cross-Sectional Evaluation Study},
journal = {JMIR Formative Research},
year = {2026},
doi = {10.2196/95851}
}
EUVIMED