Large language models versus expert clinicians in optimizing Chinese patient education materials for temporomandibular disorders: a mixed-methods study integrating readability, accuracy, actionability, and cultural adaptability
Frontiers in Public Health · 04.08.2026 · 14
DOI: 10.3389/fpubh.2026.1923536 ↗Kurz gefasst
Mixed-Methods-Studie in der Zeitschrift Frontiers in Public Health, online erschienen am 04.08.2026. Verfasst von Jing Han und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Stomatology, Jinan Maternal and Child Health Care Hospital, Jinan, China. Hauptthemen laut MEDLINE: Comprehension, Health Literacy, Large Language Models, Patient Education as Topic. Die Arbeit nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Objective
To evaluate the performance of large language models (LLMs) and expert clinicians in optimizing Chinese patient education materials (PEMs) for temporomandibular disorders (TMD) across readability, accuracy, actionability, and cultural adaptability, and to determine whether a human-AI collaboration model can achieve an optimal balance among these dimensions.
Methods
Fifteen TMD education topics were selected through a Delphi consensus process. Four groups of PEMs were generated: original texts (Group A), LLM-rewritten texts (Group B, Claude Opus 4.6), clinician-rewritten texts (Group C), and human-AI collaboration texts (Group D). Blinded assessments were conducted by a professional panel ( n = 3) and a health literacy-stratified patient panel ( n = 6). Readability was measured by sentence length and common character proportion, accuracy by 5-point expert ratings against standardized checklists, actionability by the PEMAT instrument, and cultural adaptability by qualitative thematic analysis. Prompt sensitivity was tested across three distinct styles.
Results
LLM-rewritten texts demonstrated significantly shorter sentences (21.1 vs. 33.9 characters, p < 0.001) and substantially higher actionability (95.6% vs. 16.7%, p < 0.001) compared with original texts. Clinician-rewritten texts achieved the highest accuracy (4.48 vs. 3.23, p < 0.001) but low actionability (46.7%). The human-AI collaboration model matched clinician accuracy (4.49, p = 1.000) while preserving LLM actionability (95.6%), with 72% less clinician time. Sensitivity analysis confirmed actionability robustness under empathetic and authoritative prompts but attenuation under a concise prompt. Qualitative analysis identified four cultural adaptability themes, with LLMs excelling in terminology localization and behavioral structuring but showing limitations in TCM conceptual depth.
Conclusion
The human-AI collaboration model represents a promising and balanced approach for producing Chinese TMD patient education materials, combining LLM strengths in structural optimization with expert clinician oversight for accuracy and cultural appropriateness.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Stomatology, Jinan Maternal and Child Health Care Hospital, Jinan, China.
- Department of Stomatology, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, China.
Zitieren
APA
Han, J., Shi, Y. L., & Dai, L. (2026). Large language models versus expert clinicians in optimizing Chinese patient education materials for temporomandibular disorders: a mixed-methods study integrating readability, accuracy, actionability, and cultural adaptability. Frontiers in Public Health, 14. https://doi.org/10.3389/fpubh.2026.1923536
Vancouver
Han J, Shi YL, Dai L. Large language models versus expert clinicians in optimizing Chinese patient education materials for temporomandibular disorders: a mixed-methods study integrating readability, accuracy, actionability, and cultural adaptability. Frontiers in Public Health. 2026;14. doi:10.3389/fpubh.2026.1923536
BibTeX
@article{Han2026,
author = {Han, Jing and Shi, Yan-Li and Dai, Li},
title = {Large language models versus expert clinicians in optimizing Chinese patient education materials for temporomandibular disorders: a mixed-methods study integrating readability, accuracy, actionability, and cultural adaptability},
journal = {Frontiers in Public Health},
year = {2026},
volume = {14},
doi = {10.3389/fpubh.2026.1923536}
}
EUVIMED