Reliability and readability of adenoid hypertrophy information generated by five publicly accessible LLM chatbots: A default-setting snapshot study
DIGITAL HEALTH · 2026-02 · 12
DOI: 10.1177/20552076261459596 ↗Kurz gefasst
Fachartikel in der Zeitschrift DIGITAL HEALTH, online erschienen am 02.07.2026. Verfasst von Xiaoming Qian und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Otolaryngology, The Third Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China. Die Arbeit nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Zhengzhou Healthcare Science and Technology Innovation Guidance Program, China Medical Foundation Clinical Medical Research Promotion Program.
Abstract (Originalsprache)
Objective
This study evaluated the performance of five major large language model (LLM) chatbots in generating patient-oriented information on adenoid hypertrophy, focusing on content reliability and readability.
Methods
Sixty-three frequently asked questions (FAQs) on adenoid hypertrophy were collected, covering seven domains including etiology, symptoms, and treatment. From October 1, 2025, to January 10, 2026, questions were submitted in English to five LLMs via their official web interfaces. Reliability was assessed using DISCERN, EQIP, JAMA benchmarks, and the Global Quality Scale (GQS). Readability was measured by six standard indices (ARI, CLI, FKGL, GFI, SMOG, FRES). Three otorhinolaryngology clinicians blindly scored all responses.
Results
Significant differences in reliability were found among models ( P
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Otolaryngology, The Third Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China.
- Department of Spinal Surgery, The Third Affiliated Hospital of Soochow University, Changzhou, Jiangsu, China.
- Outpatient Department, The Third Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China.
ORCID-Profile: Xiaoming Qian
Förderung
- Zhengzhou Healthcare Science and Technology Innovation Guidance Program
- China Medical Foundation Clinical Medical Research Promotion Program
Zitieren
APA
Qian, X., Wu, Z., Li, J., Su, Q., Qin, Q., & Zhang, B. (2026). Reliability and readability of adenoid hypertrophy information generated by five publicly accessible LLM chatbots: A default-setting snapshot study. DIGITAL HEALTH, 12. https://doi.org/10.1177/20552076261459596
Vancouver
Qian X, Wu Z, Li J, Su Q, Qin Q, Zhang B. Reliability and readability of adenoid hypertrophy information generated by five publicly accessible LLM chatbots: A default-setting snapshot study. DIGITAL HEALTH. 2026;12. doi:10.1177/20552076261459596
BibTeX
@article{Qian2026,
author = {Qian, Xiaoming and Wu, Zhishui and Li, Jing and Su, Qiuyu and Qin, Qian and Zhang, Beibei},
title = {Reliability and readability of adenoid hypertrophy information generated by five publicly accessible LLM chatbots: A default-setting snapshot study},
journal = {DIGITAL HEALTH},
year = {2026},
volume = {12},
doi = {10.1177/20552076261459596}
}
EUVIMED