Comparing ChatGPT's and Surgeon's Responses to Thyroid-related Questions From Patients
The Journal of Clinical Endocrinology & Metabolism · 2025
DOI: 10.1210/clinem/dgae235 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift The Journal of Clinical Endocrinology & Metabolism, 2025. Verfasst von Siyin Guo und 15 weiteren Autor:innen. Beteiligte Einrichtung: Division of Thyroid Surgery, Department of General Surgery, West China Hospital, Sichuan University, Chengdu, Sichuan 610041, China. Hauptthemen laut MEDLINE: Thyroid Diseases, Surgeons, Mobile Applications. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 44 Literaturangaben.
Abstract (Originalsprache)
Context
For some common thyroid-related conditions with high prevalence and long follow-up times, ChatGPT can be used to respond to common thyroid-related questions.
Objective
In this cross-sectional study, we assessed the ability of ChatGPT (version GPT-4.0) to provide accurate, comprehensive, compassionate, and satisfactory responses to common thyroid-related questions.
Methods
First, we obtained 28 thyroid-related questions from the Huayitong app, which together with the 2 interfering questions eventually formed 30 questions. Then, these questions were responded to by ChatGPT (on July 19, 2023), a junior specialist, and a senior specialist (on July 20, 2023) separately. Finally, 26 patients and 11 thyroid surgeons evaluated those responses on 4 dimensions: accuracy, comprehensiveness, compassion, and satisfaction.
Results
Among the 30 questions and responses, ChatGPT's speed of response was faster than that of the junior specialist (8.69 [7.53-9.48] vs 4.33 [4.05-4.60]; P < .001) and the senior specialist (8.69 [7.53-9.48] vs 4.22 [3.36-4.76]; P < .001). The word count of the ChatGPT's responses was greater than that of both the junior specialist (341.50 [301.00-384.25] vs 74.50 [51.75-84.75]; P < .001) and senior specialist (341.50 [301.00-384.25] vs 104.00 [63.75-177.75]; P < .001). ChatGPT received higher scores than the junior specialist and senior specialist in terms of accuracy, comprehensiveness, compassion, and satisfaction in responding to common thyroid-related questions.
Conclusion
ChatGPT performed better than a junior specialist and senior specialist in answering common thyroid-related questions, but further research is needed to validate the logical ability of the ChatGPT for complex thyroid questions.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Division of Thyroid Surgery, Department of General Surgery, West China Hospital, Sichuan University, Chengdu, Sichuan 610041, China.
- Health Management Center, General Practice Medical Center, West China Hospital, Sichuan University, Chengdu, Sichuan 610041, China.
- Department of Thyroid Surgery, General Surgery Ward 7, The First Hospital of Lanzhou University, Lanzhou, Gansu 730000, China.
- Chengdu Women's and Children's Central Hospital, School of Medicine, University of Electronic Science and Technology of China, Chengdu, Sichuan 610031, China.
- Thyroid Surgery, Zhengzhou Central Hospital Affiliated of Zhengzhou University, Zhengzhou, Henan 450007, China.
- Department of Thyroid Surgery, General Surgery III, Gansu Provincial Hospital, Lanzhou, Gansu 730000, China.
ORCID-Profile: Wenjie Chen, Jianyong Lei
Zitieren
APA
Guo, S., Li, R., Li, G., Chen, W., Huang, J., He, L., Ma, Y., Wang, L., Zheng, H., Tian, C., Zhao, Y., Pan, X., Wan, H., Liu, D., Li, Z., & Lei, J. (2025). Comparing ChatGPT's and Surgeon's Responses to Thyroid-related Questions From Patients. The Journal of Clinical Endocrinology & Metabolism. https://doi.org/10.1210/clinem/dgae235
Vancouver
Guo S, Li R, Li G, Chen W, Huang J, He L, et al. Comparing ChatGPT's and Surgeon's Responses to Thyroid-related Questions From Patients. The Journal of Clinical Endocrinology & Metabolism. 2025. doi:10.1210/clinem/dgae235
BibTeX
@article{Guo2025,
author = {Guo, Siyin and Li, Ruicen and Li, Genpeng and Chen, Wenjie and Huang, Jing and He, Linye and Ma, Yu and Wang, Liying and Zheng, Hongping and Tian, Chunxiang and Zhao, Yatong and Pan, Xinmin and Wan, Hongxing and Liu, Dasheng and Li, Zhihui and Lei, Jianyong},
title = {Comparing ChatGPT's and Surgeon's Responses to Thyroid-related Questions From Patients},
journal = {The Journal of Clinical Endocrinology & Metabolism},
year = {2025},
doi = {10.1210/clinem/dgae235}
}
EUVIMED