EUVIMEDEUVIMED entdecken
Vergleichsstudie

Comparing ChatGPT's and Surgeon's Responses to Thyroid-related Questions From Patients

Siyin Guo, Ruicen Li, Genpeng Li, Wenjie Chen iD, Jing Huang, Linye He, Yu Ma, Liying Wang, Hongping Zheng, Chunxiang Tian, Yatong Zhao, Xinmin Pan und 4 weitere

The Journal of Clinical Endocrinology & Metabolism · 2025

DOI: 10.1210/clinem/dgae235 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift The Journal of Clinical Endocrinology & Metabolism, 2025. Verfasst von Siyin Guo und 15 weiteren Autor:innen. Beteiligte Einrichtung: Division of Thyroid Surgery, Department of General Surgery, West China Hospital, Sichuan University, Chengdu, Sichuan 610041, China. Hauptthemen laut MEDLINE: Thyroid Diseases, Surgeons, Mobile Applications. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 44 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Context

For some common thyroid-related conditions with high prevalence and long follow-up times, ChatGPT can be used to respond to common thyroid-related questions.

Objective

In this cross-sectional study, we assessed the ability of ChatGPT (version GPT-4.0) to provide accurate, comprehensive, compassionate, and satisfactory responses to common thyroid-related questions.

Methods

First, we obtained 28 thyroid-related questions from the Huayitong app, which together with the 2 interfering questions eventually formed 30 questions. Then, these questions were responded to by ChatGPT (on July 19, 2023), a junior specialist, and a senior specialist (on July 20, 2023) separately. Finally, 26 patients and 11 thyroid surgeons evaluated those responses on 4 dimensions: accuracy, comprehensiveness, compassion, and satisfaction.

Results

Among the 30 questions and responses, ChatGPT's speed of response was faster than that of the junior specialist (8.69 [7.53-9.48] vs 4.33 [4.05-4.60]; P < .001) and the senior specialist (8.69 [7.53-9.48] vs 4.22 [3.36-4.76]; P < .001). The word count of the ChatGPT's responses was greater than that of both the junior specialist (341.50 [301.00-384.25] vs 74.50 [51.75-84.75]; P < .001) and senior specialist (341.50 [301.00-384.25] vs 104.00 [63.75-177.75]; P < .001). ChatGPT received higher scores than the junior specialist and senior specialist in terms of accuracy, comprehensiveness, compassion, and satisfaction in responding to common thyroid-related questions.

Conclusion

ChatGPT performed better than a junior specialist and senior specialist in answering common thyroid-related questions, but further research is needed to validate the logical ability of the ChatGPT for complex thyroid questions.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Thyroid DiseasesSurgeonsMobile ApplicationsHumansCross-Sectional StudiesFemaleMaleMiddle AgedAdultSurveys and QuestionnairesPatient SatisfactionAgedThyroid GlandGenerative Artificial Intelligence

Stichwörter der Autor:innen

GPT-4artificial intelligence (AI)thyroid-related common questions

Autor:innen und Institutionen

  • Division of Thyroid Surgery, Department of General Surgery, West China Hospital, Sichuan University, Chengdu, Sichuan 610041, China.
  • Health Management Center, General Practice Medical Center, West China Hospital, Sichuan University, Chengdu, Sichuan 610041, China.
  • Department of Thyroid Surgery, General Surgery Ward 7, The First Hospital of Lanzhou University, Lanzhou, Gansu 730000, China.
  • Chengdu Women's and Children's Central Hospital, School of Medicine, University of Electronic Science and Technology of China, Chengdu, Sichuan 610031, China.
  • Thyroid Surgery, Zhengzhou Central Hospital Affiliated of Zhengzhou University, Zhengzhou, Henan 450007, China.
  • Department of Thyroid Surgery, General Surgery III, Gansu Provincial Hospital, Lanzhou, Gansu 730000, China.

ORCID-Profile: Wenjie Chen, Jianyong Lei

Zitieren

APA

Guo, S., Li, R., Li, G., Chen, W., Huang, J., He, L., Ma, Y., Wang, L., Zheng, H., Tian, C., Zhao, Y., Pan, X., Wan, H., Liu, D., Li, Z., & Lei, J. (2025). Comparing ChatGPT's and Surgeon's Responses to Thyroid-related Questions From Patients. The Journal of Clinical Endocrinology & Metabolism. https://doi.org/10.1210/clinem/dgae235

Vancouver

Guo S, Li R, Li G, Chen W, Huang J, He L, et al. Comparing ChatGPT's and Surgeon's Responses to Thyroid-related Questions From Patients. The Journal of Clinical Endocrinology & Metabolism. 2025. doi:10.1210/clinem/dgae235

BibTeX
@article{Guo2025,
  author = {Guo, Siyin and Li, Ruicen and Li, Genpeng and Chen, Wenjie and Huang, Jing and He, Linye and Ma, Yu and Wang, Liying and Zheng, Hongping and Tian, Chunxiang and Zhao, Yatong and Pan, Xinmin and Wan, Hongxing and Liu, Dasheng and Li, Zhihui and Lei, Jianyong},
  title = {Comparing ChatGPT's and Surgeon's Responses to Thyroid-related Questions From Patients},
  journal = {The Journal of Clinical Endocrinology & Metabolism},
  year = {2025},
  doi = {10.1210/clinem/dgae235}
}
Kostenlos starten →