ChatGPT in urogynecology: Comparing large language model responses to human experts
Acta Obstetricia et Gynecologica Scandinavica · 2026-08 · 105 (8) · 1629-1635
DOI: 10.1111/aogs.70085 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Acta Obstetricia et Gynecologica Scandinavica, online erschienen am 23.10.2025. Verfasst von Reut Rotem und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Urogynaecology, Cork University Maternity Hospital, Cork, Ireland. Hauptthemen laut MEDLINE: Large Language Models, Urology, Gynecology. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Introduction
Large language models (LLMs) are increasingly used in healthcare, including urogynecology, where stigma may limit open discussion. LLM‐based chat platforms may provide a less intimidating and more accessible way for patients to obtain information, but their reliability requires evaluation. This study compared the quality of ChatGPT‐generated responses in urogynecology with those provided by a consultant urogynecologist, focusing on understandability, helpfulness, and reassurance. Material and Methods A cross‐sectional survey was conducted among urogynecology patients. After informed consent, participants reviewed responses to six common questions, each answered by ChatGPT and a single consultant. A blinded third‐party consultant verified clinical accuracy. Patients rated responses using a 5‐point Likert scale across three domains (maximum score 15 per response). Wilcoxon signed‐rank tests were used for comparison.
Results
A total of 203 patients participated (median age 56 years, interquartile range 46–66). ChatGPT responses received higher total ratings than consultant responses (76 [67–85] vs. 72 [63–80], p < 0.01). Scores were higher for understandability, helpfulness, and reassurance (all p < 0.01). ChatGPT was preferred in four of six questions, one showed no difference, and one favored the consultant. Subgroup analyses showed no significant variation based on patient characteristics.
Conclusions
In this exploratory study, women rated ChatGPT's responses as clearer and more reassuring than consultant answers. These findings reflect patient perceptions in a limited setting and should be interpreted with caution. While LLMs may have a supportive role in patient education, their use must remain secondary to expert clinical care and subject to careful oversight.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Urogynaecology, Cork University Maternity Hospital, Cork, Ireland.
- Department of Obstetrics and Gynecology, Shaare Zedek Medical Center, Affiliated with the Hebrew University School of Medicine, Jerusalem, Israel.
- Department of Urogynecology, National Maternity Hospital, Dublin 2, Ireland.
- Department of Obstetrics and Gynecology, Faculty of Health Sciences, Soroka University Medical Center, Ben-Gurion University of the Negev, Beer-Sheva, Israel.
ORCID-Profile: Reut Rotem, Misgav Rottenstreich, Barry A O'reilly
Zitieren
APA
Rotem, R., Simon, C., Rottenstreich, M., O'reilly, B. A., Weintraub, A. Y., & O'Sullivan, O. E. (2026). ChatGPT in urogynecology: Comparing large language model responses to human experts. Acta Obstetricia et Gynecologica Scandinavica, 105(8), 1629-1635. https://doi.org/10.1111/aogs.70085
Vancouver
Rotem R, Simon C, Rottenstreich M, O'reilly BA, Weintraub AY, O'Sullivan OE. ChatGPT in urogynecology: Comparing large language model responses to human experts. Acta Obstetricia et Gynecologica Scandinavica. 2026;105(8):1629-1635. doi:10.1111/aogs.70085
BibTeX
@article{Rotem2026,
author = {Rotem, Reut and Simon, Craven and Rottenstreich, Misgav and O'reilly, Barry A and Weintraub, Adi Y and O'Sullivan, Orfhlaith E},
title = {ChatGPT in urogynecology: Comparing large language model responses to human experts},
journal = {Acta Obstetricia et Gynecologica Scandinavica},
year = {2026},
volume = {105},
number = {8},
pages = {1629--1635},
doi = {10.1111/aogs.70085}
}
EUVIMED