Addressing Commonly Asked Questions in Urogynecology: Accuracy and Limitations of ChatGPT
International Urogynecology Journal · 2025-11 · 36 (11) · 2249-2254
DOI: 10.1007/s00192-025-06184-0 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Urogynecology Journal, online erschienen am 18.06.2025. Verfasst von Gregory Vurture und 7 weiteren Autor:innen. Beteiligte Einrichtung: Division of Urogynecology, Department of Urology, Montefiore Medical Center-Albert Einstein College of Medicine, 1250 Waters Place, Tower Two, 9 th F…. Hauptthemen laut MEDLINE: Gynecology, Urology, Internet. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 17 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Introduction and Hypothesis Existing literature suggests that large language models such as Chat Generative Pre-training Transformer (ChatGPT) might provide inaccurate and unreliable health care information. The literature regarding its performance in urogynecology is scarce. The aim of the present study is to assess ChatGPT’s ability to accurately answer commonly asked urogynecology patient questions.
Methods
An expert panel of five board certified urogynecologists and two fellows developed ten commonly asked patient questions in a urogynecology office. Questions were phrased using diction and verbiage that a patient may use when asking a question over the internet. ChatGPT responses were evaluated using the Brief DISCERN (BD) tool, a validated scoring system for online health care information. Scores ≥ 16 are consistent with good-quality content. Responses were graded based on their accuracy and consistency with expert opinion and published guidelines.
Results
The average score across all ten questions was 18.9 ± 2.7. Nine out of ten (90%) questions had a response that was determined to be of good quality (BD ≥ 16). The lowest scoring topic was “Pelvic Organ Prolapse” (mean BD = 14.0 ± 2.0). The highest scoring topic was “Interstitial Cystitis” (mean BD = 22.0 ± 0). ChatGPT provided no references for its responses.
Conclusions
ChatGPT provided high-quality responses to 90% of the questions based on an expert panel’s review with the BD tool. Nonetheless, given the evolving nature of this technology, continued analysis is crucial before ChatGPT can be accepted as accurate and reliable.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Division of Urogynecology, Department of Urology, Montefiore Medical Center-Albert Einstein College of Medicine, 1250 Waters Place, Tower Two, 9 th Floor, Bronx, NY, 10460, USA. gwv203@nyu.edu.
- Department of Obstetrics and Gynecology, Hackensack Meridian Health-Jersey Shore University Medical Center, Neptune City, NJ, USA.
- Division of Urogynecology, Department of Obstetrics and Gynecology, Hackensack Meridian Health-Jersey Shore University Medical Center, Neptune City, NJ, USA.
ORCID-Profile: Gregory Vurture
Zitieren
APA
Vurture, G., Jenkins, N., Ross, J., Sansone, S., Conner, E., Jacobson, N., Smilen, S., & Baum, J. (2025). Addressing Commonly Asked Questions in Urogynecology: Accuracy and Limitations of ChatGPT. International Urogynecology Journal, 36(11), 2249-2254. https://doi.org/10.1007/s00192-025-06184-0
Vancouver
Vurture G, Jenkins N, Ross J, Sansone S, Conner E, Jacobson N, et al. Addressing Commonly Asked Questions in Urogynecology: Accuracy and Limitations of ChatGPT. International Urogynecology Journal. 2025;36(11):2249-2254. doi:10.1007/s00192-025-06184-0
BibTeX
@article{Vurture2025,
author = {Vurture, Gregory and Jenkins, Nicole and Ross, James and Sansone, Stephanie and Conner, Ellen and Jacobson, Nina and Smilen, Scott and Baum, Jonathan},
title = {Addressing Commonly Asked Questions in Urogynecology: Accuracy and Limitations of ChatGPT},
journal = {International Urogynecology Journal},
year = {2025},
volume = {36},
number = {11},
pages = {2249--2254},
doi = {10.1007/s00192-025-06184-0}
}
EUVIMED