EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Addressing Commonly Asked Questions in Urogynecology: Accuracy and Limitations of ChatGPT

Gregory Vurture iD, Nicole Jenkins, James Ross, Stephanie Sansone, Ellen Conner, Nina Jacobson, Scott Smilen, Jonathan Baum

International Urogynecology Journal · 2025-11 · 36 (11) · 2249-2254

DOI: 10.1007/s00192-025-06184-0 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Urogynecology Journal, online erschienen am 18.06.2025. Verfasst von Gregory Vurture und 7 weiteren Autor:innen. Beteiligte Einrichtung: Division of Urogynecology, Department of Urology, Montefiore Medical Center-Albert Einstein College of Medicine, 1250 Waters Place, Tower Two, 9 th F…. Hauptthemen laut MEDLINE: Gynecology, Urology, Internet. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 17 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction and Hypothesis Existing literature suggests that large language models such as Chat Generative Pre-training Transformer (ChatGPT) might provide inaccurate and unreliable health care information. The literature regarding its performance in urogynecology is scarce. The aim of the present study is to assess ChatGPT’s ability to accurately answer commonly asked urogynecology patient questions.

Methods

An expert panel of five board certified urogynecologists and two fellows developed ten commonly asked patient questions in a urogynecology office. Questions were phrased using diction and verbiage that a patient may use when asking a question over the internet. ChatGPT responses were evaluated using the Brief DISCERN (BD) tool, a validated scoring system for online health care information. Scores ≥ 16 are consistent with good-quality content. Responses were graded based on their accuracy and consistency with expert opinion and published guidelines.

Results

The average score across all ten questions was 18.9 ± 2.7. Nine out of ten (90%) questions had a response that was determined to be of good quality (BD ≥ 16). The lowest scoring topic was “Pelvic Organ Prolapse” (mean BD = 14.0 ± 2.0). The highest scoring topic was “Interstitial Cystitis” (mean BD = 22.0 ± 0). ChatGPT provided no references for its responses.

Conclusions

ChatGPT provided high-quality responses to 90% of the questions based on an expert panel’s review with the BD tool. Nonetheless, given the evolving nature of this technology, continued analysis is crucial before ChatGPT can be accepted as accurate and reliable.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

GynecologyUrologyInternetHumansFemaleSurveys and QuestionnairesGenerative Artificial Intelligence

Stichwörter der Autor:innen

Artificial intelligenceLarge language modelMachine learning

Autor:innen und Institutionen

  • Division of Urogynecology, Department of Urology, Montefiore Medical Center-Albert Einstein College of Medicine, 1250 Waters Place, Tower Two, 9 th Floor, Bronx, NY, 10460, USA. gwv203@nyu.edu.
  • Department of Obstetrics and Gynecology, Hackensack Meridian Health-Jersey Shore University Medical Center, Neptune City, NJ, USA.
  • Division of Urogynecology, Department of Obstetrics and Gynecology, Hackensack Meridian Health-Jersey Shore University Medical Center, Neptune City, NJ, USA.

ORCID-Profile: Gregory Vurture

Zitieren

APA

Vurture, G., Jenkins, N., Ross, J., Sansone, S., Conner, E., Jacobson, N., Smilen, S., & Baum, J. (2025). Addressing Commonly Asked Questions in Urogynecology: Accuracy and Limitations of ChatGPT. International Urogynecology Journal, 36(11), 2249-2254. https://doi.org/10.1007/s00192-025-06184-0

Vancouver

Vurture G, Jenkins N, Ross J, Sansone S, Conner E, Jacobson N, et al. Addressing Commonly Asked Questions in Urogynecology: Accuracy and Limitations of ChatGPT. International Urogynecology Journal. 2025;36(11):2249-2254. doi:10.1007/s00192-025-06184-0

BibTeX
@article{Vurture2025,
  author = {Vurture, Gregory and Jenkins, Nicole and Ross, James and Sansone, Stephanie and Conner, Ellen and Jacobson, Nina and Smilen, Scott and Baum, Jonathan},
  title = {Addressing Commonly Asked Questions in Urogynecology: Accuracy and Limitations of ChatGPT},
  journal = {International Urogynecology Journal},
  year = {2025},
  volume = {36},
  number = {11},
  pages = {2249--2254},
  doi = {10.1007/s00192-025-06184-0}
}
Kostenlos starten →