EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Artificial intelligence in obstetrics and gynecology: Evaluating ChatGPT and Google Gemini in answering patient questions

Madeline West iD, Amir Alsaidi iD, Rohail Siddiqi, Fatima Sayyed, Rachael Counts, Lauren Quinto, Nicholas Stansbury iD

International Journal of Gynecology & Obstetrics · 2026

DOI: 10.1002/ijgo.70622 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Gynecology & Obstetrics, 2026. Verfasst von Madeline West und 6 weiteren Autor:innen. Beteiligte Einrichtung: Paul L. Foster School of Medicine, Texas Tech University Health Sciences Center, El Paso, Texas, USA. Hauptthemen laut MEDLINE: Obstetrics, Gynecology, Artificial Intelligence, Internet. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

To evaluate the accuracy and completeness of responses across common obstetrical and gynecologic topics generated by the large language models (LLMs) ChatGPT and Google Gemini, which have become increasingly popular for patients seeking medical information before physician consultations.

Methods

Ten topics were identified, five obstetrical (prenatal labs, extended carrier screen, treatments for nausea and vomiting in pregnancy, gestational diabetes, and trial of labor after cesarean section) and five gynecologic (polycystic ovary syndrome, pelvic inflammatory disease, cervical smears, mammograms, and birth control). For each condition, ChatGPT generated five of the most frequently asked patient questions, which were then presented separately to ChatGPT and Google Gemini. Board‐certified Obstetrics and Gynecology physicians evaluated the responses using Likert scales for accuracy (1–6) and completeness (1–3).

Results

Acceptable response criteria were defined as an accuracy score of 5 or greater (“nearly all correct”) and a completeness score of 2 or greater (“adequately complete”). Most responses from both models met these thresholds. Wilcoxon signed‐rank tests demonstrated statistically significant differences in accuracy and completeness between models ( P < 0.05). Inter‐rater agreement was measured using intraclass correlation coefficients. For obstetrical topics, ChatGPT scored −0.047 (completeness) and 0.112 (accuracy), whereas Google Gemini scored 0.367 and 0.205, respectively. For gynecologic topics, ChatGPT scored 0.328 and 0.20, compared with Google Gemini at 0.151 and −0.08.

Conclusion

Both LLMs provided largely accurate and complete responses to patient questions. ChatGPT demonstrated stronger outcomes overall, suggesting potential utility in patient education; however, patients should confirm online information with physicians given the limitations of LLMs.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

ObstetricsGynecologyArtificial IntelligenceInternetHumansFemalePregnancyGenerative Artificial Intelligence

Stichwörter der Autor:innen

ChatGPTGoogle Geminiartificial intelligencegynecologyobstetricspatient education

Autor:innen und Institutionen

  • Paul L. Foster School of Medicine, Texas Tech University Health Sciences Center, El Paso, Texas, USA.
  • Department of Obstetrics & Gynecology, The University of Texas Health Science Center at San Antonio, San Antonio, Texas, USA.

ORCID-Profile: Madeline West, Amir Alsaidi, Nicholas Stansbury

Zitieren

APA

West, M., Alsaidi, A., Siddiqi, R., Sayyed, F., Counts, R., Quinto, L., & Stansbury, N. (2026). Artificial intelligence in obstetrics and gynecology: Evaluating ChatGPT and Google Gemini in answering patient questions. International Journal of Gynecology & Obstetrics. https://doi.org/10.1002/ijgo.70622

Vancouver

West M, Alsaidi A, Siddiqi R, Sayyed F, Counts R, Quinto L, et al. Artificial intelligence in obstetrics and gynecology: Evaluating ChatGPT and Google Gemini in answering patient questions. International Journal of Gynecology & Obstetrics. 2026. doi:10.1002/ijgo.70622

BibTeX
@article{West2026,
  author = {West, Madeline and Alsaidi, Amir and Siddiqi, Rohail and Sayyed, Fatima and Counts, Rachael and Quinto, Lauren and Stansbury, Nicholas},
  title = {Artificial intelligence in obstetrics and gynecology: Evaluating ChatGPT and Google Gemini in answering patient questions},
  journal = {International Journal of Gynecology & Obstetrics},
  year = {2026},
  doi = {10.1002/ijgo.70622}
}
Kostenlos starten →