Artificial intelligence in obstetrics and gynecology: Evaluating ChatGPT and Google Gemini in answering patient questions
International Journal of Gynecology & Obstetrics · 2026
DOI: 10.1002/ijgo.70622 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Gynecology & Obstetrics, 2026. Verfasst von Madeline West und 6 weiteren Autor:innen. Beteiligte Einrichtung: Paul L. Foster School of Medicine, Texas Tech University Health Sciences Center, El Paso, Texas, USA. Hauptthemen laut MEDLINE: Obstetrics, Gynecology, Artificial Intelligence, Internet. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Introduction
To evaluate the accuracy and completeness of responses across common obstetrical and gynecologic topics generated by the large language models (LLMs) ChatGPT and Google Gemini, which have become increasingly popular for patients seeking medical information before physician consultations.
Methods
Ten topics were identified, five obstetrical (prenatal labs, extended carrier screen, treatments for nausea and vomiting in pregnancy, gestational diabetes, and trial of labor after cesarean section) and five gynecologic (polycystic ovary syndrome, pelvic inflammatory disease, cervical smears, mammograms, and birth control). For each condition, ChatGPT generated five of the most frequently asked patient questions, which were then presented separately to ChatGPT and Google Gemini. Board‐certified Obstetrics and Gynecology physicians evaluated the responses using Likert scales for accuracy (1–6) and completeness (1–3).
Results
Acceptable response criteria were defined as an accuracy score of 5 or greater (“nearly all correct”) and a completeness score of 2 or greater (“adequately complete”). Most responses from both models met these thresholds. Wilcoxon signed‐rank tests demonstrated statistically significant differences in accuracy and completeness between models ( P < 0.05). Inter‐rater agreement was measured using intraclass correlation coefficients. For obstetrical topics, ChatGPT scored −0.047 (completeness) and 0.112 (accuracy), whereas Google Gemini scored 0.367 and 0.205, respectively. For gynecologic topics, ChatGPT scored 0.328 and 0.20, compared with Google Gemini at 0.151 and −0.08.
Conclusion
Both LLMs provided largely accurate and complete responses to patient questions. ChatGPT demonstrated stronger outcomes overall, suggesting potential utility in patient education; however, patients should confirm online information with physicians given the limitations of LLMs.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Paul L. Foster School of Medicine, Texas Tech University Health Sciences Center, El Paso, Texas, USA.
- Department of Obstetrics & Gynecology, The University of Texas Health Science Center at San Antonio, San Antonio, Texas, USA.
ORCID-Profile: Madeline West, Amir Alsaidi, Nicholas Stansbury
Zitieren
APA
West, M., Alsaidi, A., Siddiqi, R., Sayyed, F., Counts, R., Quinto, L., & Stansbury, N. (2026). Artificial intelligence in obstetrics and gynecology: Evaluating ChatGPT and Google Gemini in answering patient questions. International Journal of Gynecology & Obstetrics. https://doi.org/10.1002/ijgo.70622
Vancouver
West M, Alsaidi A, Siddiqi R, Sayyed F, Counts R, Quinto L, et al. Artificial intelligence in obstetrics and gynecology: Evaluating ChatGPT and Google Gemini in answering patient questions. International Journal of Gynecology & Obstetrics. 2026. doi:10.1002/ijgo.70622
BibTeX
@article{West2026,
author = {West, Madeline and Alsaidi, Amir and Siddiqi, Rohail and Sayyed, Fatima and Counts, Rachael and Quinto, Lauren and Stansbury, Nicholas},
title = {Artificial intelligence in obstetrics and gynecology: Evaluating ChatGPT and Google Gemini in answering patient questions},
journal = {International Journal of Gynecology & Obstetrics},
year = {2026},
doi = {10.1002/ijgo.70622}
}
EUVIMED