Large language models and specialty certification examinations in obstetrics and gynecology: a comparative performance analysis
Archives of Gynecology and Obstetrics · 16.09.2026
DOI: 10.1007/s00404-026-08572-3 ↗Kurz gefasst
Fachartikel in der Zeitschrift Archives of Gynecology and Obstetrics, online erschienen am 16.09.2026. Verfasst von Anna Owczarek und 2 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Purpose
Large language models (LLMs) are becoming integral to medical fields, yet comprehensive evaluations of their expertise in specific domains such as obstetrics and gynecology remain limited. The aim of this study was to assess and compare the observed performance and accuracy of a pragmatic sample of widely used LLMs—ChatGPT 5.1, Gemini Flash 2.5, Gemini Pro 3.0, Claude Sonnet 4.5, Microsoft Copilot, and Llama 4 Maverick—to determine their utility as educational tools and adjunctive knowledge-assistance systems.
Methods
We submitted 355 single-best-answer questions from three recent sessions of the Polish Specialty Certificate Examination in Obstetrics and Gynecology to the models. Questions were translated into English, and model performance was evaluated based on overall accuracy and the difficulty index of the questions.
Results
The results demonstrated that while all models surpassed the 60% passing threshold required for human specialists, significant performance disparities were observed. Gemini Pro 3.0 achieved superior results, consistently exceeding 90% accuracy and maintaining stability regardless of question complexity. Conversely, descriptive session-stratified analyses indicated lower accuracy for Gemini Flash 2.5, Microsoft Copilot, and Llama 4 Maverick on difficult questions.
Conclusions
These findings suggest that while LLMs hold promise as educational and knowledge-assistance tools, their performance variability necessitates rigorous prospective validation and expert oversight before any clinical deployment.
Zitieren
APA
Owczarek, A., Ługowski, F., & Stanirowski, P. J. (2026). Large language models and specialty certification examinations in obstetrics and gynecology: a comparative performance analysis. Archives of Gynecology and Obstetrics. https://doi.org/10.1007/s00404-026-08572-3
Vancouver
Owczarek A, Ługowski F, Stanirowski PJ. Large language models and specialty certification examinations in obstetrics and gynecology: a comparative performance analysis. Archives of Gynecology and Obstetrics. 2026. doi:10.1007/s00404-026-08572-3
BibTeX
@article{Owczarek2026,
author = {Owczarek, Anna and Ługowski, Franciszek and Stanirowski, Paweł Jan},
title = {Large language models and specialty certification examinations in obstetrics and gynecology: a comparative performance analysis},
journal = {Archives of Gynecology and Obstetrics},
year = {2026},
doi = {10.1007/s00404-026-08572-3}
}
EUVIMED