Comparing clinical decision-making between colposcopists and large language models in cervical dysplasia management: a pilot prospective multicenter study
Archives of Gynecology and Obstetrics · 18.06.2026 · 313 (1)
DOI: 10.1007/s00404-026-08498-w ↗Kurz gefasst
Multizentrische Studie in der Zeitschrift Archives of Gynecology and Obstetrics, online erschienen am 18.06.2026. Verfasst von Jan Lennart Stalp und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Obstetrics and Gynecology, Hannover Medical School, Carl-Neuberg-Str. 1, 30625, Hannover, Germany. stalp.jan@mh-hannover.de. Hauptthemen laut MEDLINE: Large Language Models, Uterine Cervical Dysplasia, Colposcopy, Clinical Decision-Making. Die Arbeit nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Bundesministerium für Forschung, Technologie und Raumfahrt, Comprehensive Cancer Center (CCC) Hannover, Medizinische Hochschule Hannover (MHH).
Abstract (Originalsprache)
Purpose
This prospective multicenter study aimed to compare the decision-making abilities of board-certified colposcopists and two commercially available large language models (LLM), ChatGPT-4o and ChatGPT-5, in cervical dysplasia management.
Methods
Twenty-three anonymized real-life patient cases with multiple-choice (MC) questions regarding treatment decisions were used to assess answer quality. Ten board-certified colposcopists and the two LLMs addressed the MC questions. The gold standard was defined by two guideline authors. LLMs were prompted to justify their responses. Concordance rates were calculated and compared across all questions and histopathological subgroups, including cervical intraepithelial neoplasia (CIN), unspecific histopathological results, and cervical cancer cases.
Results
Clinicians and LLMs achieved similar overall concordance rates compared to the gold standard (69.6% for clinicians, 69.6% for ChatGPT-4o, and 65.2% for ChatGPT-5). ChatGPT-5 outperformed clinicians in precancerous lesions (81.8% vs. 66.4%), while clinicians excelled in complex cases with unspecific histopathology (86% vs. 60%). Clinicians showed a tendency to overtreat low-grade lesions (CIN I), opting for more intensive surveillance. ChatGPT-4o performed better than ChatGPT-5 in cervical cancer cases, though both models struggled with these scenarios.
Conclusion
This study highlights the potential of LLMs as decision support tools in cervical dysplasia management, particularly for straightforward cases like precancerous lesions. However, clinicians remain superior in handling complex or ambiguous cases. The tendency of clinicians to overtreat low-grade lesions may offer the potential to test the implementation of a decision support tool for those cases. While LLMs show promise, exploring open-ended clinical scenarios and integrating retrieval-augmented generation could enhance their practical application.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Obstetrics and Gynecology, Hannover Medical School, Carl-Neuberg-Str. 1, 30625, Hannover, Germany. stalp.jan@mh-hannover.de.
- Commission Digital Medicine, German Society for Gynecology and Obstetrics (DGGG), Berlin, Germany. stalp.jan@mh-hannover.de.
- Peter L. Reichertz Institute for Medical Informatics (PLRI) of TU Braunschweig and Hannover Medical School, Hannover Medical School, Hannover, Germany.
- Department of Obstetrics and Gynecology, Hannover Medical School, Carl-Neuberg-Str. 1, 30625, Hannover, Germany.
- Department of Obstetrics and Gynecology, Klinikum Würzburg Mitte, Würzburg, Germany.
Förderung
- Bundesministerium für Forschung, Technologie und Raumfahrt
- Comprehensive Cancer Center (CCC) Hannover
- Medizinische Hochschule Hannover (MHH)
Zitieren
APA
Stalp, J. L., Schneider, J. A., Steinkasserer, L., Hachenberg, J., Jentschke, M., Hillemanns, P., Wolff, D., & Denecke, A. (2026). Comparing clinical decision-making between colposcopists and large language models in cervical dysplasia management: a pilot prospective multicenter study. Archives of Gynecology and Obstetrics, 313(1). https://doi.org/10.1007/s00404-026-08498-w
Vancouver
Stalp JL, Schneider JA, Steinkasserer L, Hachenberg J, Jentschke M, Hillemanns P, et al. Comparing clinical decision-making between colposcopists and large language models in cervical dysplasia management: a pilot prospective multicenter study. Archives of Gynecology and Obstetrics. 2026;313(1). doi:10.1007/s00404-026-08498-w
BibTeX
@article{Stalp2026,
author = {Stalp, Jan Lennart and Schneider, Juliane Alexandra and Steinkasserer, Lena and Hachenberg, Jens and Jentschke, Matthias and Hillemanns, Peter and Wolff, Dominik and Denecke, Agnieszka},
title = {Comparing clinical decision-making between colposcopists and large language models in cervical dysplasia management: a pilot prospective multicenter study},
journal = {Archives of Gynecology and Obstetrics},
year = {2026},
volume = {313},
number = {1},
doi = {10.1007/s00404-026-08498-w}
}
EUVIMED