EUVIMEDEUVIMED entdecken
Multizentrische StudieVergleichsstudieOpen Access · CC BY 4.0

Comparing clinical decision-making between colposcopists and large language models in cervical dysplasia management: a pilot prospective multicenter study

Jan Lennart Stalp, Juliane Alexandra Schneider, Lena Steinkasserer, Jens Hachenberg, Matthias Jentschke, Peter Hillemanns, Dominik Wolff, Agnieszka Denecke

Archives of Gynecology and Obstetrics · 18.06.2026 · 313 (1)

DOI: 10.1007/s00404-026-08498-w ↗

Kurz gefasst

Multizentrische Studie in der Zeitschrift Archives of Gynecology and Obstetrics, online erschienen am 18.06.2026. Verfasst von Jan Lennart Stalp und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Obstetrics and Gynecology, Hannover Medical School, Carl-Neuberg-Str. 1, 30625, Hannover, Germany. stalp.jan@mh-hannover.de. Hauptthemen laut MEDLINE: Large Language Models, Uterine Cervical Dysplasia, Colposcopy, Clinical Decision-Making. Die Arbeit nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Bundesministerium für Forschung, Technologie und Raumfahrt, Comprehensive Cancer Center (CCC) Hannover, Medizinische Hochschule Hannover (MHH).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

This prospective multicenter study aimed to compare the decision-making abilities of board-certified colposcopists and two commercially available large language models (LLM), ChatGPT-4o and ChatGPT-5, in cervical dysplasia management.

Methods

Twenty-three anonymized real-life patient cases with multiple-choice (MC) questions regarding treatment decisions were used to assess answer quality. Ten board-certified colposcopists and the two LLMs addressed the MC questions. The gold standard was defined by two guideline authors. LLMs were prompted to justify their responses. Concordance rates were calculated and compared across all questions and histopathological subgroups, including cervical intraepithelial neoplasia (CIN), unspecific histopathological results, and cervical cancer cases.

Results

Clinicians and LLMs achieved similar overall concordance rates compared to the gold standard (69.6% for clinicians, 69.6% for ChatGPT-4o, and 65.2% for ChatGPT-5). ChatGPT-5 outperformed clinicians in precancerous lesions (81.8% vs. 66.4%), while clinicians excelled in complex cases with unspecific histopathology (86% vs. 60%). Clinicians showed a tendency to overtreat low-grade lesions (CIN I), opting for more intensive surveillance. ChatGPT-4o performed better than ChatGPT-5 in cervical cancer cases, though both models struggled with these scenarios.

Conclusion

This study highlights the potential of LLMs as decision support tools in cervical dysplasia management, particularly for straightforward cases like precancerous lesions. However, clinicians remain superior in handling complex or ambiguous cases. The tendency of clinicians to overtreat low-grade lesions may offer the potential to test the implementation of a decision support tool for those cases. While LLMs show promise, exploring open-ended clinical scenarios and integrating retrieval-augmented generation could enhance their practical application.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Large Language ModelsUterine Cervical DysplasiaColposcopyClinical Decision-MakingUterine Cervical NeoplasmsHumansFemaleProspective StudiesPilot ProjectsAdultMiddle Aged

Stichwörter der Autor:innen

Cervical intraepithelial neoplasiaChatGPTClinical decision support systemLarge language modelMedical guideline

Autor:innen und Institutionen

  • Department of Obstetrics and Gynecology, Hannover Medical School, Carl-Neuberg-Str. 1, 30625, Hannover, Germany. stalp.jan@mh-hannover.de.
  • Commission Digital Medicine, German Society for Gynecology and Obstetrics (DGGG), Berlin, Germany. stalp.jan@mh-hannover.de.
  • Peter L. Reichertz Institute for Medical Informatics (PLRI) of TU Braunschweig and Hannover Medical School, Hannover Medical School, Hannover, Germany.
  • Department of Obstetrics and Gynecology, Hannover Medical School, Carl-Neuberg-Str. 1, 30625, Hannover, Germany.
  • Department of Obstetrics and Gynecology, Klinikum Würzburg Mitte, Würzburg, Germany.

Förderung

  • Bundesministerium für Forschung, Technologie und Raumfahrt
  • Comprehensive Cancer Center (CCC) Hannover
  • Medizinische Hochschule Hannover (MHH)

Zitieren

APA

Stalp, J. L., Schneider, J. A., Steinkasserer, L., Hachenberg, J., Jentschke, M., Hillemanns, P., Wolff, D., & Denecke, A. (2026). Comparing clinical decision-making between colposcopists and large language models in cervical dysplasia management: a pilot prospective multicenter study. Archives of Gynecology and Obstetrics, 313(1). https://doi.org/10.1007/s00404-026-08498-w

Vancouver

Stalp JL, Schneider JA, Steinkasserer L, Hachenberg J, Jentschke M, Hillemanns P, et al. Comparing clinical decision-making between colposcopists and large language models in cervical dysplasia management: a pilot prospective multicenter study. Archives of Gynecology and Obstetrics. 2026;313(1). doi:10.1007/s00404-026-08498-w

BibTeX
@article{Stalp2026,
  author = {Stalp, Jan Lennart and Schneider, Juliane Alexandra and Steinkasserer, Lena and Hachenberg, Jens and Jentschke, Matthias and Hillemanns, Peter and Wolff, Dominik and Denecke, Agnieszka},
  title = {Comparing clinical decision-making between colposcopists and large language models in cervical dysplasia management: a pilot prospective multicenter study},
  journal = {Archives of Gynecology and Obstetrics},
  year = {2026},
  volume = {313},
  number = {1},
  doi = {10.1007/s00404-026-08498-w}
}
Kostenlos starten →