EUVIMEDEUVIMED entdecken
Crossref

Evaluation of general-purpose large language models as diagnostic support tools in cervical cytology

Thiyaphat Laohawetwanit, Sompon Apornvirat, Aleksandra Asaturova, Hua Li, Kris Lami, Andrey Bychkov

Pathology - Research and Practice · 2025-10 · 274 · 156159

DOI: 10.1016/j.prp.2025.156159 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Pathology - Research and Practice, 2025-10. Verfasst von Thiyaphat Laohawetwanit und 5 weiteren Autor:innen. Beteiligte Einrichtung: Division of Pathology, Chulabhorn International College of Medicine, Thammasat University, Pathum Thani, Thailand. Electronic address: thiyapat@tu.ac…. Hauptthemen laut MEDLINE: Uterine Cervical Neoplasms, Uterine Cervical Dysplasia, Cytodiagnosis. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 23 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

INTRODUCTION: The application of general-purpose large language models (LLMs) in cytopathology remains largely unexplored. This study aims to evaluate the accuracy and consistency of a custom version of ChatGPT-4 (GPT), ChatGPT o3, and Gemini 2.5 Pro as diagnostic support tools for cervical cytology. MATERIALS AND METHODS: A total of 200 Papanicolaou-stained cervical cytology images were acquired at 40x magnification, each measuring 384 × 384 pixels. These images consisted of 100 cases classified as negative for intraepithelial lesion or malignancy (NILM) and 100 cases across various abnormal categories: 20 low-grade squamous intraepithelial lesion (LSIL), 20 high-grade squamous intraepithelial lesion (HSIL), 20 squamous cell carcinoma (SCC), 20 adenocarcinoma in situ (AIS), and 20 adenocarcinoma (ADC). Diagnostic accuracy and consistency were evaluated by submitting each image to a GPT, ChatGPT o3, and Gemini 2.5 Pro 5-10 times. RESULTS: When distinguishing normal from abnormal cytology, LLMs showed mean sensitivity between 85.4 % and 100 %, and specificity between 67.2 % and 92.7 %. ChatGPT o3 was more accurate in identifying NILM (mean 89.2 % vs. 67.2 %) but less accurate in detecting LSIL (34 % vs. 85 %), HSIL (6 % vs. 63 %), and ADC (28 % vs. 91 %). Chain-of-thought prompting and submitting multiple images of the same diagnosis to ChatGPT o3 and Gemini 2.5 Pro did not significantly improve accuracy. Both models also performed poorly in identifying cervicovaginal infections. CONCLUSIONS: ChatGPT o3 and Gemini 2.5 Pro demonstrated complementary strengths in cervical cytology. Due to their low accuracy and inconsistency in abnormal cytology, general-purpose LLMs are not recommended as diagnostic support tools in cervical cytology.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Uterine Cervical NeoplasmsUterine Cervical DysplasiaCytodiagnosisHumansFemalePapanicolaou TestVaginal SmearsSensitivity and SpecificityLarge Language Models

Stichwörter der Autor:innen

Artificial intelligenceCervical cytologyDiagnosisLarge language model

Autor:innen und Institutionen

  • Division of Pathology, Chulabhorn International College of Medicine, Thammasat University, Pathum Thani, Thailand. Electronic address: thiyapat@tu.ac.th.
  • Division of Pathology, Chulabhorn International College of Medicine, Thammasat University, Pathum Thani, Thailand. Electronic address: slithereensoul@hotmail.com.
  • FSBI "National Medical Research Centre for Obstetrics, Gynecology and Perinatology Named after Academician V.I.Kulakov" of the Ministry of Health of the Russian Federation, Moscow, Russia. Electronic address: a.asaturov…
  • Landing Med (Wuhan Landing Intelligence Medical Co., Ltd, Wuhan, China. Electronic address: 448296465@qq.com.
  • Department of Pathology Informatics, Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan. Electronic address: krislami@nagasaki-u.ac.jp.
  • Department of Pathology, Kameda Medical Center, Kamogawa, Japan. Electronic address: bychkov.andrey@kameda.jp.

Zitieren

APA

Laohawetwanit, T., Apornvirat, S., Asaturova, A., Li, H., Lami, K., & Bychkov, A. (2025). Evaluation of general-purpose large language models as diagnostic support tools in cervical cytology. Pathology - Research and Practice, 274, 156159. https://doi.org/10.1016/j.prp.2025.156159

Vancouver

Laohawetwanit T, Apornvirat S, Asaturova A, Li H, Lami K, Bychkov A. Evaluation of general-purpose large language models as diagnostic support tools in cervical cytology. Pathology - Research and Practice. 2025;274:156159. doi:10.1016/j.prp.2025.156159

BibTeX
@article{Laohawetwanit2025,
  author = {Laohawetwanit, Thiyaphat and Apornvirat, Sompon and Asaturova, Aleksandra and Li, Hua and Lami, Kris and Bychkov, Andrey},
  title = {Evaluation of general-purpose large language models as diagnostic support tools in cervical cytology},
  journal = {Pathology - Research and Practice},
  year = {2025},
  volume = {274},
  pages = {156159},
  doi = {10.1016/j.prp.2025.156159}
}
Kostenlos starten →