Benchmarking Large Language Models in Acute-on-Chronic Pancreatitis: An Exploratory Study
Diagnostics · 19.08.2026 · 16 (16) · 2639
DOI: 10.3390/diagnostics16162639 ↗Kurz gefasst
Fachartikel in der Zeitschrift Diagnostics, online erschienen am 19.08.2026. Verfasst von Alina Florentina Pistrițu und 17 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Medicine, "Carol Davila" University of Medicine and Pharmacy, 050474 Bucharest, Romania. Die Arbeit nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background/Objectives: Acute-on-chronic pancreatitis (ACP) is a fibro-inflammatory syndrome that stands at the border between acute pancreatitis (AP) and chronic pancreatitis (CP). It can be broadly defined as an acute exacerbation of CP. Large language models (LLMs) are artificial intelligence (AI) machine learning tools that can be employed in clinical decision systems (CDSs).
Methods
This is an exploratory benchmark study. Six LLM chatbots were evaluated on a Likert scale by a panel of 13 experts in pancreatology based on the similarity of responses to a position statement (PS) in ACP.
Results
ClaudeAI had the best average Likert score, while Alice had the lowest. There was a positive correlation between the length of the response and expert-perceived similarity. There was no correlation between seniority and Likert score.
Conclusions
In this exploratory benchmark, some LLMs generated answers that were often judged as similar to the position statement, suggesting that they might be helpful as educational support tools and may assist in the refinement of research questions or in the identification of research gaps in this particular pathology.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Faculty of Medicine, "Carol Davila" University of Medicine and Pharmacy, 050474 Bucharest, Romania.
- Internal Medicine and Gastroenterology Department, University Emergency Hospital of Bucharest, 050098 Bucharest, Romania.
- Gastroenterology Department, Emergency Clinical Hospital of Bucharest, 014461 Bucharest, Romania.
- Gastroenterology Department, "Prof. Dr. Agrippa Ionescu" Hospital, 011356 Bucharest, Romania.
- Faculty of Medicine, "Ovidius" University of Constanta, 900470 Constanta, Romania.
- Gastroenterology Department, "Sf. Apostol Andrei" Emergency County Hospital, 900591 Constanta, Romania.
ORCID-Profile: Mihai Radu Pahomeanu, Andreea Irina Ghiță, Cosmin Mihail Andrian, Arina Ilinca Gheorghe, Elena Alupei, Dana Bilous, Deniz Gunsahin, Petruța Violeta Filip, Răzvan Cătălin Popescu, Cristian George Țieranu, Eugen Dumitru, Lucian Negreanu
Zitieren
APA
Pistrițu, A. F., Pahomeanu, M. R., Ghiță, A. I., Andrian, C. M., Gheorghe, A. I., Alupei, E., Bilous, D., Gunsahin, D., Vlăduț, C., Costache, A., Filip, P. V., Tocia, C., Popescu, R. C., Țieranu, C. G., Dumitru, E., Ciocîrlan, M., Pop, C. S., & Negreanu, L. (2026). Benchmarking Large Language Models in Acute-on-Chronic Pancreatitis: An Exploratory Study. Diagnostics, 16(16), 2639. https://doi.org/10.3390/diagnostics16162639
Vancouver
Pistrițu AF, Pahomeanu MR, Ghiță AI, Andrian CM, Gheorghe AI, Alupei E, et al. Benchmarking Large Language Models in Acute-on-Chronic Pancreatitis: An Exploratory Study. Diagnostics. 2026;16(16):2639. doi:10.3390/diagnostics16162639
BibTeX
@article{Pistriu2026,
author = {Pistrițu, Alina Florentina and Pahomeanu, Mihai Radu and Ghiță, Andreea Irina and Andrian, Cosmin Mihail and Gheorghe, Arina Ilinca and Alupei, Elena and Bilous, Dana and Gunsahin, Deniz and Vlăduț, Cătălina and Costache, Adrian and Filip, Petruța Violeta and Tocia, Cristina and Popescu, Răzvan Cătălin and Țieranu, Cristian George and Dumitru, Eugen and Ciocîrlan, Mihai and Pop, Corina Silvia and Negreanu, Lucian},
title = {Benchmarking Large Language Models in Acute-on-Chronic Pancreatitis: An Exploratory Study},
journal = {Diagnostics},
year = {2026},
volume = {16},
number = {16},
pages = {2639},
doi = {10.3390/diagnostics16162639}
}
EUVIMED