Assessing the performance of large language models when used to determine ASA status of cats and dogs and generate anaesthetic protocols
Veterinary Record · 03.10.2026 · 199 (7)
DOI: 10.1002/vetr.70741 ↗Kurz gefasst
Fachartikel in der Zeitschrift Veterinary Record, online erschienen am 12.05.2026. Verfasst von Sıtkıcan Okur und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Surgery, Faculty of Veterinary Medicine, Atatürk University, Erzurum, Turkey. Hauptthemen laut MEDLINE: Large Language Models, Anesthesia. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Background
Large language models (LLMs) are emerging as decision‐support tools in human medicine; however, their evaluation in veterinary anaesthesiology remains limited.
Methods
We retrospectively analysed 225 anonymised feline and canine cases (American Society of Anaesthesiologists [ASA] classifications 1‒5) from Atatürk University Veterinary Hospital. ChatGPT‐4o, ChatGPT‐5 and Gemini 2.5 Pro independently assigned ASA classifications and generated anaesthetic protocols using standardised prompts. Protocol adequacy was evaluated for all cases, regardless of ASA classification agreement, by two experienced veterinary anaesthesiologists using a four‐point scale. Statistical analyses included Friedman and Bonferroni‐adjusted Wilcoxon tests, effect sizes and inter‐panelist reliability (assessed by quadratic‐weighted Cohen's kappa and intraclass correlation coefficient).
Results
ChatGPT‐5 achieved the highest ASA classification accuracy (53.3%), followed by ChatGPT‐4o (46.7%) and Gemini 2.5 Pro (30.7%). The performance was strongest for ASA 3‒5, whereas ASA 1 cases were frequently misclassified, mainly due to ASA overestimation. ChatGPT‐5 generated the most clinically sufficient anaesthetic protocols, outperforming the other models.
Limitations
The retrospective, single‐centre design and inclusion of only feline and canine cases may limit generalisability.
Conclusions
LLMs can generate clinically relevant ASA classifications and anaesthetic protocols in veterinary anaesthesiology, although performance varies across models. However, expert oversight remains essential.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Surgery, Faculty of Veterinary Medicine, Atatürk University, Erzurum, Turkey.
- Department of Obstetrics and Gynecology, Faculty of Veterinary Medicine, Atatürk University, Erzurum, Turkey.
- Department of Surgery, Faculty of Veterinary Medicine, Aydın Adnan Menderes University, Aydın, Turkey.
ORCID-Profile: Sıtkıcan Okur, Yasemin Akçora, Damla T Okur, Mümin G Şenocak, Ayşe Gölgeli Bedir, Uğur Ersöz, Tuğçe Kartal, Büşra Kibar Kurt
Zitieren
APA
Okur, S., Akçora, Y., Okur, D. T., Şenocak, M. G., Bedir, A. G., Ersöz, U., Kartal, T., & Kurt, B. K. (2026). Assessing the performance of large language models when used to determine ASA status of cats and dogs and generate anaesthetic protocols. Veterinary Record, 199(7). https://doi.org/10.1002/vetr.70741
Vancouver
Okur S, Akçora Y, Okur DT, Şenocak MG, Bedir AG, Ersöz U, et al. Assessing the performance of large language models when used to determine ASA status of cats and dogs and generate anaesthetic protocols. Veterinary Record. 2026;199(7). doi:10.1002/vetr.70741
BibTeX
@article{Okur2026,
author = {Okur, Sıtkıcan and Akçora, Yasemin and Okur, Damla T and Şenocak, Mümin G and Bedir, Ayşe Gölgeli and Ersöz, Uğur and Kartal, Tuğçe and Kurt, Büşra Kibar},
title = {Assessing the performance of large language models when used to determine ASA status of cats and dogs and generate anaesthetic protocols},
journal = {Veterinary Record},
year = {2026},
volume = {199},
number = {7},
doi = {10.1002/vetr.70741}
}
EUVIMED