EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Assessing the performance of large language models when used to determine ASA status of cats and dogs and generate anaesthetic protocols

Sıtkıcan Okur iD, Yasemin Akçora iD, Damla T Okur iD, Mümin G Şenocak iD, Ayşe Gölgeli Bedir iD, Uğur Ersöz iD, Tuğçe Kartal iD, Büşra Kibar Kurt iD

Veterinary Record · 03.10.2026 · 199 (7)

DOI: 10.1002/vetr.70741 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Veterinary Record, online erschienen am 12.05.2026. Verfasst von Sıtkıcan Okur und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Surgery, Faculty of Veterinary Medicine, Atatürk University, Erzurum, Turkey. Hauptthemen laut MEDLINE: Large Language Models, Anesthesia. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Large language models (LLMs) are emerging as decision‐support tools in human medicine; however, their evaluation in veterinary anaesthesiology remains limited.

Methods

We retrospectively analysed 225 anonymised feline and canine cases (American Society of Anaesthesiologists [ASA] classifications 1‒5) from Atatürk University Veterinary Hospital. ChatGPT‐4o, ChatGPT‐5 and Gemini 2.5 Pro independently assigned ASA classifications and generated anaesthetic protocols using standardised prompts. Protocol adequacy was evaluated for all cases, regardless of ASA classification agreement, by two experienced veterinary anaesthesiologists using a four‐point scale. Statistical analyses included Friedman and Bonferroni‐adjusted Wilcoxon tests, effect sizes and inter‐panelist reliability (assessed by quadratic‐weighted Cohen's kappa and intraclass correlation coefficient).

Results

ChatGPT‐5 achieved the highest ASA classification accuracy (53.3%), followed by ChatGPT‐4o (46.7%) and Gemini 2.5 Pro (30.7%). The performance was strongest for ASA 3‒5, whereas ASA 1 cases were frequently misclassified, mainly due to ASA overestimation. ChatGPT‐5 generated the most clinically sufficient anaesthetic protocols, outperforming the other models.

Limitations

The retrospective, single‐centre design and inclusion of only feline and canine cases may limit generalisability.

Conclusions

LLMs can generate clinically relevant ASA classifications and anaesthetic protocols in veterinary anaesthesiology, although performance varies across models. However, expert oversight remains essential.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Large Language ModelsAnesthesiaAnimalsDogsCatsRetrospective StudiesReproducibility of ResultsClinical Protocols

Stichwörter der Autor:innen

ASA classificationdecision supportlarge language modelsveterinary anaesthesiology

Autor:innen und Institutionen

  • Department of Surgery, Faculty of Veterinary Medicine, Atatürk University, Erzurum, Turkey.
  • Department of Obstetrics and Gynecology, Faculty of Veterinary Medicine, Atatürk University, Erzurum, Turkey.
  • Department of Surgery, Faculty of Veterinary Medicine, Aydın Adnan Menderes University, Aydın, Turkey.

ORCID-Profile: Sıtkıcan Okur, Yasemin Akçora, Damla T Okur, Mümin G Şenocak, Ayşe Gölgeli Bedir, Uğur Ersöz, Tuğçe Kartal, Büşra Kibar Kurt

Zitieren

APA

Okur, S., Akçora, Y., Okur, D. T., Şenocak, M. G., Bedir, A. G., Ersöz, U., Kartal, T., & Kurt, B. K. (2026). Assessing the performance of large language models when used to determine ASA status of cats and dogs and generate anaesthetic protocols. Veterinary Record, 199(7). https://doi.org/10.1002/vetr.70741

Vancouver

Okur S, Akçora Y, Okur DT, Şenocak MG, Bedir AG, Ersöz U, et al. Assessing the performance of large language models when used to determine ASA status of cats and dogs and generate anaesthetic protocols. Veterinary Record. 2026;199(7). doi:10.1002/vetr.70741

BibTeX
@article{Okur2026,
  author = {Okur, Sıtkıcan and Akçora, Yasemin and Okur, Damla T and Şenocak, Mümin G and Bedir, Ayşe Gölgeli and Ersöz, Uğur and Kartal, Tuğçe and Kurt, Büşra Kibar},
  title = {Assessing the performance of large language models when used to determine ASA status of cats and dogs and generate anaesthetic protocols},
  journal = {Veterinary Record},
  year = {2026},
  volume = {199},
  number = {7},
  doi = {10.1002/vetr.70741}
}
Kostenlos starten →