Observer‐Performance Comparison of ChatGPT ‐5 and Gemini 2.5 Pro Versus Veterinarians in Canine and Feline Fundus Interpretation: A Multi‐Reader, Multi‐Case Study
Veterinary Ophthalmology · 2026
DOI: 10.1111/vop.70138 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Veterinary Ophthalmology, 2026. Verfasst von Büşra Kibar und 5 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Veterinary Medicine, Department of Surgery, Aydın Adnan Menderes University, Aydın, Türkiye. Hauptthemen laut MEDLINE: Veterinarians, Dog Diseases, Cat Diseases, Fundus Oculi. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 25 Literaturangaben.
Abstract (Originalsprache)
Objective
To compare two large language models (ChatGPT‐5, Gemini 2.5 Pro) with experienced and novice veterinarians on canine and feline fundus cases, and to assess the relationship between perceived case difficulty and diagnostic performance. Animals Studied Forty‐three client‐owned cases were sampled from 200 ophthalmology records. Procedure(s) Each case included signalment, history, and fundus photographs. Two experienced veterinarians, two novice veterinarians, and two LLMs independently selected findings and provided diagnosis from options. Participants rated difficulty (Very Easy–Hard). Group differences were tested with Kruskal–Wallis and Dunn‐Bonferroni procedures; associations with difficulty used Spearman's ρ ; paired proportions used Cochran's Q with Holm‐adjusted McNemar tests.
Results
Experts achieved the highest accuracies (findings: 73.3% and 61.6%; diagnosis: 86.0% and 66.3%), significantly outperforming LLMs and novices (all adjusted p < 0.05). LLM finding accuracies were 52.0% (ChatGPT‐5) and 49.3% (Gemini 2.5 Pro), both above novices (28.3% and 26.9%). LLM diagnosis accuracies were lower (ChatGPT‐5: 37.2%, Gemini 2.5 Pro: 37.2%) but still numerically higher than novices (23.1% and 22.5%). Expert accuracy declined with increasing case difficulty, whereas LLM performance was comparatively stable (ChatGPT‐5 range 2.37–3.86; Gemini 2.5 Pro 2.00–2.95). Difficulty correlated negatively with Expert 2 totals ( ρ = −0.70, p < 0.0001) but not with LLMs (| ρ | ≤ 0.17, p ≥ 0.28).
Conclusions
Experienced veterinarians are most accurate in fundus interpretation, but their performance declines with increasing difficulty. LLMs, though less accurate, remain stable across cases and outperform novices, indicating value as training or decision‐support tools. Future studies should assess whether expert‐LLM collaboration enhances accuracy and efficiency.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Faculty of Veterinary Medicine, Department of Surgery, Aydın Adnan Menderes University, Aydın, Türkiye.
- Faculty of Veterinary Medicine, Department of Surgery, Necmettin Erbakan University, Konya, Türkiye.
- Faculty of Veterinary Medicine, Department of Surgery, Atatürk University, Erzurum, Türkiye.
- Faculty of Veterinary Medicine, Department of Surgery, Namık Kemal University, Tekirdağ, Türkiye.
ORCID-Profile: Büşra Kibar, Ömer Tarık Orhun, Tuğçe Kartal, Büşra Baykal, Ezgi Sude Aybak, Sıtkıcan Okur
Zitieren
APA
Kibar, B., Orhun, Ö. T., Kartal, T., Baykal, B., Aybak, E. S., & Okur, S. (2026). Observer‐Performance Comparison of ChatGPT ‐5 and Gemini 2.5 Pro Versus Veterinarians in Canine and Feline Fundus Interpretation: A Multi‐Reader, Multi‐Case Study. Veterinary Ophthalmology. https://doi.org/10.1111/vop.70138
Vancouver
Kibar B, Orhun ÖT, Kartal T, Baykal B, Aybak ES, Okur S. Observer‐Performance Comparison of ChatGPT ‐5 and Gemini 2.5 Pro Versus Veterinarians in Canine and Feline Fundus Interpretation: A Multi‐Reader, Multi‐Case Study. Veterinary Ophthalmology. 2026. doi:10.1111/vop.70138
BibTeX
@article{Kibar2026,
author = {Kibar, Büşra and Orhun, Ömer Tarık and Kartal, Tuğçe and Baykal, Büşra and Aybak, Ezgi Sude and Okur, Sıtkıcan},
title = {Observer‐Performance Comparison of ChatGPT ‐5 and Gemini 2.5 Pro Versus Veterinarians in Canine and Feline Fundus Interpretation: A Multi‐Reader, Multi‐Case Study},
journal = {Veterinary Ophthalmology},
year = {2026},
doi = {10.1111/vop.70138}
}
EUVIMED