EUVIMEDEUVIMED entdecken
Vergleichsstudie

Observer‐Performance Comparison of ChatGPT ‐5 and Gemini 2.5 Pro Versus Veterinarians in Canine and Feline Fundus Interpretation: A Multi‐Reader, Multi‐Case Study

Büşra Kibar iD, Ömer Tarık Orhun iD, Tuğçe Kartal iD, Büşra Baykal iD, Ezgi Sude Aybak iD, Sıtkıcan Okur iD

Veterinary Ophthalmology · 2026

DOI: 10.1111/vop.70138 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift Veterinary Ophthalmology, 2026. Verfasst von Büşra Kibar und 5 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Veterinary Medicine, Department of Surgery, Aydın Adnan Menderes University, Aydın, Türkiye. Hauptthemen laut MEDLINE: Veterinarians, Dog Diseases, Cat Diseases, Fundus Oculi. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 25 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

To compare two large language models (ChatGPT‐5, Gemini 2.5 Pro) with experienced and novice veterinarians on canine and feline fundus cases, and to assess the relationship between perceived case difficulty and diagnostic performance. Animals Studied Forty‐three client‐owned cases were sampled from 200 ophthalmology records. Procedure(s) Each case included signalment, history, and fundus photographs. Two experienced veterinarians, two novice veterinarians, and two LLMs independently selected findings and provided diagnosis from options. Participants rated difficulty (Very Easy–Hard). Group differences were tested with Kruskal–Wallis and Dunn‐Bonferroni procedures; associations with difficulty used Spearman's ρ ; paired proportions used Cochran's Q with Holm‐adjusted McNemar tests.

Results

Experts achieved the highest accuracies (findings: 73.3% and 61.6%; diagnosis: 86.0% and 66.3%), significantly outperforming LLMs and novices (all adjusted p < 0.05). LLM finding accuracies were 52.0% (ChatGPT‐5) and 49.3% (Gemini 2.5 Pro), both above novices (28.3% and 26.9%). LLM diagnosis accuracies were lower (ChatGPT‐5: 37.2%, Gemini 2.5 Pro: 37.2%) but still numerically higher than novices (23.1% and 22.5%). Expert accuracy declined with increasing case difficulty, whereas LLM performance was comparatively stable (ChatGPT‐5 range 2.37–3.86; Gemini 2.5 Pro 2.00–2.95). Difficulty correlated negatively with Expert 2 totals ( ρ = −0.70, p < 0.0001) but not with LLMs (| ρ | ≤ 0.17, p ≥ 0.28).

Conclusions

Experienced veterinarians are most accurate in fundus interpretation, but their performance declines with increasing difficulty. LLMs, though less accurate, remain stable across cases and outperform novices, indicating value as training or decision‐support tools. Future studies should assess whether expert‐LLM collaboration enhances accuracy and efficiency.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

VeterinariansDog DiseasesCat DiseasesFundus OculiAnimalsDogsCatsClinical CompetenceObserver VariationFemaleMaleGenerative Artificial Intelligence

Stichwörter der Autor:innen

experimental biasfundus oculilarge language modelsoptic discretina

Autor:innen und Institutionen

  • Faculty of Veterinary Medicine, Department of Surgery, Aydın Adnan Menderes University, Aydın, Türkiye.
  • Faculty of Veterinary Medicine, Department of Surgery, Necmettin Erbakan University, Konya, Türkiye.
  • Faculty of Veterinary Medicine, Department of Surgery, Atatürk University, Erzurum, Türkiye.
  • Faculty of Veterinary Medicine, Department of Surgery, Namık Kemal University, Tekirdağ, Türkiye.

ORCID-Profile: Büşra Kibar, Ömer Tarık Orhun, Tuğçe Kartal, Büşra Baykal, Ezgi Sude Aybak, Sıtkıcan Okur

Zitieren

APA

Kibar, B., Orhun, Ö. T., Kartal, T., Baykal, B., Aybak, E. S., & Okur, S. (2026). Observer‐Performance Comparison of ChatGPT ‐5 and Gemini 2.5 Pro Versus Veterinarians in Canine and Feline Fundus Interpretation: A Multi‐Reader, Multi‐Case Study. Veterinary Ophthalmology. https://doi.org/10.1111/vop.70138

Vancouver

Kibar B, Orhun ÖT, Kartal T, Baykal B, Aybak ES, Okur S. Observer‐Performance Comparison of ChatGPT ‐5 and Gemini 2.5 Pro Versus Veterinarians in Canine and Feline Fundus Interpretation: A Multi‐Reader, Multi‐Case Study. Veterinary Ophthalmology. 2026. doi:10.1111/vop.70138

BibTeX
@article{Kibar2026,
  author = {Kibar, Büşra and Orhun, Ömer Tarık and Kartal, Tuğçe and Baykal, Büşra and Aybak, Ezgi Sude and Okur, Sıtkıcan},
  title = {Observer‐Performance Comparison of ChatGPT ‐5 and Gemini 2.5 Pro Versus Veterinarians in Canine and Feline Fundus Interpretation: A Multi‐Reader, Multi‐Case Study},
  journal = {Veterinary Ophthalmology},
  year = {2026},
  doi = {10.1111/vop.70138}
}
Kostenlos starten →