DeepSeek versus ChatGPT-4.0: A Comparative Analysis in Ophthalmology (Cross-Sectional Study)
Turkiye Klinikleri Journal of Medical Sciences · 2026 · 46 (2) · 164-169
DOI: 10.5336/medsci.2025-115063 ↗Kurz gefasst
Querschnittstudie in der Zeitschrift Turkiye Klinikleri Journal of Medical Sciences, 2026. Verfasst von Özlem BİÇER und 1 weiteren Autor:innen.
Abstract (Originalsprache)
Objective
To evaluate the performance of ChatGPT4.0 and DeepSeek in answering multiple-choice questions (MCQs) from the Review of Ophthalmology book. Material and Methods: In February 2025, 629 text‑based MCQs were entered to ChatGPT‑4.0 and DeepSeek. The evaluated subsections included optics (n=65), pharmacology (n=55), embryology/pathology (n=40), neuro-ophthalmology (n=64), pediatrics/strabismus (n=71), orbit/lids/adnexa (n=55), cornea/external disease (n=60), uveitis (n=55), glaucoma (n=45), anterior segment (n=67), and posterior segment (n=52). The percentage of correct responses was calculated per section, and an overall assessment score was determined.
Results
ChatGPT-4.0 correctly answered 74.6% (469/629) of questions, while DeepSeek achieved 76.2% (479/629). No statistically significant difference was observed in the response accuracy rates between the artificial intelligence models (p=0.556). Both models demonstrated their lowest accuracy in optics, with ChatGPT-4 achieving 64.6% (42/65) and DeepSeek scoring 63.1% (41/65). In contrast, ChatGPT-4 exhibited its highest accuracy in pharmacology (87.3%, 48/55), while DeepSeek achieved its best performance in embryology/pathology (90.0%, 36/40). ChatGPT-4 and DeepSeek substantial agreement with the answer key, respectively (Cohen's κ=0.660, Cohen's κ=0.682).
Conclusion
To our knowledge, this study is the first to compare ophthalmology-related MCQs from ChatGPT-4 and DeepSeek, 2 of the most popular AI chatbots. Both chatbots had an acceptable performance in responding to ophthalmology related MCQs. Therefore, it is reasonable that ophthalmologists suggest either chatbot as a source of supplementary education.
Zitieren
APA
BİÇER, Ö., & ŞAHLI, E. (2026). DeepSeek versus ChatGPT-4.0: A Comparative Analysis in Ophthalmology (Cross-Sectional Study). Turkiye Klinikleri Journal of Medical Sciences, 46(2), 164-169. https://doi.org/10.5336/medsci.2025-115063
Vancouver
BİÇER Ö, ŞAHLI E. DeepSeek versus ChatGPT-4.0: A Comparative Analysis in Ophthalmology (Cross-Sectional Study). Turkiye Klinikleri Journal of Medical Sciences. 2026;46(2):164-169. doi:10.5336/medsci.2025-115063
BibTeX
@article{BER2026,
author = {BİÇER, Özlem and ŞAHLI, Esra},
title = {DeepSeek versus ChatGPT-4.0: A Comparative Analysis in Ophthalmology (Cross-Sectional Study)},
journal = {Turkiye Klinikleri Journal of Medical Sciences},
year = {2026},
volume = {46},
number = {2},
pages = {164--169},
doi = {10.5336/medsci.2025-115063}
}
EUVIMED