Image-based diagnostic accuracy of artificial intelligence models in acute otitis media and otitis media with effusion: a comparison of ChatGPT and Gemini
European Archives of Oto-Rhino-Laryngology · 08.11.2026
DOI: 10.1007/s00405-026-10786-9 ↗Kurz gefasst
Fachartikel in der Zeitschrift European Archives of Oto-Rhino-Laryngology, online erschienen am 08.11.2026. Verfasst von Melih Alpay und 1 weiteren Autor:innen. Beteiligte Einrichtung: Bursa High Specialty Training and Research Hospital, Department of Otolaryngology, University of Health Sciences, Bursa, Türkiye. melih_alpay@hotmail…. Die Arbeit nennt 12 Literaturangaben.
Abstract (Originalsprache)
OBJECTIVE: The aim of this study is to comparatively evaluate two multimodal large language models (LLMs); ChatGPT (GPT-5.2) and Gemini 3.0 Flash, in terms of diagnostic accuracy, reliability, and clinical consistency for the diagnosis of pathologic tympanic membrane (PTM), acute otitis media (AOM) and otitis media with effusion (OME) prompting oto-endoscopic images. METHODS: This prospective diagnostic accuracy study included 515 high-resolution tympanic membrane (TM) images from patients aged between 6 months and 80 years. Nine questions, including final reference diagnoses (normal, AOM or OME) were set and the reference standard was based on concordant independent assessments by two senior otolaryngologists who were blinded to AI outputs. Both models were evaluated using the same standardized zero-shot prompt and the same nine-item structured image-assessment framework. Expert-model agreement was assessed using Cohen's kappa. Diagnostic performance was summarized using sensitivity, specificity, positive and negative predictive values, accuracy, and area under the receiver operating characteristic curve (AUC), with 95% confidence intervals; AUCs were compared using the DeLong method. RESULTS: ChatGPT (GPT-5.2) and Gemini 3.0 Flash showed good agreement (κ = 0.662, κ = 0.697 respectively; p < 0.001 for both) in final diagnosis (normal, OME, AOM). Gemini showed better agreement (κ = 0.652 vs. κ = 0.590) in diagnosing PTM. Disagreement was observed higher, particularly in the assessment of cone of light, TM color and definitive diagnosis. GPT-5.2 showed better sensitivity, whereas Gemini showed better specificity for the models of normal/pathologic TM and OME (+)/OME (-). Both models presented similar diagnostic accuracy for differentiating the presence of OME and AOM. Gemini 3 Flash demonstrated statistically significantly higher diagnostic accuracy for differentiating PTM compared with GPT-5.2 (p = 0.006), with higher specificity. CONCLUSION: LLMs offer significant potential in image-based diagnosis of OME and AOM. Gemini 3.0 Flash demonstrated higher diagnostic accuracy for identifying pathologic TMs compared with GPT-5.2. However, both models demonstrate similar accuracy with different sensitivities and specificities for OME and AOM, suggesting that AI-based systems may be better positioned as clinical decision support tools to complement clinical evaluation rather than as standalone diagnostic solutions.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Bursa High Specialty Training and Research Hospital, Department of Otolaryngology, University of Health Sciences, Bursa, Türkiye. melih_alpay@hotmail.com.
- Nilüfer Doruk Hospital, Department of Otolaryngology, Atlas University, Bursa, Türkiye.
Zitieren
APA
Alpay, M., & Aslier, N. G. Y. (2026). Image-based diagnostic accuracy of artificial intelligence models in acute otitis media and otitis media with effusion: a comparison of ChatGPT and Gemini. European Archives of Oto-Rhino-Laryngology. https://doi.org/10.1007/s00405-026-10786-9
Vancouver
Alpay M, Aslier NGY. Image-based diagnostic accuracy of artificial intelligence models in acute otitis media and otitis media with effusion: a comparison of ChatGPT and Gemini. European Archives of Oto-Rhino-Laryngology. 2026. doi:10.1007/s00405-026-10786-9
BibTeX
@article{Alpay2026,
author = {Alpay, Melih and Aslier, Nesibe Gül Yüksel},
title = {Image-based diagnostic accuracy of artificial intelligence models in acute otitis media and otitis media with effusion: a comparison of ChatGPT and Gemini},
journal = {European Archives of Oto-Rhino-Laryngology},
year = {2026},
doi = {10.1007/s00405-026-10786-9}
}
EUVIMED