DIAGNOSTIC PERFORMANCE OF CHATGPT, GEMINI, AND DEEPSEEK IN CLINICAL DECISION SUPPORT: A COMPARATIVE ANALYSIS
Turkish Journal of Family Medicine and Primary Care · 01.06.2026 · 20 (2) · 214-219
DOI: 10.21763/tjfmpc.1809491 ↗Kurz gefasst
Fachartikel in der Zeitschrift Turkish Journal of Family Medicine and Primary Care, online erschienen am 01.06.2026. Verfasst von Yıldız Büyükdereli Atadağ und 3 weiteren Autor:innen. Die Arbeit nennt 14 Literaturangaben. Gefördert von: N-A.
Abstract (Originalsprache)
Objective:This study aimed to compare the diagnostic performance of three large language model (LLM)-based artificial intelligence (AI) tools-ChatGPT-4, Gemini 2.0 Flash, and DeepSeek-V3-in supporting initial clinical decision-making using standardized clinical scenarios.Methods:A total of 36 clinical scenarios were selected based on diagnostic algorithms from the Guide to Diagnostic Tests (7th ed.), representing five major clinical domains. For each scenario, only the first decision step of the relevant diagnostic algorithm was assessed. All questions were presented in Turkish and entered once, using identical prompts, into the publicly available free versions of the three models. Responses were evaluated using a three-point categorical accuracy system (completely correct, partially correct, incorrect).Results:ChatGPT achieved the highest total score (40/72), followed by Gemini and DeepSeek (36/72 each); however, this difference was not statistically significant (p>0.05). ChatGPT provided completely correct responses in 36.1% of scenarios, compared with 33.3% for Gemini and 22.2% for DeepSeek. Overlapping patterns of fully correct responses were observed between ChatGPT and Gemini, although this did not reach statistical significance (p>0.05). Performance varied by category: Gemini excelled in electrolyte disorders, ChatGPT in infectious and systemic conditions, and DeepSeek showed parity only in endocrinology and hematology.Conclusion:While all models showed some diagnostic potential, none reached a level of accuracy sufficient to replace clinical judgment. However, when used for the initial step of diagnostic reasoning based on limited clinical information, these models may offer supportive value to clinicians, particularly when integrated into broader clinical decision-support systems.
Förderung
- N-A
Zitieren
APA
Atadağ, Y. B., Seyhan, T. K., Hilaloğlu, U., & Akbayram, H. T. (2026). DIAGNOSTIC PERFORMANCE OF CHATGPT, GEMINI, AND DEEPSEEK IN CLINICAL DECISION SUPPORT: A COMPARATIVE ANALYSIS. Turkish Journal of Family Medicine and Primary Care, 20(2), 214-219. https://doi.org/10.21763/tjfmpc.1809491
Vancouver
Atadağ YB, Seyhan TK, Hilaloğlu U, Akbayram HT. DIAGNOSTIC PERFORMANCE OF CHATGPT, GEMINI, AND DEEPSEEK IN CLINICAL DECISION SUPPORT: A COMPARATIVE ANALYSIS. Turkish Journal of Family Medicine and Primary Care. 2026;20(2):214-219. doi:10.21763/tjfmpc.1809491
BibTeX
@article{Atada2026,
author = {Atadağ, Yıldız Büyükdereli and Seyhan, Tuba Kalınkara and Hilaloğlu, Umut and Akbayram, Hatice Tuba},
title = {DIAGNOSTIC PERFORMANCE OF CHATGPT, GEMINI, AND DEEPSEEK IN CLINICAL DECISION SUPPORT: A COMPARATIVE ANALYSIS},
journal = {Turkish Journal of Family Medicine and Primary Care},
year = {2026},
volume = {20},
number = {2},
pages = {214--219},
doi = {10.21763/tjfmpc.1809491}
}
EUVIMED