Comparison and Review of Different Versions of OpenAI Chat GPT , Anthropic Claude and Google Gemini Large Language Models' Performance on Endodontics Questions in the Turkish Dentistry Specialization Exam
European Journal of Dental Education · 2026
DOI: 10.1111/eje.70121 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift European Journal of Dental Education, 2026. Verfasst von Anil Ozgun Karatekin. Beteiligte Einrichtung: Department of Endodontics, School of Dentistry, Uskudar University, Istanbul, Turkey. Hauptthemen laut MEDLINE: Large Language Models, Endodontics, Educational Measurement, Education, Dental. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 18 Literaturangaben.
Abstract (Originalsprache)
Introduction
This study compares the performance of five major large language models (LLMs)—OpenAI ChatGPT 4o and o1, Anthropic Claude 3.5 Sonnet, Google Gemini Advanced 1.5 Pro and Google Gemini Advanced 2.0 Experimental Advanced—on endodontics‐related questions from the Turkish Dentistry Specialization Entrance Exam (DUS) from 2017 to 2024.
Method
A total of 93 text‐based questions were used to evaluate each model's accuracy in answering specialized dental knowledge queries.
Results
The results revealed significant differences among the models, with GPT o1 achieving the highest success rate (89.2%) and Gemini Advanced 1.5 Pro the lowest (67.7%). Performance varied by language, with GPT‐4o and GPT o1 showing improved accuracy post‐2022. Additionally, query repetition influenced model responses, with some models exhibiting self‐correction abilities, while others consistently maintained incorrect answers.
Conclusion
The study highlights the strengths and limitations of current LLMs in domain‐specific assessments, emphasizing the role of reasoning‐based architectures like GPT o1's Chain of Thought (CoT) methodology. These findings underscore the need for continued advancements in AI‐driven education, particularly in dental specialization exams. While LLMs show potential as supplementary tools in dental education, their integration into real‐world applications requires further validation to ensure reliability and domain‐specific proficiency.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Endodontics, School of Dentistry, Uskudar University, Istanbul, Turkey.
ORCID-Profile: Anil Ozgun Karatekin
Zitieren
APA
Karatekin, A. O. (2026). Comparison and Review of Different Versions of OpenAI Chat GPT , Anthropic Claude and Google Gemini Large Language Models' Performance on Endodontics Questions in the Turkish Dentistry Specialization Exam. European Journal of Dental Education. https://doi.org/10.1111/eje.70121
Vancouver
Karatekin AO. Comparison and Review of Different Versions of OpenAI Chat GPT , Anthropic Claude and Google Gemini Large Language Models' Performance on Endodontics Questions in the Turkish Dentistry Specialization Exam. European Journal of Dental Education. 2026. doi:10.1111/eje.70121
BibTeX
@article{Karatekin2026,
author = {Karatekin, Anil Ozgun},
title = {Comparison and Review of Different Versions of OpenAI Chat GPT , Anthropic Claude and Google Gemini Large Language Models' Performance on Endodontics Questions in the Turkish Dentistry Specialization Exam},
journal = {European Journal of Dental Education},
year = {2026},
doi = {10.1111/eje.70121}
}
EUVIMED