EUVIMEDEUVIMED entdecken
Vergleichsstudie

Comparison and Review of Different Versions of OpenAI Chat GPT , Anthropic Claude and Google Gemini Large Language Models' Performance on Endodontics Questions in the Turkish Dentistry Specialization Exam

Anil Ozgun Karatekin iD

European Journal of Dental Education · 2026

DOI: 10.1111/eje.70121 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift European Journal of Dental Education, 2026. Verfasst von Anil Ozgun Karatekin. Beteiligte Einrichtung: Department of Endodontics, School of Dentistry, Uskudar University, Istanbul, Turkey. Hauptthemen laut MEDLINE: Large Language Models, Endodontics, Educational Measurement, Education, Dental. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 18 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

This study compares the performance of five major large language models (LLMs)—OpenAI ChatGPT 4o and o1, Anthropic Claude 3.5 Sonnet, Google Gemini Advanced 1.5 Pro and Google Gemini Advanced 2.0 Experimental Advanced—on endodontics‐related questions from the Turkish Dentistry Specialization Entrance Exam (DUS) from 2017 to 2024.

Method

A total of 93 text‐based questions were used to evaluate each model's accuracy in answering specialized dental knowledge queries.

Results

The results revealed significant differences among the models, with GPT o1 achieving the highest success rate (89.2%) and Gemini Advanced 1.5 Pro the lowest (67.7%). Performance varied by language, with GPT‐4o and GPT o1 showing improved accuracy post‐2022. Additionally, query repetition influenced model responses, with some models exhibiting self‐correction abilities, while others consistently maintained incorrect answers.

Conclusion

The study highlights the strengths and limitations of current LLMs in domain‐specific assessments, emphasizing the role of reasoning‐based architectures like GPT o1's Chain of Thought (CoT) methodology. These findings underscore the need for continued advancements in AI‐driven education, particularly in dental specialization exams. While LLMs show potential as supplementary tools in dental education, their integration into real‐world applications requires further validation to ensure reliability and domain‐specific proficiency.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Large Language ModelsEndodonticsEducational MeasurementEducation, DentalGenerative Artificial IntelligenceTurkeyHumans

Autor:innen und Institutionen

  • Department of Endodontics, School of Dentistry, Uskudar University, Istanbul, Turkey.

ORCID-Profile: Anil Ozgun Karatekin

Zitieren

APA

Karatekin, A. O. (2026). Comparison and Review of Different Versions of OpenAI Chat GPT , Anthropic Claude and Google Gemini Large Language Models' Performance on Endodontics Questions in the Turkish Dentistry Specialization Exam. European Journal of Dental Education. https://doi.org/10.1111/eje.70121

Vancouver

Karatekin AO. Comparison and Review of Different Versions of OpenAI Chat GPT , Anthropic Claude and Google Gemini Large Language Models' Performance on Endodontics Questions in the Turkish Dentistry Specialization Exam. European Journal of Dental Education. 2026. doi:10.1111/eje.70121

BibTeX
@article{Karatekin2026,
  author = {Karatekin, Anil Ozgun},
  title = {Comparison and Review of Different Versions of OpenAI Chat GPT , Anthropic Claude and Google Gemini Large Language Models' Performance on Endodontics Questions in the Turkish Dentistry Specialization Exam},
  journal = {European Journal of Dental Education},
  year = {2026},
  doi = {10.1111/eje.70121}
}
Kostenlos starten →