Assessing the Educational Role of Large Language Models in Dental Training: A Decade‐Long Analysis of Text‐Based and Visual Questions in a National Examination
European Journal of Dental Education · 2026
DOI: 10.1111/eje.70268 ↗Kurz gefasst
Fachartikel in der Zeitschrift European Journal of Dental Education, 2026. Verfasst von Sedef Ayse Tasyapan und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Oral and Maxillofacial Radiology, Faculty of Dentistry, Istanbul University, Istanbul, Turkey. Hauptthemen laut MEDLINE: Large Language Models, Education, Dental, Educational Measurement. Die Arbeit nennt 13 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Background
Large language models (LLMs), including ChatGPT, Gemini and DeepSeek, are increasingly explored as supportive tools in health professions education. However, their educational utility across different knowledge domains and question formats, particularly those involving visual content, remains insufficiently understood.
Objective
This study aimed to evaluate the educational potential of three advanced LLMs in dental training by analysing their performance on a national specialty examination over a 10‐year period, with particular emphasis on domain‐specific accuracy and differences between text‐based and visual questions.
Methods
A total of 1560 multiple‐choice questions from 13 administrations of the Turkish Dental Specialty Examination (DUS) between 2012 and 2021 were included. All questions were translated into English and categorized into nine dental specialties. Each question was individually entered into ChatGPT‐4.0, Gemini Advanced and DeepSeek in isolated sessions. Model responses were compared with official answer keys, and accuracy rates were analysed across years, specialties and question types. Statistical analyses included chi‐square tests, one‐way ANOVA and Kruskal–Wallis tests.
Results
ChatGPT‐4.0 achieved the highest overall accuracy (86.93%), followed by Gemini (82.86%) and DeepSeek (82.34%). Performance varied across specialties, with higher accuracy observed in Basic Sciences and Oral Surgery, and lower performance in Orthodontics and Endodontics. A substantial decrease in accuracy was observed for visual questions (ChatGPT: 52.38%; Gemini: 45.24%; DeepSeek: 2.38%) compared to text‐based items (all models > 83%). ChatGPT demonstrated more stable performance across years, whereas Gemini and DeepSeek showed greater variability.
Conclusions
LLMs demonstrate strong potential as supportive tools in dental education, particularly for text‐based knowledge assessment. However, their limited performance in visual question contexts highlights an important constraint for their integration into image‐dependent domains such as dental diagnostics. These findings underscore the need for cautious and context‐aware implementation of AI tools in dental curricula and assessment practices.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Oral and Maxillofacial Radiology, Faculty of Dentistry, Istanbul University, Istanbul, Turkey.
ORCID-Profile: Sedef Ayse Tasyapan, Didem Özer
Zitieren
APA
Tasyapan, S. A., & Özer, D. (2026). Assessing the Educational Role of Large Language Models in Dental Training: A Decade‐Long Analysis of Text‐Based and Visual Questions in a National Examination. European Journal of Dental Education. https://doi.org/10.1111/eje.70268
Vancouver
Tasyapan SA, Özer D. Assessing the Educational Role of Large Language Models in Dental Training: A Decade‐Long Analysis of Text‐Based and Visual Questions in a National Examination. European Journal of Dental Education. 2026. doi:10.1111/eje.70268
BibTeX
@article{Tasyapan2026,
author = {Tasyapan, Sedef Ayse and Özer, Didem},
title = {Assessing the Educational Role of Large Language Models in Dental Training: A Decade‐Long Analysis of Text‐Based and Visual Questions in a National Examination},
journal = {European Journal of Dental Education},
year = {2026},
doi = {10.1111/eje.70268}
}
EUVIMED