Comparative evaluation of the performance of AI-powered chatbots in answering basic sciences questions of the dentistry specialization examination
Journal of Dental Sciences and Education · 27.02.2026 · 4 (1) · 17-22
DOI: 10.51271/jdse-0072 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Dental Sciences and Education, online erschienen am 27.02.2026. Verfasst von Tolga Mavigöz und 2 weiteren Autor:innen.
Abstract (Originalsprache)
Aims
The aim of this study is to evaluate the correctness rate/probability of answers provided by AI-powered chatbots—Gemini Advanced 2.5 Pro, ChatGPT 4 omni, ChatGPT 5, and DeepSeek v3—to single-answer, multiple-choice basic sciences questions from the Dentistry Specialization Examination (DUS) administered between 2012 and 2025.
Methods
A total of 539 multiple-choice questions from the basic sciences section of the DUS from 2012 to 2025 were used. Each question was presented directly in a new session. The rates of correct/incorrect answers were calculated based on the subject of the question, the year it was asked, and the chatbot model. The rate and probability of incorrect answers were evaluated using chi-square and binary logistic regression analyses.
Results
The rate of incorrect answers was highest in 2012, with a significant decrease observed in subsequent years (p
Zitieren
APA
Mavigöz, T., Altin, A., & Özata, M. Y. (2026). Comparative evaluation of the performance of AI-powered chatbots in answering basic sciences questions of the dentistry specialization examination. Journal of Dental Sciences and Education, 4(1), 17-22. https://doi.org/10.51271/jdse-0072
Vancouver
Mavigöz T, Altin A, Özata MY. Comparative evaluation of the performance of AI-powered chatbots in answering basic sciences questions of the dentistry specialization examination. Journal of Dental Sciences and Education. 2026;4(1):17-22. doi:10.51271/jdse-0072
BibTeX
@article{Mavigz2026,
author = {Mavigöz, Tolga and Altin, Adem and Özata, Merve Yeniçeri},
title = {Comparative evaluation of the performance of AI-powered chatbots in answering basic sciences questions of the dentistry specialization examination},
journal = {Journal of Dental Sciences and Education},
year = {2026},
volume = {4},
number = {1},
pages = {17--22},
doi = {10.51271/jdse-0072}
}
EUVIMED