Comparison of artificial intelligence systems in answering prosthodontics questions from the dental specialty exam in Turkey
Journal of Dental Sciences · 2025-07 · 20 (3) · 1454-1459
DOI: 10.1016/j.jds.2025.01.025 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Dental Sciences, 2025-07. Verfasst von Busra Tosun und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Prosthodontics, Faculty of Dentistry, Bolu Abant Izzet Baysal University, Bolu, Turkey. Die Arbeit wurde bisher 38-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Background/purpose: Artificial intelligence (AI) is increasingly vital in dentistry, supporting diagnostics, treatment planning, and patient education. However, AI systems face challenges, especially in delivering accurate information within specialized dental fields. This study aimed to evaluate the performance of seven AI-based chatbots (ChatGPT-3.5, ChatGPT-4, Gemini, Gemini Advanced, Claude AI, Microsoft Copilot, and Smodin AI) in correctly answering prosthodontics questions from the Dental Specialty Exam (DUS) in Turkey. Materials and methods: The dataset for this study consists of 128 multiple-choice prosthodontics questions from the DUS, a national exam administered in Turkey by the Student Selection and Placement Center (ÖSYM) between 2012 and 2021. Chatbot performance was assessed by categorizing the questions into case-based and knowledge-based.
Results
ChatGPT-4 achieved the highest accuracy (75.8 %), while Gemini AI had the lowest (46.1 %). Gemini AI also had more incorrect (69) than correct answers (59). ChatGPT-4 and ChatGPT-3.5 showed significantly higher accuracy in knowledge-based questions compared to case-based ones (p < 0.05). For case-based questions, Gemini and Gemini Advanced had the lowest accuracy (36.4 %), while other chatbots averaged 45.5 %. In knowledge-based questions, ChatGPT-4 performed best (78.6 %) and Gemini AI the worst (47 %).
Conclusion
ChatGPT-4 excelled in knowledge-based prosthodontic questions, showing potential to enhance dental education through personalized learning and clinical reasoning support. However, its limitations in case-based scenarios highlight the need for optimization to better address complex clinical situations. These findings suggest that AI models can significantly contribute to dental education and clinical practice.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Prosthodontics, Faculty of Dentistry, Bolu Abant Izzet Baysal University, Bolu, Turkey.
- Department of Prosthodontics, Faculty of Dentistry, The University of Atatürk, Erzurum, Turkey.
Zitieren
APA
Tosun, B., & Yilmaz, Z. S. (2025). Comparison of artificial intelligence systems in answering prosthodontics questions from the dental specialty exam in Turkey. Journal of Dental Sciences, 20(3), 1454-1459. https://doi.org/10.1016/j.jds.2025.01.025
Vancouver
Tosun B, Yilmaz ZS. Comparison of artificial intelligence systems in answering prosthodontics questions from the dental specialty exam in Turkey. Journal of Dental Sciences. 2025;20(3):1454-1459. doi:10.1016/j.jds.2025.01.025
BibTeX
@article{Tosun2025,
author = {Tosun, Busra and Yilmaz, Zeynep Sen},
title = {Comparison of artificial intelligence systems in answering prosthodontics questions from the dental specialty exam in Turkey},
journal = {Journal of Dental Sciences},
year = {2025},
volume = {20},
number = {3},
pages = {1454--1459},
doi = {10.1016/j.jds.2025.01.025}
}
EUVIMED