EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Comparison of artificial intelligence systems in answering prosthodontics questions from the dental specialty exam in Turkey

Busra Tosun, Zeynep Sen Yilmaz

Journal of Dental Sciences · 2025-07 · 20 (3) · 1454-1459

DOI: 10.1016/j.jds.2025.01.025 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Dental Sciences, 2025-07. Verfasst von Busra Tosun und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Prosthodontics, Faculty of Dentistry, Bolu Abant Izzet Baysal University, Bolu, Turkey. Die Arbeit wurde bisher 38-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background/purpose: Artificial intelligence (AI) is increasingly vital in dentistry, supporting diagnostics, treatment planning, and patient education. However, AI systems face challenges, especially in delivering accurate information within specialized dental fields. This study aimed to evaluate the performance of seven AI-based chatbots (ChatGPT-3.5, ChatGPT-4, Gemini, Gemini Advanced, Claude AI, Microsoft Copilot, and Smodin AI) in correctly answering prosthodontics questions from the Dental Specialty Exam (DUS) in Turkey. Materials and methods: The dataset for this study consists of 128 multiple-choice prosthodontics questions from the DUS, a national exam administered in Turkey by the Student Selection and Placement Center (ÖSYM) between 2012 and 2021. Chatbot performance was assessed by categorizing the questions into case-based and knowledge-based.

Results

ChatGPT-4 achieved the highest accuracy (75.8 %), while Gemini AI had the lowest (46.1 %). Gemini AI also had more incorrect (69) than correct answers (59). ChatGPT-4 and ChatGPT-3.5 showed significantly higher accuracy in knowledge-based questions compared to case-based ones (p < 0.05). For case-based questions, Gemini and Gemini Advanced had the lowest accuracy (36.4 %), while other chatbots averaged 45.5 %. In knowledge-based questions, ChatGPT-4 performed best (78.6 %) and Gemini AI the worst (47 %).

Conclusion

ChatGPT-4 excelled in knowledge-based prosthodontic questions, showing potential to enhance dental education through personalized learning and clinical reasoning support. However, its limitations in case-based scenarios highlight the need for optimization to better address complex clinical situations. These findings suggest that AI models can significantly contribute to dental education and clinical practice.

Schlagwörter

Stichwörter der Autor:innen

Artificial intelligenceLarge language modelsMultiple-choice questionProsthodontics

Autor:innen und Institutionen

  • Department of Prosthodontics, Faculty of Dentistry, Bolu Abant Izzet Baysal University, Bolu, Turkey.
  • Department of Prosthodontics, Faculty of Dentistry, The University of Atatürk, Erzurum, Turkey.

Zitieren

APA

Tosun, B., & Yilmaz, Z. S. (2025). Comparison of artificial intelligence systems in answering prosthodontics questions from the dental specialty exam in Turkey. Journal of Dental Sciences, 20(3), 1454-1459. https://doi.org/10.1016/j.jds.2025.01.025

Vancouver

Tosun B, Yilmaz ZS. Comparison of artificial intelligence systems in answering prosthodontics questions from the dental specialty exam in Turkey. Journal of Dental Sciences. 2025;20(3):1454-1459. doi:10.1016/j.jds.2025.01.025

BibTeX
@article{Tosun2025,
  author = {Tosun, Busra and Yilmaz, Zeynep Sen},
  title = {Comparison of artificial intelligence systems in answering prosthodontics questions from the dental specialty exam in Turkey},
  journal = {Journal of Dental Sciences},
  year = {2025},
  volume = {20},
  number = {3},
  pages = {1454--1459},
  doi = {10.1016/j.jds.2025.01.025}
}
Kostenlos starten →