EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Evaluating the Accuracy, Reliability, Consistency, and Readability of Different Large Language Models in Restorative Dentistry

Zeyneb Merve Ozdemir iD, Emre Yapici iD

Journal of Esthetic and Restorative Dentistry · 2025

DOI: 10.1111/jerd.13447 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Esthetic and Restorative Dentistry, 2025. Verfasst von Zeyneb Merve Ozdemir und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Restorative Dentistry, Faculty of Dentistry, Kahramanmaras Sutcu Imam University, Kahramanmaras, Turkey. Hauptthemen laut MEDLINE: Comprehension, Dental Restoration, Permanent, Artificial Intelligence, Language. Die Arbeit wurde bisher 38-mal zitiert (Crossref) und nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

This study aimed to evaluate the reliability, consistency, and readability of responses provided by various artificial intelligence (AI) programs to questions related to Restorative Dentistry. Materials and Methods Forty‐five knowledge‐based information and 20 questions (10 patient‐related and 10 dentistry‐specific) were posed to ChatGPT‐3.5, ChatGPT‐4, ChatGPT‐4o, Chatsonic, Copilot, and Gemini Advanced chatbots. The DISCERN questionnaire was used to assess the reliability; Flesch Reading Ease and Flesch–Kincaid Grade Level scores were utilized to evaluate readability. Accuracy and consistency were determined based on the chatbots' responses to the knowledge‐based questions.

Results

ChatGPT‐4, ChatGPT‐4o, Chatsonic, and Copilot demonstrated “good” reliability, while ChatGPT‐3.5 and Gemini Advanced showed “fair” reliability. Chatsonic exhibited the highest “DISCERN total score” for patient‐related questions, while ChatGPT‐4o performed best for dentistry‐specific questions. No significant differences were found in readability among the chatbots ( p > 0.05). ChatGPT‐4o showed the highest accuracy (93.3%) for knowledge‐based questions, while Copilot had the lowest (68.9%). ChatGPT‐4 demonstrated the highest consistency between repetitions.

Conclusion

Performance of AIs varied in terms of accuracy, reliability, consistency, and readability when responding to Restorative Dentistry questions. ChatGPT‐4o and Chatsonic showed promising results for academic and patient education applications. However, the readability of responses was generally above recommended levels for patient education materials. Clinical Significance The utilization of AI has an increasing impact on various aspects of dentistry. Moreover, if the responses to patient‐related and dentistry‐specific questions in restorative dentistry prove to be reliable and comprehensible, this may yield promising outcomes for the future.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

ComprehensionDental Restoration, PermanentArtificial IntelligenceLanguageDentistry, OperativeHumansReproducibility of ResultsSurveys and QuestionnairesLarge Language Models

Stichwörter der Autor:innen

accuracyartificial intelligenceconsistencyreadabilityreliability

Autor:innen und Institutionen

  • Department of Restorative Dentistry, Faculty of Dentistry, Kahramanmaras Sutcu Imam University, Kahramanmaras, Turkey.

ORCID-Profile: Zeyneb Merve Ozdemir, Emre Yapici

Zitieren

APA

Ozdemir, Z. M., & Yapici, E. (2025). Evaluating the Accuracy, Reliability, Consistency, and Readability of Different Large Language Models in Restorative Dentistry. Journal of Esthetic and Restorative Dentistry. https://doi.org/10.1111/jerd.13447

Vancouver

Ozdemir ZM, Yapici E. Evaluating the Accuracy, Reliability, Consistency, and Readability of Different Large Language Models in Restorative Dentistry. Journal of Esthetic and Restorative Dentistry. 2025. doi:10.1111/jerd.13447

BibTeX
@article{Ozdemir2025,
  author = {Ozdemir, Zeyneb Merve and Yapici, Emre},
  title = {Evaluating the Accuracy, Reliability, Consistency, and Readability of Different Large Language Models in Restorative Dentistry},
  journal = {Journal of Esthetic and Restorative Dentistry},
  year = {2025},
  doi = {10.1111/jerd.13447}
}
Kostenlos starten →