Evaluation of Large Language Model‐Based Chatbots for Dental Trauma Management: A Comparative Study Based on Accuracy, Consistency and Information Quality
Australian Endodontic Journal · 2026-08 · 52 (2) · 356-363
DOI: 10.1111/aej.70055 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Australian Endodontic Journal, online erschienen am 08.01.2026. Verfasst von Vasfiye Isik und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Endodontics, Faculty of Dentistry, Istanbul University-Cerrahpaşa, Istanbul, Turkey. Hauptthemen laut MEDLINE: Tooth Injuries, Large Language Models. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
This study evaluated and compared the accuracy, consistency, readability, and information quality of three LLM‐based chatbots, namely ChatGPT‐5, Claude AI (Sonnet 4.0), and Perplexity (Mistral Large 2), in addressing traumatic dental injury questions. Forty true/false statements were submitted to each chatbot three times at weekly intervals to assess accuracy and consistency. Additionally, chatbot responses for 25 open‐ended case‐based questions were evaluated for readability, understandability and actionability, information reliability and quality. For true/false questions, Perplexity showed the highest accuracy, followed by Claude and ChatGPT. For open‐ended responses, ChatGPT excelled in readability (FRE: 62.4 ± 7.6), Perplexity in understandability (91.0 ± 4.3) and actionability (93.0 ± 6.4) and Claude in information reliability (mDISCERN total: 61.2; no variability observed). All chatbots achieved acceptable global quality scores (> 4.4). These findings emphasise the complementary role of chatbots in dental trauma management. Tool selection should be based on intended use, while continued human oversight remains essential in clinical decision‐making.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Endodontics, Faculty of Dentistry, Istanbul University-Cerrahpaşa, Istanbul, Turkey.
- Faculty of Dentistry, Istanbul University-Cerrahpaşa, Istanbul, Turkey.
- Department of Restorative Dentistry, Faculty of Dentistry, Istanbul University-Cerrahpaşa, Istanbul, Turkey.
ORCID-Profile: Vasfiye Isik, Rana Ikbal Sengul, Soner Sismanoglu
Zitieren
APA
Isik, V., Sengul, R. I., & Sismanoglu, S. (2026). Evaluation of Large Language Model‐Based Chatbots for Dental Trauma Management: A Comparative Study Based on Accuracy, Consistency and Information Quality. Australian Endodontic Journal, 52(2), 356-363. https://doi.org/10.1111/aej.70055
Vancouver
Isik V, Sengul RI, Sismanoglu S. Evaluation of Large Language Model‐Based Chatbots for Dental Trauma Management: A Comparative Study Based on Accuracy, Consistency and Information Quality. Australian Endodontic Journal. 2026;52(2):356-363. doi:10.1111/aej.70055
BibTeX
@article{Isik2026,
author = {Isik, Vasfiye and Sengul, Rana Ikbal and Sismanoglu, Soner},
title = {Evaluation of Large Language Model‐Based Chatbots for Dental Trauma Management: A Comparative Study Based on Accuracy, Consistency and Information Quality},
journal = {Australian Endodontic Journal},
year = {2026},
volume = {52},
number = {2},
pages = {356--363},
doi = {10.1111/aej.70055}
}
EUVIMED