EUVIMEDEUVIMED entdecken
BeobachtungsstudieOpen Access · CC BY-NC-ND 4.0

Can Artificial Intelligence Language Models Effectively Address Dental Trauma Questions?

Hasibe Elif Kuru iD, Aslı Aşık iD, Doğukan Mert Demir iD

Dental Traumatology · 2025-10 · 41 (5) · 567-580

DOI: 10.1111/edt.13063 ↗

Kurz gefasst

Beobachtungsstudie in der Zeitschrift Dental Traumatology, 2025-04. Verfasst von Hasibe Elif Kuru und 2 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Dentistry, Department of Pediatric Dentistry, Uşak University, Uşak, Turkey. Hauptthemen laut MEDLINE: Artificial Intelligence, Tooth Injuries, Education, Dental. Die Arbeit wurde bisher 48-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background/Aim Artificial intelligence (AI) chatbots, also known as large language models (LLMs), have become increasingly common educational tools in healthcare. Although the use of LLMs for emergency dental trauma is gaining popularity, it is crucial to assess their reliability. This study aimed to compare the reliabilities of different LLMs in response to multiple questions related to dental trauma. Materials and Methods In a cross‐sectional observational study conducted in October 2024, 30 questions (10 multiple‐choice, 10 fill‐in‐the‐blank, and 10 dichotomous) based on the International Association of Dental Traumatology guidelines were posed to five LLMs: ChatGPT 4, ChatGPT 3.5, Copilot Free version (Copilot F), Copilot Pro (Copilot P), and Google Gemini over nine consecutive days. Responses of each model (1350 in total) were recorded in binary format and analyzed using Pearson's chi‐square and Fisher's exact tests to assess correctness and consistency ( p < 0.05).

Results

The answers provided by the LLMs to repeated questions on consecutive days showed a high degree of repeatability. Although there was no statistically significant difference in the success rate of providing correct answers among the LLMs ( p > 0.05), the rankings based on the rate of successful answers were as follows: ChatGPT 3.5 (76.7%) > Copilot P (73.3%) > Copilot F (70%) > ChatGPT 4 (63.3%) > Gemini (46.7%). ChatGPT 3.5, ChatGPT 4, and Gemini showed a significantly higher correct response rate for multiple choice and fill in the blank questions compared to their performance on dichotomous (true/false) questions ( p < 0.05). Conversely, The Copilot models did not exhibit significant differences across question types. Notably, the explanations provided by Copilot and Gemini were often inaccurate, and Copilot's cited references had low evidential value.

Conclusions

While LLMs show potential as adjunct educational tools in dental traumatology, their variable accuracy and inclusion of unreliable references call for careful integration strategies.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceTooth InjuriesEducation, DentalHumansCross-Sectional StudiesReproducibility of Results

Stichwörter der Autor:innen

artificial intelligencechatbotsdental educationdental traumatologylarge language models

Autor:innen und Institutionen

  • Faculty of Dentistry, Department of Pediatric Dentistry, Uşak University, Uşak, Turkey.
  • Faculty of Dentistry, Department of Pediatric Dentistry, İzmir Tınaztepe University, İzmir, Turkey.
  • Faculty of Dentistry, Uşak University, Uşak, Turkey.

ORCID-Profile: Hasibe Elif Kuru, Aslı Aşık, Doğukan Mert Demir

Zitieren

APA

Kuru, H. E., Aşık, A., & Demir, D. M. (2025). Can Artificial Intelligence Language Models Effectively Address Dental Trauma Questions?. Dental Traumatology, 41(5), 567-580. https://doi.org/10.1111/edt.13063

Vancouver

Kuru HE, Aşık A, Demir DM. Can Artificial Intelligence Language Models Effectively Address Dental Trauma Questions?. Dental Traumatology. 2025;41(5):567-580. doi:10.1111/edt.13063

BibTeX
@article{Kuru2025,
  author = {Kuru, Hasibe Elif and Aşık, Aslı and Demir, Doğukan Mert},
  title = {Can Artificial Intelligence Language Models Effectively Address Dental Trauma Questions?},
  journal = {Dental Traumatology},
  year = {2025},
  volume = {41},
  number = {5},
  pages = {567--580},
  doi = {10.1111/edt.13063}
}
Kostenlos starten →