EUVIMEDEUVIMED entdecken
Leitlinie

Can large language models adhere to clinical guidelines in tooth avulsion management? A repeated-measures comparative study

Banu Çiçek Tez Yaşar, Meltem Karahan, Arif Yiğit Güler, Bahar Başak Kızıltan Eliaçık

Anatolian Current Medical Journal · 25.10.2026 · 8 (6) · 1199-1207

DOI: 10.38053/acmj.2002163 ↗

Kurz gefasst

Leitlinie in der Zeitschrift Anatolian Current Medical Journal, online erschienen am 25.10.2026. Verfasst von Banu Çiçek Tez Yaşar und 3 weiteren Autor:innen. Die Arbeit nennt 18 Literaturangaben. Gefördert von: This research received no funding..

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Aims

To comparatively evaluate adherence to the 2020 International Association of Dental Traumatology (IADT) guidelines and short-term temporal consistency across three large language models (LLMs)-ChatGPT (GPT-5.5), Gemini 2.5 Flash, and Microsoft Copilot-when answering open-ended questions on tooth avulsion management.

Methods

Fourteen open-ended questions were categorized into four domains: Emergency and first aid, clinical management, prognosis and critical factors, and advanced decision-making. Each question was submitted to each LLM three times daily for three consecutive days. Two pediatric dentists classified responses as correct or incorrect by consensus using a guideline-based answer key. Cochran’s Q and post hoc McNemar tests were used for comparisons.

Results

Among 378 responses, ChatGPT generated the highest number of correct responses (94/126; 74.6%), followed by Gemini (87/126; 69.0%) and Copilot (79/126; 62.7%). The overall intermodel difference was significant (p=0.021), with a significant pairwise difference only between ChatGPT and Copilot (p=0.015). No significant differences were observed in emergency and first aid, clinical management, or prognosis and critical factors (p>0.05). Advanced decision-making differed significantly among models (p=0.008), particularly between ChatGPT and Gemini (p=0.016). No significant within-day or across-day variation was detected (p>0.05).

Conclusion

The evaluated LLMs showed no statistically significant short-term temporal variation, but their adherence to IADT recommendations varied across models and clinical domains. ChatGPT achieved the highest performance, while the greatest divergence occurred in the predefined Advanced Decision-Making domain, specifically in questions concerning extra-alveolar dry time and delayed replantation. These models should be used only as adjunctive tools, with recommendations verified against guidelines under professional supervision.

Förderung

  • This research received no funding.

Zitieren

APA

Yaşar, B. Ç. T., Karahan, M., Güler, A. Y., & Eliaçık, B. B. K. (2026). Can large language models adhere to clinical guidelines in tooth avulsion management? A repeated-measures comparative study. Anatolian Current Medical Journal, 8(6), 1199-1207. https://doi.org/10.38053/acmj.2002163

Vancouver

Yaşar BÇT, Karahan M, Güler AY, Eliaçık BBK. Can large language models adhere to clinical guidelines in tooth avulsion management? A repeated-measures comparative study. Anatolian Current Medical Journal. 2026;8(6):1199-1207. doi:10.38053/acmj.2002163

BibTeX
@article{Yaar2026,
  author = {Yaşar, Banu Çiçek Tez and Karahan, Meltem and Güler, Arif Yiğit and Eliaçık, Bahar Başak Kızıltan},
  title = {Can large language models adhere to clinical guidelines in tooth avulsion management? A repeated-measures comparative study},
  journal = {Anatolian Current Medical Journal},
  year = {2026},
  volume = {8},
  number = {6},
  pages = {1199--1207},
  doi = {10.38053/acmj.2002163}
}
Kostenlos starten →