Domain-Specific vs. General-Purpose Large Language Models in Orthodontics: A Blinded Comparison of AlimGPT, GPT-4o, Gemini, and Llama
Dentistry Journal · 08.04.2026 · 14 (4) · 219
DOI: 10.3390/dj14040219 ↗Kurz gefasst
Fachartikel in der Zeitschrift Dentistry Journal, online erschienen am 08.04.2026. Verfasst von Sertaç Aksakallı und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Orthodontics, Istanbul Gelisim University, Istanbul 34310, Turkey. Die Arbeit nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Objective
The application of artificial intelligence (AI) in orthodontics has evolved rapidly in recent years, encompassing areas such as diagnosis, treatment planning, and patient management, and AlimGPT is an AI-based tool that provides treatment options based on data and algorithms.
Methods
Fourteen different orthodontic questions were asked to each model, and answers were analyzed. This study aimed to compare AlimGPT with GPT-4o, Gemini, and Llama using standardized tests to evaluate the quality of information provided, including the Likert scale, modified DISCERN (mDISCERN), and modified Global Quality Score (mGQS).
Results
Significant differences were detected for reliability (χ2 = 15.267, p = 0.0016) and usefulness (χ2 = 20.557, p = 0.0001). Post hoc tests showed AlimGPT > Gemini and Llama for reliability and AlimGPT > GPT-4o, Gemini, and Llama for usefulness. mDISCERN was significant overall (χ2 = 11.047, p = 0.0115), but no pairwise contrast met adjusted significance; mGQS showed no significant differences (χ2 = 7.071, p = 0.0697). Inter-rater agreement was moderate-to-good for reliability (ICC = 0.710, 95% CI 0.60–0.80) and usefulness (ICC = 0.729, 95% CI 0.63–0.82), moderate for mGQS (ICC = 0.596, 95% CI 0.47–0.71), and poor-to-moderate for mDISCERN (ICC = 0.435, 95% CI 0.30–0.58).
Conclusions
In this blinded, within-subjects experiment, the domain-specific model (AlimGPT) received higher clinician ratings for usefulness and, for reliability, exceeded two general baselines. Differences in mGQS were not detected. Expanding the number of raters, increasing item diversity or integrating updated baselines would be beneficial.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Orthodontics, Istanbul Gelisim University, Istanbul 34310, Turkey.
- Department of Orthodontics, Cyprus Health and Social Sciences University, Guzelyurt 99750, Cyprus.
- Hezarfen LLC, Mountain View, CA 34990, USA.
ORCID-Profile: Bilgin Giray, Çağrı Temel
Zitieren
APA
Aksakallı, S., Giray, B., & Temel, Ç. (2026). Domain-Specific vs. General-Purpose Large Language Models in Orthodontics: A Blinded Comparison of AlimGPT, GPT-4o, Gemini, and Llama. Dentistry Journal, 14(4), 219. https://doi.org/10.3390/dj14040219
Vancouver
Aksakallı S, Giray B, Temel Ç. Domain-Specific vs. General-Purpose Large Language Models in Orthodontics: A Blinded Comparison of AlimGPT, GPT-4o, Gemini, and Llama. Dentistry Journal. 2026;14(4):219. doi:10.3390/dj14040219
BibTeX
@article{Aksakall2026,
author = {Aksakallı, Sertaç and Giray, Bilgin and Temel, Çağrı},
title = {Domain-Specific vs. General-Purpose Large Language Models in Orthodontics: A Blinded Comparison of AlimGPT, GPT-4o, Gemini, and Llama},
journal = {Dentistry Journal},
year = {2026},
volume = {14},
number = {4},
pages = {219},
doi = {10.3390/dj14040219}
}
EUVIMED