EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Domain-Specific vs. General-Purpose Large Language Models in Orthodontics: A Blinded Comparison of AlimGPT, GPT-4o, Gemini, and Llama

Sertaç Aksakallı, Bilgin Giray iD, Çağrı Temel iD

Dentistry Journal · 08.04.2026 · 14 (4) · 219

DOI: 10.3390/dj14040219 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Dentistry Journal, online erschienen am 08.04.2026. Verfasst von Sertaç Aksakallı und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Orthodontics, Istanbul Gelisim University, Istanbul 34310, Turkey. Die Arbeit nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

The application of artificial intelligence (AI) in orthodontics has evolved rapidly in recent years, encompassing areas such as diagnosis, treatment planning, and patient management, and AlimGPT is an AI-based tool that provides treatment options based on data and algorithms.

Methods

Fourteen different orthodontic questions were asked to each model, and answers were analyzed. This study aimed to compare AlimGPT with GPT-4o, Gemini, and Llama using standardized tests to evaluate the quality of information provided, including the Likert scale, modified DISCERN (mDISCERN), and modified Global Quality Score (mGQS).

Results

Significant differences were detected for reliability (χ2 = 15.267, p = 0.0016) and usefulness (χ2 = 20.557, p = 0.0001). Post hoc tests showed AlimGPT > Gemini and Llama for reliability and AlimGPT > GPT-4o, Gemini, and Llama for usefulness. mDISCERN was significant overall (χ2 = 11.047, p = 0.0115), but no pairwise contrast met adjusted significance; mGQS showed no significant differences (χ2 = 7.071, p = 0.0697). Inter-rater agreement was moderate-to-good for reliability (ICC = 0.710, 95% CI 0.60–0.80) and usefulness (ICC = 0.729, 95% CI 0.63–0.82), moderate for mGQS (ICC = 0.596, 95% CI 0.47–0.71), and poor-to-moderate for mDISCERN (ICC = 0.435, 95% CI 0.30–0.58).

Conclusions

In this blinded, within-subjects experiment, the domain-specific model (AlimGPT) received higher clinician ratings for usefulness and, for reliability, exceeded two general baselines. Differences in mGQS were not detected. Expanding the number of raters, increasing item diversity or integrating updated baselines would be beneficial.

Schlagwörter

Stichwörter der Autor:innen

artificial intelligencelanguage modelorthodontic planningreliability

Autor:innen und Institutionen

  • Department of Orthodontics, Istanbul Gelisim University, Istanbul 34310, Turkey.
  • Department of Orthodontics, Cyprus Health and Social Sciences University, Guzelyurt 99750, Cyprus.
  • Hezarfen LLC, Mountain View, CA 34990, USA.

ORCID-Profile: Bilgin Giray, Çağrı Temel

Zitieren

APA

Aksakallı, S., Giray, B., & Temel, Ç. (2026). Domain-Specific vs. General-Purpose Large Language Models in Orthodontics: A Blinded Comparison of AlimGPT, GPT-4o, Gemini, and Llama. Dentistry Journal, 14(4), 219. https://doi.org/10.3390/dj14040219

Vancouver

Aksakallı S, Giray B, Temel Ç. Domain-Specific vs. General-Purpose Large Language Models in Orthodontics: A Blinded Comparison of AlimGPT, GPT-4o, Gemini, and Llama. Dentistry Journal. 2026;14(4):219. doi:10.3390/dj14040219

BibTeX
@article{Aksakall2026,
  author = {Aksakallı, Sertaç and Giray, Bilgin and Temel, Çağrı},
  title = {Domain-Specific vs. General-Purpose Large Language Models in Orthodontics: A Blinded Comparison of AlimGPT, GPT-4o, Gemini, and Llama},
  journal = {Dentistry Journal},
  year = {2026},
  volume = {14},
  number = {4},
  pages = {219},
  doi = {10.3390/dj14040219}
}
Kostenlos starten →