EUVIMEDEUVIMED entdecken
VergleichsstudieOpen Access · CC BY-NC 4.0

Large Language Models and Retrieval‐Augmented Platforms for the Diagnosis and Management of Periodontal Diseases: A Blinded Expert‐Rated Comparative Study of 11 Systems

Yaniv Mayer iD, Bertha Demetriou, Giulio Rasperini iD, Eran Gabay iD, Rok Gašperšič, Darko Božić iD, Javier Calatrava iD, Ofir Ginesin iD, Hadar Zigdon Giladi, Ricardo Faria Almeida iD

Journal of Clinical Periodontology · 2026

DOI: 10.1111/jcpe.70160 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift Journal of Clinical Periodontology, 2026. Verfasst von Yaniv Mayer und 9 weiteren Autor:innen. Beteiligte Einrichtung: The Ruth and Bruce Rappaport Faculty of Medicine, Technion, Israel Institute of Technology, Haifa, Israel. Hauptthemen laut MEDLINE: Large Language Models, Periodontal Diseases, Information Storage and Retrieval. Die Arbeit nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Aim

To compare retrieval‐augmented systems with general‐purpose large language models (LLMs) on standardised periodontal clinical vignettes. Materials and Methods Eleven AI systems were evaluated: nine general‐purpose LLMs, one general‐purpose retrieval‐augmented platform (Perplexity) and one medical‐domain retrieval‐augmented platform (OpenEvidence). Each responded to 30 synthetic vignettes covering acute, chronic and complex periodontal scenarios. Six blinded periodontists scored responses on a 5‐point Likert scale for accuracy, safety, freedom from hallucinations and completeness in a randomised block design. Friedman and Conover–Iman tests with Holm correction were applied; mixed‐effects and ordinal models served as sensitivity analyses.

Results

At least one parameter scored dangerous (≤ 2) in 3.3%–46.7% of responses across platforms, despite mean composite scores (3.28–4.86) exceeding the rubric midpoint of 3.0. Between‐model differences were significant ( p < 0.001), with a small‐to‐medium overall effect (Kendall's W = 0.17) and large within‐category effects ( W up to 0.82). Perplexity, OpenEvidence and Claude 4.7 Opus formed a top tier.

Conclusion

Retrieval‐augmented systems rated highest, but this advantage was confounded with response length. The dangerous‐response spread argues against undifferentiated use. These tools should assist, not replace, specialist judgement.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Large Language ModelsPeriodontal DiseasesInformation Storage and RetrievalHumansGenerative Artificial Intelligence

Stichwörter der Autor:innen

artificial intelligenceclinical decision supportdiagnosislarge language modelsperiodontitis

Autor:innen und Institutionen

  • The Ruth and Bruce Rappaport Faculty of Medicine, Technion, Israel Institute of Technology, Haifa, Israel.
  • Department of Periodontology, Rambam Health Care Campus, Haifa, Israel.
  • Department of Biomedical, Surgical and Dental Sciences, University of Milan, Milan, Italy.
  • Department of Oral Medicine and Periodontology, Faculty of Medicine, University of Ljubljana, Ljubljana, Slovenia.
  • Department of Periodontology, School of Dental Medicine, University of Zagreb, Zagreb, Croatia.
  • Section of Graduate Periodontology, Faculty of Odontology, University Complutense of Madrid, Madrid, Spain.

ORCID-Profile: Yaniv Mayer, Giulio Rasperini, Eran Gabay, Darko Božić, Javier Calatrava, Ofir Ginesin, Ricardo Faria Almeida

Zitieren

APA

Mayer, Y., Demetriou, B., Rasperini, G., Gabay, E., Gašperšič, R., Božić, D., Calatrava, J., Ginesin, O., Giladi, H. Z., & Almeida, R. F. (2026). Large Language Models and Retrieval‐Augmented Platforms for the Diagnosis and Management of Periodontal Diseases: A Blinded Expert‐Rated Comparative Study of 11 Systems. Journal of Clinical Periodontology. https://doi.org/10.1111/jcpe.70160

Vancouver

Mayer Y, Demetriou B, Rasperini G, Gabay E, Gašperšič R, Božić D, et al. Large Language Models and Retrieval‐Augmented Platforms for the Diagnosis and Management of Periodontal Diseases: A Blinded Expert‐Rated Comparative Study of 11 Systems. Journal of Clinical Periodontology. 2026. doi:10.1111/jcpe.70160

BibTeX
@article{Mayer2026,
  author = {Mayer, Yaniv and Demetriou, Bertha and Rasperini, Giulio and Gabay, Eran and Gašperšič, Rok and Božić, Darko and Calatrava, Javier and Ginesin, Ofir and Giladi, Hadar Zigdon and Almeida, Ricardo Faria},
  title = {Large Language Models and Retrieval‐Augmented Platforms for the Diagnosis and Management of Periodontal Diseases: A Blinded Expert‐Rated Comparative Study of 11 Systems},
  journal = {Journal of Clinical Periodontology},
  year = {2026},
  doi = {10.1111/jcpe.70160}
}
Kostenlos starten →