Large Language Models and Retrieval‐Augmented Platforms for the Diagnosis and Management of Periodontal Diseases: A Blinded Expert‐Rated Comparative Study of 11 Systems
Journal of Clinical Periodontology · 2026
DOI: 10.1111/jcpe.70160 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Journal of Clinical Periodontology, 2026. Verfasst von Yaniv Mayer und 9 weiteren Autor:innen. Beteiligte Einrichtung: The Ruth and Bruce Rappaport Faculty of Medicine, Technion, Israel Institute of Technology, Haifa, Israel. Hauptthemen laut MEDLINE: Large Language Models, Periodontal Diseases, Information Storage and Retrieval. Die Arbeit nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Aim
To compare retrieval‐augmented systems with general‐purpose large language models (LLMs) on standardised periodontal clinical vignettes. Materials and Methods Eleven AI systems were evaluated: nine general‐purpose LLMs, one general‐purpose retrieval‐augmented platform (Perplexity) and one medical‐domain retrieval‐augmented platform (OpenEvidence). Each responded to 30 synthetic vignettes covering acute, chronic and complex periodontal scenarios. Six blinded periodontists scored responses on a 5‐point Likert scale for accuracy, safety, freedom from hallucinations and completeness in a randomised block design. Friedman and Conover–Iman tests with Holm correction were applied; mixed‐effects and ordinal models served as sensitivity analyses.
Results
At least one parameter scored dangerous (≤ 2) in 3.3%–46.7% of responses across platforms, despite mean composite scores (3.28–4.86) exceeding the rubric midpoint of 3.0. Between‐model differences were significant ( p < 0.001), with a small‐to‐medium overall effect (Kendall's W = 0.17) and large within‐category effects ( W up to 0.82). Perplexity, OpenEvidence and Claude 4.7 Opus formed a top tier.
Conclusion
Retrieval‐augmented systems rated highest, but this advantage was confounded with response length. The dangerous‐response spread argues against undifferentiated use. These tools should assist, not replace, specialist judgement.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- The Ruth and Bruce Rappaport Faculty of Medicine, Technion, Israel Institute of Technology, Haifa, Israel.
- Department of Periodontology, Rambam Health Care Campus, Haifa, Israel.
- Department of Biomedical, Surgical and Dental Sciences, University of Milan, Milan, Italy.
- Department of Oral Medicine and Periodontology, Faculty of Medicine, University of Ljubljana, Ljubljana, Slovenia.
- Department of Periodontology, School of Dental Medicine, University of Zagreb, Zagreb, Croatia.
- Section of Graduate Periodontology, Faculty of Odontology, University Complutense of Madrid, Madrid, Spain.
ORCID-Profile: Yaniv Mayer, Giulio Rasperini, Eran Gabay, Darko Božić, Javier Calatrava, Ofir Ginesin, Ricardo Faria Almeida
Zitieren
APA
Mayer, Y., Demetriou, B., Rasperini, G., Gabay, E., Gašperšič, R., Božić, D., Calatrava, J., Ginesin, O., Giladi, H. Z., & Almeida, R. F. (2026). Large Language Models and Retrieval‐Augmented Platforms for the Diagnosis and Management of Periodontal Diseases: A Blinded Expert‐Rated Comparative Study of 11 Systems. Journal of Clinical Periodontology. https://doi.org/10.1111/jcpe.70160
Vancouver
Mayer Y, Demetriou B, Rasperini G, Gabay E, Gašperšič R, Božić D, et al. Large Language Models and Retrieval‐Augmented Platforms for the Diagnosis and Management of Periodontal Diseases: A Blinded Expert‐Rated Comparative Study of 11 Systems. Journal of Clinical Periodontology. 2026. doi:10.1111/jcpe.70160
BibTeX
@article{Mayer2026,
author = {Mayer, Yaniv and Demetriou, Bertha and Rasperini, Giulio and Gabay, Eran and Gašperšič, Rok and Božić, Darko and Calatrava, Javier and Ginesin, Ofir and Giladi, Hadar Zigdon and Almeida, Ricardo Faria},
title = {Large Language Models and Retrieval‐Augmented Platforms for the Diagnosis and Management of Periodontal Diseases: A Blinded Expert‐Rated Comparative Study of 11 Systems},
journal = {Journal of Clinical Periodontology},
year = {2026},
doi = {10.1111/jcpe.70160}
}
EUVIMED