Development and Comparative Evaluation of a Reinstructed GPT ‐4o Model Specialized in Periodontology
Journal of Clinical Periodontology · 2025-05 · 52 (5) · 707-716
DOI: 10.1111/jcpe.14101 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Journal of Clinical Periodontology, online erschienen am 26.12.2024. Verfasst von Francesco Fanelli und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Clinical and Experimental Medicine, University of Foggia, Foggia, Italy. Hauptthemen laut MEDLINE: Periodontics, Artificial Intelligence. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Background
Artificial intelligence (AI) has the potential to enhance healthcare practices, including periodontology, by improving diagnostics, treatment planning and patient care. This study introduces ‘PerioGPT’, a specialized AI model designed to provide up‐to‐date periodontal knowledge using GPT‐4o and a novel retrieval‐augmented generation (RAG) system.
Methods
PerioGPT was evaluated in two phases. First, its performance was compared against those of five other chatbots using 50 periodontal questions from specialists, followed by a validation with 71 questions from the 2023–2024 ‘In‐Service Examination’ of the American Academy of Periodontology (AAP). The second phase focused on assessing PerioGPT's generative capacity, specifically its ability to create complex and accurate periodontal questions.
Results
PerioGPT outperformed other chatbots, achieving a higher accuracy rate (81.16%) and generating more complex and precise questions with a mean complexity score of 3.81 ± 0.965 and an accuracy score of 4.35 ± 0.898. These results demonstrate PerioGPT's potential as a leading tool for creating reliable clinical queries in periodontology.
Conclusions
This study underscores the transformative potential of AI in periodontology, illustrating that specialized models can offer significant advantages over general language models for both educational and clinical applications. The findings highlight that tailoring AI technologies to specific medical fields may improve performance and relevance.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Clinical and Experimental Medicine, University of Foggia, Foggia, Italy.
- Department of Periodontics and Oral Medicine, University of Michigan School of Dentistry, Ann Arbor, Michigan, USA.
- Centre for Host Microbiome Interactions, Faculty of Dentistry, Oral and Craniofacial Sciences, King's College London, London, UK.
- Department of Medicine and Surgery, LUM University, Casamassima, Italy.
ORCID-Profile: Muhammad Saleh, Pasquale Santamaria, Luigi Nibali, Giuseppe Troiano
Zitieren
APA
Fanelli, F., Saleh, M., Santamaria, P., Zhurakivska, K., Nibali, L., & Troiano, G. (2025). Development and Comparative Evaluation of a Reinstructed GPT ‐4o Model Specialized in Periodontology. Journal of Clinical Periodontology, 52(5), 707-716. https://doi.org/10.1111/jcpe.14101
Vancouver
Fanelli F, Saleh M, Santamaria P, Zhurakivska K, Nibali L, Troiano G. Development and Comparative Evaluation of a Reinstructed GPT ‐4o Model Specialized in Periodontology. Journal of Clinical Periodontology. 2025;52(5):707-716. doi:10.1111/jcpe.14101
BibTeX
@article{Fanelli2025,
author = {Fanelli, Francesco and Saleh, Muhammad and Santamaria, Pasquale and Zhurakivska, Khrystyna and Nibali, Luigi and Troiano, Giuseppe},
title = {Development and Comparative Evaluation of a Reinstructed GPT ‐4o Model Specialized in Periodontology},
journal = {Journal of Clinical Periodontology},
year = {2025},
volume = {52},
number = {5},
pages = {707--716},
doi = {10.1111/jcpe.14101}
}
EUVIMED