Assessment of ChatGPT's Performance on the ACP 2024 National Prosthodontics Resident Exam (NPRE)
European Journal of Dental Education · 2026
DOI: 10.1111/eje.70045 ↗Kurz gefasst
Fachartikel in der Zeitschrift European Journal of Dental Education, 2026. Verfasst von Abdulrahman Almalki und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Prosthodontics, College of Dentistry, Prince Sattam Bin Abdulaziz University, Al-Kharj, Riyadh, Saudi Arabia. Hauptthemen laut MEDLINE: Prosthodontics, Educational Measurement, Internship and Residency, Education, Dental, Graduate. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 12 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Purpose
To evaluate the performance of ChatGPT on the National Prosthodontics Resident Exam (NPRE).
Methods
Two separate OpenAI accounts were used for ChatGPT 3.5 and ChatGPT 4.0, each managed by independent examiners. The dataset was sourced from the American College of Prosthodontics (ACP) 2024 National Prosthodontics Resident Exam (NPRE), which includes 150 multiple‐choice board‐style questions on various prosthodontic topics. Questions were inputted as they appeared in the NPRE, and responses were recorded as correct or incorrect. Accuracy was assessed using a two‐tailed t‐test, with statistical significance set at p < 0.05. After the study was completed, OpenAI accounts were deleted to ensure data privacy and security.
Results
ChatGPT 3.5 correctly answered 84 out of 150 questions, achieving a score of 56.0%; while ChatGPT 4 significantly outperformed it with a score of 73.7%, correctly answering 109 out of 150 questions ( p < 0.001). In specific subjects, ChatGPT 4 consistently scored higher, with significant improvements in Basic Science (71.2% vs. 61.3%), Implant Surgery (67.5% vs. 41.2%), Diagnosis and Treatment Planning (66.6% vs. 53.4%) and Fixed Prosthodontics (86.9% vs. 62.5%). The highest scores for both versions were in Dental Materials, with ChatGPT 4 achieving 91.6% compared to ChatGPT 3.5's 73.1%.
Conclusion
ChatGPT 4.0 shows promising potential as an educational tool for prosthodontics residents by effectively addressing board‐style questions. However, due to a significant presence of misinformation in ChatGPT's current prosthodontics knowledge base, residents should exercise caution and supplement AI‐generated content with evidence‐based information from credible sources to ensure accuracy and reliability.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Prosthodontics, College of Dentistry, Prince Sattam Bin Abdulaziz University, Al-Kharj, Riyadh, Saudi Arabia.
- Department of Restorative and Preventive Dentistry, School of Penn Dental Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA.
- Department of Prosthodontics, Faculty of Dentistry, Mansoura University, Mansoura, Egypt.
ORCID-Profile: Heba Wageh Abozaed
Zitieren
APA
Almalki, A., Althubaitiy, R. O., Alkhtani, F., Anadioti, E., & Abozaed, H. W. (2026). Assessment of ChatGPT's Performance on the ACP 2024 National Prosthodontics Resident Exam (NPRE). European Journal of Dental Education. https://doi.org/10.1111/eje.70045
Vancouver
Almalki A, Althubaitiy RO, Alkhtani F, Anadioti E, Abozaed HW. Assessment of ChatGPT's Performance on the ACP 2024 National Prosthodontics Resident Exam (NPRE). European Journal of Dental Education. 2026. doi:10.1111/eje.70045
BibTeX
@article{Almalki2026,
author = {Almalki, Abdulrahman and Althubaitiy, Ramzi O and Alkhtani, Fahad and Anadioti, Evanthia and Abozaed, Heba Wageh},
title = {Assessment of ChatGPT's Performance on the ACP 2024 National Prosthodontics Resident Exam (NPRE)},
journal = {European Journal of Dental Education},
year = {2026},
doi = {10.1111/eje.70045}
}
EUVIMED