Comparative evaluation of large language models in interpreting the scientific literature on intraoral scanners across varying input levels
The Journal of Prosthetic Dentistry · 2026-11 · 136 (5) · 1310-1318
DOI: 10.1016/j.prosdent.2026.08.008 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift The Journal of Prosthetic Dentistry, 2026-11. Verfasst von Pranay Jain und 4 weiteren Autor:innen. Beteiligte Einrichtung: Postgraduate student, Department of Prosthodontics, Sri Ramachandra Dental College & Hospital, Sri Ramachandra Institute of Higher Education and Rese…. Hauptthemen laut MEDLINE: Large Language Models. Die Arbeit nennt 41 Literaturangaben.
Abstract (Originalsprache)
STATEMENT OF PROBLEM: Dental professionals increasingly seek artificial intelligence (AI)-generated sources for concise information on emerging topics in advancement and scientific literature; however, concerns persist regarding the accuracy of AI tools and the reliability of responses generated based on the complexity of the prompt. PURPOSE: The purpose of this study was to evaluate and compare the response accuracy of 2 advanced large language models (LLMs): OpenAI ChatGPT-5.2 (Auto) and Google Gemini-3.0 Flash in interpreting and analyzing published data on intraoral scanners. MATERIAL AND METHODS: A total of 20 articles were selected through a structured PubMed search. Two independent senior prosthodontists were blinded and assessed every response generated by the LLMs at each prompt level. Prompts were fed at different levels (1-4) of complexity: Level 1 consisted of simplified prompts requiring high logical reasoning by the LLM, while Level 4 consisted of a structured prompt including methodology. The responses were evaluated across the 4 domains of relevance, scientific accuracy, clarity, and closeness to article content using a 5-point Likert scale. The nonparametric Friedman test and Wilcoxon signed-rank test with Bonferroni correction were conducted for statistical analysis (α=.05). RESULTS: The median output for ChatGPT-5.2 for relevance of answer and clarity were higher than for Gemini-3.0 at the simpler prompt levels of Level 1 and Level 2 (P .05). In contrast, Gemini-3.0 outperformed ChatGPT-5.2 in closeness to article at Level 2 (P
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Postgraduate student, Department of Prosthodontics, Sri Ramachandra Dental College & Hospital, Sri Ramachandra Institute of Higher Education and Research, Porur, Tamil Nadu, India.
- Reader, Department of Prosthodontics, Sri Ramachandra Dental College & Hospital, Sri Ramachandra Institute of Higher Education and Research, Porur, Tamil Nadu, India. Electronic address: drfathimabanu@yahoo.com.
- Professor, Department of Prosthodontics, Sri Ramachandra Dental College & Hospital, Sri Ramachandra Institute of Higher Education and Research, Porur, Tamil Nadu, India; Ex-Professor, Department of Prosthodontics, Sri R…
- Senior Lecturer, Department of Prosthodontics, Sri Ramachandra Dental College & Hospital, Sri Ramachandra Institute of Higher Education and Research, Porur, Tamil Nadu, India.
Zitieren
APA
Jain, P., R, F. B., V, A. K., Kulkarni, S., & Ks, M. (2026). Comparative evaluation of large language models in interpreting the scientific literature on intraoral scanners across varying input levels. The Journal of Prosthetic Dentistry, 136(5), 1310-1318. https://doi.org/10.1016/j.prosdent.2026.08.008
Vancouver
Jain P, R FB, V AK, Kulkarni S, Ks M. Comparative evaluation of large language models in interpreting the scientific literature on intraoral scanners across varying input levels. The Journal of Prosthetic Dentistry. 2026;136(5):1310-1318. doi:10.1016/j.prosdent.2026.08.008
BibTeX
@article{Jain2026,
author = {Jain, Pranay and R, Fathima Banu and V, Anand Kumar and Kulkarni, Sarvesh and Ks, Maheshwaran},
title = {Comparative evaluation of large language models in interpreting the scientific literature on intraoral scanners across varying input levels},
journal = {The Journal of Prosthetic Dentistry},
year = {2026},
volume = {136},
number = {5},
pages = {1310--1318},
doi = {10.1016/j.prosdent.2026.08.008}
}
EUVIMED