EUVIMEDEUVIMED entdecken
Vergleichsstudie

Comparative evaluation of large language models in interpreting the scientific literature on intraoral scanners across varying input levels

Pranay Jain, Fathima Banu R, Anand Kumar V, Sarvesh Kulkarni, Maheshwaran Ks

The Journal of Prosthetic Dentistry · 2026-11 · 136 (5) · 1310-1318

DOI: 10.1016/j.prosdent.2026.08.008 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift The Journal of Prosthetic Dentistry, 2026-11. Verfasst von Pranay Jain und 4 weiteren Autor:innen. Beteiligte Einrichtung: Postgraduate student, Department of Prosthodontics, Sri Ramachandra Dental College & Hospital, Sri Ramachandra Institute of Higher Education and Rese…. Hauptthemen laut MEDLINE: Large Language Models. Die Arbeit nennt 41 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

STATEMENT OF PROBLEM: Dental professionals increasingly seek artificial intelligence (AI)-generated sources for concise information on emerging topics in advancement and scientific literature; however, concerns persist regarding the accuracy of AI tools and the reliability of responses generated based on the complexity of the prompt. PURPOSE: The purpose of this study was to evaluate and compare the response accuracy of 2 advanced large language models (LLMs): OpenAI ChatGPT-5.2 (Auto) and Google Gemini-3.0 Flash in interpreting and analyzing published data on intraoral scanners. MATERIAL AND METHODS: A total of 20 articles were selected through a structured PubMed search. Two independent senior prosthodontists were blinded and assessed every response generated by the LLMs at each prompt level. Prompts were fed at different levels (1-4) of complexity: Level 1 consisted of simplified prompts requiring high logical reasoning by the LLM, while Level 4 consisted of a structured prompt including methodology. The responses were evaluated across the 4 domains of relevance, scientific accuracy, clarity, and closeness to article content using a 5-point Likert scale. The nonparametric Friedman test and Wilcoxon signed-rank test with Bonferroni correction were conducted for statistical analysis (α=.05). RESULTS: The median output for ChatGPT-5.2 for relevance of answer and clarity were higher than for Gemini-3.0 at the simpler prompt levels of Level 1 and Level 2 (P .05). In contrast, Gemini-3.0 outperformed ChatGPT-5.2 in closeness to article at Level 2 (P

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Large Language ModelsHumansGenerative Artificial IntelligenceReproducibility of Results

Autor:innen und Institutionen

  • Postgraduate student, Department of Prosthodontics, Sri Ramachandra Dental College & Hospital, Sri Ramachandra Institute of Higher Education and Research, Porur, Tamil Nadu, India.
  • Reader, Department of Prosthodontics, Sri Ramachandra Dental College & Hospital, Sri Ramachandra Institute of Higher Education and Research, Porur, Tamil Nadu, India. Electronic address: drfathimabanu@yahoo.com.
  • Professor, Department of Prosthodontics, Sri Ramachandra Dental College & Hospital, Sri Ramachandra Institute of Higher Education and Research, Porur, Tamil Nadu, India; Ex-Professor, Department of Prosthodontics, Sri R…
  • Senior Lecturer, Department of Prosthodontics, Sri Ramachandra Dental College & Hospital, Sri Ramachandra Institute of Higher Education and Research, Porur, Tamil Nadu, India.

Zitieren

APA

Jain, P., R, F. B., V, A. K., Kulkarni, S., & Ks, M. (2026). Comparative evaluation of large language models in interpreting the scientific literature on intraoral scanners across varying input levels. The Journal of Prosthetic Dentistry, 136(5), 1310-1318. https://doi.org/10.1016/j.prosdent.2026.08.008

Vancouver

Jain P, R FB, V AK, Kulkarni S, Ks M. Comparative evaluation of large language models in interpreting the scientific literature on intraoral scanners across varying input levels. The Journal of Prosthetic Dentistry. 2026;136(5):1310-1318. doi:10.1016/j.prosdent.2026.08.008

BibTeX
@article{Jain2026,
  author = {Jain, Pranay and R, Fathima Banu and V, Anand Kumar and Kulkarni, Sarvesh and Ks, Maheshwaran},
  title = {Comparative evaluation of large language models in interpreting the scientific literature on intraoral scanners across varying input levels},
  journal = {The Journal of Prosthetic Dentistry},
  year = {2026},
  volume = {136},
  number = {5},
  pages = {1310--1318},
  doi = {10.1016/j.prosdent.2026.08.008}
}
Kostenlos starten →