Comparing large language models and search engine responses to common orthodontic questions
PLOS One · 2026
DOI: 10.1371/journal.pone.0339908 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift PLOS One, 2026. Verfasst von Yuanyuan Ren und 1 weiteren Autor:innen. Beteiligte Einrichtung: School of Nursing, Peking University, Beijing, China. Hauptthemen laut MEDLINE: Search Engine, Language, Orthodontics, Patient Education as Topic. Die Arbeit nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
Large Language Models (LLMs) highlight their potential in supporting patient education and self-management. Their performance in responses to orthodontic questions has yet to be explored.
Objectives
This study aims to compare the quality, empathy, readability, and satisfaction of responses from LLMs and search engines on common orthodontic questions.
Methods
Forty-five common orthodontic questions (six categories) and a prompt were developed, and a self-designed multidimensional evaluation questionnaire was constructed. Questions were presented to 5 LLMs and 3 search engines on December,22,2024. The primary outcomes were the median expert-rated scores of LLMs versus search engine responses on quality, empathy, readability, and satisfaction, using 5- or 10-point Likert scales.
Results
LLMs scored significantly higher than search engines in quality (4.00 vs. 3.50, p < 0.001), empathy (3.75 vs. 3.50, p < 0.001), readability (4.00 vs. 3.75, p < 0.001), and satisfaction (8.00 vs. 7.25, p < 0.001). LLM-generated responses were rated significantly higher than those from search engines in therapeutic outcomes category, appliance selection category and cost category.
Conclusions
In this cross-sectional study, the LLMs, particularly GPT-4o, outperformed search engines. These results indicate the potential of LLMs as supplementary tools for orthodontic patient education and self-management.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- School of Nursing, Peking University, Beijing, China.
- Department of Community Nursing, School of Nursing, Peking University, Beijing, China.
ORCID-Profile: Jing Sun
Zitieren
APA
Ren, Y., & Sun, J. (2026). Comparing large language models and search engine responses to common orthodontic questions. PLOS One. https://doi.org/10.1371/journal.pone.0339908
Vancouver
Ren Y, Sun J. Comparing large language models and search engine responses to common orthodontic questions. PLOS One. 2026. doi:10.1371/journal.pone.0339908
BibTeX
@article{Ren2026,
author = {Ren, Yuanyuan and Sun, Jing},
title = {Comparing large language models and search engine responses to common orthodontic questions},
journal = {PLOS One},
year = {2026},
doi = {10.1371/journal.pone.0339908}
}
EUVIMED