EUVIMEDEUVIMED entdecken
VergleichsstudieOpen Access · CC BY 4.0

Comparing large language models and search engine responses to common orthodontic questions

Yuanyuan Ren, Jing Sun iD

PLOS One · 2026

DOI: 10.1371/journal.pone.0339908 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift PLOS One, 2026. Verfasst von Yuanyuan Ren und 1 weiteren Autor:innen. Beteiligte Einrichtung: School of Nursing, Peking University, Beijing, China. Hauptthemen laut MEDLINE: Search Engine, Language, Orthodontics, Patient Education as Topic. Die Arbeit nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Large Language Models (LLMs) highlight their potential in supporting patient education and self-management. Their performance in responses to orthodontic questions has yet to be explored.

Objectives

This study aims to compare the quality, empathy, readability, and satisfaction of responses from LLMs and search engines on common orthodontic questions.

Methods

Forty-five common orthodontic questions (six categories) and a prompt were developed, and a self-designed multidimensional evaluation questionnaire was constructed. Questions were presented to 5 LLMs and 3 search engines on December,22,2024. The primary outcomes were the median expert-rated scores of LLMs versus search engine responses on quality, empathy, readability, and satisfaction, using 5- or 10-point Likert scales.

Results

LLMs scored significantly higher than search engines in quality (4.00 vs. 3.50, p < 0.001), empathy (3.75 vs. 3.50, p < 0.001), readability (4.00 vs. 3.75, p < 0.001), and satisfaction (8.00 vs. 7.25, p < 0.001). LLM-generated responses were rated significantly higher than those from search engines in therapeutic outcomes category, appliance selection category and cost category.

Conclusions

In this cross-sectional study, the LLMs, particularly GPT-4o, outperformed search engines. These results indicate the potential of LLMs as supplementary tools for orthodontic patient education and self-management.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Search EngineLanguageOrthodonticsPatient Education as TopicHumansSurveys and QuestionnairesFemaleMaleComprehensionLarge Language Models

Autor:innen und Institutionen

  • School of Nursing, Peking University, Beijing, China.
  • Department of Community Nursing, School of Nursing, Peking University, Beijing, China.

ORCID-Profile: Jing Sun

Zitieren

APA

Ren, Y., & Sun, J. (2026). Comparing large language models and search engine responses to common orthodontic questions. PLOS One. https://doi.org/10.1371/journal.pone.0339908

Vancouver

Ren Y, Sun J. Comparing large language models and search engine responses to common orthodontic questions. PLOS One. 2026. doi:10.1371/journal.pone.0339908

BibTeX
@article{Ren2026,
  author = {Ren, Yuanyuan and Sun, Jing},
  title = {Comparing large language models and search engine responses to common orthodontic questions},
  journal = {PLOS One},
  year = {2026},
  doi = {10.1371/journal.pone.0339908}
}
Kostenlos starten →