EUVIMEDEUVIMED entdecken
VergleichsstudieOpen Access · CC BY 4.0

Readability, quality, and reliability of AI-generated ınformation on myofascial pain syndrome: A comparative analysis of ChatGPT, Gemini, and Perplexity

Lesbarkeit, Qualität und Zuverlässigkeit von KI-generierten Informationen zum Myofaszialen Schmerzsyndrom: vergleichende Analyse von ChatGPT, Gemini und Perplexity

Yüksel Erkin, Erkan Ozduran iD, İlhan Celil Özbek iD, Volkan Hancı

PLOS One · 04.06.2026 · 21 (6) · e0350402

DOI: 10.1371/journal.pone.0350402 ↗

Auf einen Blick

KI-Chatbots zu Myofaszialem Schmerzsyndrom wurden hinsichtlich Lesbarkeit, Qualität und Zuverlässigkeit verglichen. Alle Antworten lagen über dem empfohlenen Leseverständnis der 6. Klassenstufe.

Fragestellung

Wie unterscheiden sich ChatGPT, Gemini und Perplexity bei Lesbarkeit, Qualität und Zuverlässigkeit von Informationen zum Myofaszialen Schmerzsyndrom?

Methode

Vergleichende Analyse von Antworten auf 18 Keywords aus 25 Google-Trends-Keywords; Bewertung mit 6 Lesbarkeitsmaßen sowie GQS, EQIP, DISCERN und JAMA durch 2 Beobachter:innen.

Ergebnisse

Alle Modelle erzeugten Inhalte, die signifikant komplexer als die 6. Klassenstufe waren (p < 0,001). ChatGPT war am leichtesten lesbar; Perplexity erzielte höhere Werte bei Qualität und Zuverlässigkeit als ChatGPT und Gemini (p < 0,05).

Schlussfolgerung der Autor:innen

KI-Plattformen haben Potenzial für medizinische Informationen, können aber wegen sprachlicher Barrieren über der 6. Klassenstufe und begrenzter Zuverlässigkeit ärztliche Beratung nicht ersetzen.

Kernaussagen

  • Alle Modelle lagen über dem empfohlenen Leseverständnis der 6. Klassenstufe
  • ChatGPT war am leichtesten lesbar
  • Perplexity schnitt bei Qualität und Zuverlässigkeit am besten ab

Deutsche Zusammenfassung: KI-gestützt aus dem Original-Abstract erstellt; alle Zahlen wurden automatisch mit dem Original abgeglichen. Maßgeblich ist der Original-Abstract.

Kurz gefasst

Vergleichsstudie in der Zeitschrift PLOS One, online erschienen am 04.06.2026. Verfasst von Yüksel Erkin und 3 weiteren Autor:innen. Beteiligte Einrichtung: Dokuz Eylul University, Anesthesiology and Reanimation, Pain Medicine, Izmir, Turkey. Hauptthemen laut MEDLINE: Myofascial Pain Syndromes, Comprehension. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

Auf einen BlickAbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Patients seeking information about Myofascial Pain Syndrome (MPS), which affects a large segment of the population, are increasingly turning to AI-based chatbots as an alternative to traditional methods. However, the medical accuracy of the content offered by these digital platforms, as well as its suitability to the “grade 6 reading level” standard, which determines its comprehensibility by patients, is a critical point of uncertainty. This study aims to fill this significant gap in the literature by systematically comparing MPS content generated by different AI models using readability indices, reliability, and quality metrics. The 18 most relevant keywords, derived from 25 keywords identified via Google Trends data, were queried using ChatGPT (GPT-5.2), Gemini 3 Flash, and Perplexity (Sonar-4 Large) models. The readability of the generated responses was analyzed using six different indices (FRES, FKGL, GFOG, CLI, ARI, SMOG), while content quality was assessed using GQS and EQIP scales, and reliability using DISCERN and JAMA scales by two independent observers. The responses generated by all AI models examined were found to be statistically significantly more complex than the suggested 6th-grade reading level (p < 0.001). In inter-model comparisons, ChatGPT exhibited the easiest readability [lowest linguistic difficulty] scores, while Perplexity scored significantly higher than both ChatGPT and Gemini in content quality and reliability metrics (JAMA, DISCERN, GQS, EQIP) (p < 0.05). Correlation analysis revealed a strong and positive relationship between quality and reliability parameters. Artificial intelligence platforms have been observed to exhibit high potential in the production of medical information. However, linguistic barriers exceeding sixth-grade reading comprehension, along with reliability limitations of current models, prevent them from replacing professional medical consultation. Perplexity has been found superior in terms of academic quality, while ChatGPT has been found superior in terms of readability. Nevertheless, positioning these systems as complementary “secondary consultation mechanisms” supporting physician oversight in clinical decision-making processes is critically important for patient safety.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Myofascial Pain SyndromesComprehensionHumansReproducibility of ResultsGenerative Artificial IntelligenceLarge Language Models

Autor:innen und Institutionen

  • Dokuz Eylul University, Anesthesiology and Reanimation, Pain Medicine, Izmir, Turkey.
  • Sivas Numune Hospital, Physical Medicine and Rehabilitation, Pain Medicine, Sivas, Turkey.
  • Health Science University, Derince Training and Research Hospital, Physical Medicine and Rehabilitation, Kocaeli, Turkey.
  • Dokuz Eylul University, Anesthesiology and Reanimation, Critical Care Medicine, Izmir, Turkey‌‌.

ORCID-Profile: Erkan Ozduran, İlhan Celil Özbek

Zitieren

APA

Erkin, Y., Ozduran, E., Özbek, İ. C., & Hancı, V. (2026). Readability, quality, and reliability of AI-generated ınformation on myofascial pain syndrome: A comparative analysis of ChatGPT, Gemini, and Perplexity. PLOS One, 21(6), e0350402. https://doi.org/10.1371/journal.pone.0350402

Vancouver

Erkin Y, Ozduran E, Özbek İC, Hancı V. Readability, quality, and reliability of AI-generated ınformation on myofascial pain syndrome: A comparative analysis of ChatGPT, Gemini, and Perplexity. PLOS One. 2026;21(6):e0350402. doi:10.1371/journal.pone.0350402

BibTeX
@article{Erkin2026,
  author = {Erkin, Yüksel and Ozduran, Erkan and Özbek, İlhan Celil and Hancı, Volkan},
  title = {Readability, quality, and reliability of AI-generated ınformation on myofascial pain syndrome: A comparative analysis of ChatGPT, Gemini, and Perplexity},
  journal = {PLOS One},
  year = {2026},
  volume = {21},
  number = {6},
  pages = {e0350402},
  doi = {10.1371/journal.pone.0350402}
}
Kostenlos starten →