Readability, quality, and reliability of AI-generated ınformation on myofascial pain syndrome: A comparative analysis of ChatGPT, Gemini, and Perplexity
Lesbarkeit, Qualität und Zuverlässigkeit von KI-generierten Informationen zum Myofaszialen Schmerzsyndrom: vergleichende Analyse von ChatGPT, Gemini und Perplexity
PLOS One · 04.06.2026 · 21 (6) · e0350402
DOI: 10.1371/journal.pone.0350402 ↗Auf einen Blick
KI-Chatbots zu Myofaszialem Schmerzsyndrom wurden hinsichtlich Lesbarkeit, Qualität und Zuverlässigkeit verglichen. Alle Antworten lagen über dem empfohlenen Leseverständnis der 6. Klassenstufe.
Fragestellung
Wie unterscheiden sich ChatGPT, Gemini und Perplexity bei Lesbarkeit, Qualität und Zuverlässigkeit von Informationen zum Myofaszialen Schmerzsyndrom?
Methode
Vergleichende Analyse von Antworten auf 18 Keywords aus 25 Google-Trends-Keywords; Bewertung mit 6 Lesbarkeitsmaßen sowie GQS, EQIP, DISCERN und JAMA durch 2 Beobachter:innen.
Ergebnisse
Alle Modelle erzeugten Inhalte, die signifikant komplexer als die 6. Klassenstufe waren (p < 0,001). ChatGPT war am leichtesten lesbar; Perplexity erzielte höhere Werte bei Qualität und Zuverlässigkeit als ChatGPT und Gemini (p < 0,05).
Schlussfolgerung der Autor:innen
KI-Plattformen haben Potenzial für medizinische Informationen, können aber wegen sprachlicher Barrieren über der 6. Klassenstufe und begrenzter Zuverlässigkeit ärztliche Beratung nicht ersetzen.
Kernaussagen
- Alle Modelle lagen über dem empfohlenen Leseverständnis der 6. Klassenstufe
- ChatGPT war am leichtesten lesbar
- Perplexity schnitt bei Qualität und Zuverlässigkeit am besten ab
Deutsche Zusammenfassung: KI-gestützt aus dem Original-Abstract erstellt; alle Zahlen wurden automatisch mit dem Original abgeglichen. Maßgeblich ist der Original-Abstract.
Kurz gefasst
Vergleichsstudie in der Zeitschrift PLOS One, online erschienen am 04.06.2026. Verfasst von Yüksel Erkin und 3 weiteren Autor:innen. Beteiligte Einrichtung: Dokuz Eylul University, Anesthesiology and Reanimation, Pain Medicine, Izmir, Turkey. Hauptthemen laut MEDLINE: Myofascial Pain Syndromes, Comprehension. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Patients seeking information about Myofascial Pain Syndrome (MPS), which affects a large segment of the population, are increasingly turning to AI-based chatbots as an alternative to traditional methods. However, the medical accuracy of the content offered by these digital platforms, as well as its suitability to the “grade 6 reading level” standard, which determines its comprehensibility by patients, is a critical point of uncertainty. This study aims to fill this significant gap in the literature by systematically comparing MPS content generated by different AI models using readability indices, reliability, and quality metrics. The 18 most relevant keywords, derived from 25 keywords identified via Google Trends data, were queried using ChatGPT (GPT-5.2), Gemini 3 Flash, and Perplexity (Sonar-4 Large) models. The readability of the generated responses was analyzed using six different indices (FRES, FKGL, GFOG, CLI, ARI, SMOG), while content quality was assessed using GQS and EQIP scales, and reliability using DISCERN and JAMA scales by two independent observers. The responses generated by all AI models examined were found to be statistically significantly more complex than the suggested 6th-grade reading level (p < 0.001). In inter-model comparisons, ChatGPT exhibited the easiest readability [lowest linguistic difficulty] scores, while Perplexity scored significantly higher than both ChatGPT and Gemini in content quality and reliability metrics (JAMA, DISCERN, GQS, EQIP) (p < 0.05). Correlation analysis revealed a strong and positive relationship between quality and reliability parameters. Artificial intelligence platforms have been observed to exhibit high potential in the production of medical information. However, linguistic barriers exceeding sixth-grade reading comprehension, along with reliability limitations of current models, prevent them from replacing professional medical consultation. Perplexity has been found superior in terms of academic quality, while ChatGPT has been found superior in terms of readability. Nevertheless, positioning these systems as complementary “secondary consultation mechanisms” supporting physician oversight in clinical decision-making processes is critically important for patient safety.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Dokuz Eylul University, Anesthesiology and Reanimation, Pain Medicine, Izmir, Turkey.
- Sivas Numune Hospital, Physical Medicine and Rehabilitation, Pain Medicine, Sivas, Turkey.
- Health Science University, Derince Training and Research Hospital, Physical Medicine and Rehabilitation, Kocaeli, Turkey.
- Dokuz Eylul University, Anesthesiology and Reanimation, Critical Care Medicine, Izmir, Turkey.
ORCID-Profile: Erkan Ozduran, İlhan Celil Özbek
Zitieren
APA
Erkin, Y., Ozduran, E., Özbek, İ. C., & Hancı, V. (2026). Readability, quality, and reliability of AI-generated ınformation on myofascial pain syndrome: A comparative analysis of ChatGPT, Gemini, and Perplexity. PLOS One, 21(6), e0350402. https://doi.org/10.1371/journal.pone.0350402
Vancouver
Erkin Y, Ozduran E, Özbek İC, Hancı V. Readability, quality, and reliability of AI-generated ınformation on myofascial pain syndrome: A comparative analysis of ChatGPT, Gemini, and Perplexity. PLOS One. 2026;21(6):e0350402. doi:10.1371/journal.pone.0350402
BibTeX
@article{Erkin2026,
author = {Erkin, Yüksel and Ozduran, Erkan and Özbek, İlhan Celil and Hancı, Volkan},
title = {Readability, quality, and reliability of AI-generated ınformation on myofascial pain syndrome: A comparative analysis of ChatGPT, Gemini, and Perplexity},
journal = {PLOS One},
year = {2026},
volume = {21},
number = {6},
pages = {e0350402},
doi = {10.1371/journal.pone.0350402}
}
EUVIMED