Quality and Readability of ChatGPT and Gemini Responses to Patient Questions About Systemic Isotretinoin: Comparative Evaluation Study
JMIR Dermatology · 30.10.2026 · 9 · e99780-e99780
DOI: 10.2196/99780 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift JMIR Dermatology, online erschienen am 30.10.2026. Verfasst von Elif Bal Avcı und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Dermatology, Faculty of Medicine, Trakya University, Trakya University Balkan Campus, Iskender, Edirne, Türkiye, 90 5054511134. Hauptthemen laut MEDLINE: Isotretinoin, Comprehension, Patient Education as Topic, Dermatologic Agents. Die Arbeit nennt 34 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
The use of AI in health care is rapidly expanding due to its accessibility, with growing reliance among both physicians and patients.
Objective
This study evaluated ChatGPT (OpenAI) and Gemini (Google) responses to patient questions on systemic isotretinoin.
Methods
A total of 40 commonly anticipated patient questions were developed based on online sources and patient education materials and categorized into 5 groups. Responses were generated using the January 2025 free versions of ChatGPT (GPT-4o) and Gemini 2.0 Flash. A total of 5 experienced dermatologists evaluated the responses in a blinded manner using a 5-point Likert scale assessing accuracy, clarity, completeness, usefulness, and overall quality score (Global Quality Score [GQS]). Readability was measured using Flesch-Kincaid Grade Level (FKGL), Flesch Reading Ease, and Simple Measure of Gobbledygook (SMOG) index scores. Mixed-effects modeling was performed to adjust for reviewer and question variability, and intraclass correlation coefficients (ICCs) were calculated to assess interrater reliability.
Results
ChatGPT achieved significantly higher ratings in accuracy, completeness, usefulness, and GQS, while clarity showed a nonsignificant trend. When questions were analyzed by subtype, no statistically significant differences were observed between models across evaluation parameters. Mixed-effects modeling confirmed higher odds of superior ratings for ChatGPT across domains (odds ratios [ORs] 1.82‐5.88; all P
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Substanzen
Autor:innen und Institutionen
- Department of Dermatology, Faculty of Medicine, Trakya University, Trakya University Balkan Campus, Iskender, Edirne, Türkiye, 90 5054511134.
- Department of Dermatology, Istanbul Training and Research Hospital, Istanbul, Türkiye.
- Department of Dermatology, Etlik City Hospital, Ankara, Türkiye.
- Department of Dermatology, Medeniyet University Faculty of Medicine, Göztepe Prof. Dr. Suleyman Yalcin City Hospital, Istanbul, Türkiye.
- Department of Dermatology, School of Medicine, Acıbadem Mehmet Ali Aydınlar University, Istanbul, Türkiye.
- Department of Biostatistics and Medical Informatics, Trakya University Faculty of Medicine, Edirne, Türkiye.
Zitieren
APA
Bal Avcı, E., Dağtaş, B. B., İlhan Erdil, D., Erdem, O., Salman, A., Korkmaz, S., & Sarıkaya Solak, S. (2026). Quality and Readability of ChatGPT and Gemini Responses to Patient Questions About Systemic Isotretinoin: Comparative Evaluation Study. JMIR Dermatology, 9, e99780-e99780. https://doi.org/10.2196/99780
Vancouver
Bal Avcı E, Dağtaş BB, İlhan Erdil D, Erdem O, Salman A, Korkmaz S, et al. Quality and Readability of ChatGPT and Gemini Responses to Patient Questions About Systemic Isotretinoin: Comparative Evaluation Study. JMIR Dermatology. 2026;9:e99780-e99780. doi:10.2196/99780
BibTeX
@article{BalAvc2026,
author = {Bal Avcı, Elif and Dağtaş, Buğra Burç and İlhan Erdil, Dilara and Erdem, Ozan and Salman, Andaç and Korkmaz, Selçuk and Sarıkaya Solak, Sezgi},
title = {Quality and Readability of ChatGPT and Gemini Responses to Patient Questions About Systemic Isotretinoin: Comparative Evaluation Study},
journal = {JMIR Dermatology},
year = {2026},
volume = {9},
pages = {e99780--e99780},
doi = {10.2196/99780}
}
EUVIMED