EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Can artificial intelligence counsel expectant mothers? Expert evaluation of ChatGPT’s educational performance in gestational diabetes mellitus

Mücahit Furkan Balcı, Celal Akdemi̇r, Fatih Yildirim

BMC Endocrine Disorders · 14.08.2026 · 26 (1)

DOI: 10.1186/s12902-026-02490-w ↗

Kurz gefasst

Fachartikel in der Zeitschrift BMC Endocrine Disorders, online erschienen am 14.08.2026. Verfasst von Mücahit Furkan Balcı und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Obstetrics and Gynecology, Torbalı State Hospital, Torbalı, Izmir, Turkey. mucahitfurkanbalci@gmail.com. Hauptthemen laut MEDLINE: Diabetes, Gestational, Artificial Intelligence, Patient Education as Topic, Counseling. Die Arbeit nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

BACKGROUND: Gestational diabetes mellitus (GDM) is an increasingly common pregnancy complication associated with adverse maternal-fetal outcomes and long-term risk of type 2 diabetes. Artificial intelligence (AI) tools such as ChatGPT have emerged as potential instruments for patient education, yet their reliability and safety in obstetric counseling remain underexplored. This study aimed to evaluate the educational quality of ChatGPT-5 responses to frequently asked questions about GDM. METHODS: This cross-sectional study was conducted between January and June 2025 at Torbalı State Hospital, İzmir, Türkiye, following STROBE guidelines. Twenty frequently asked questions about gestational diabetes mellitus, identified from routine antenatal counseling through clinician observation and consensus, were entered into ChatGPT-5 using a standardized prompt. Thirty physicians specializing in obstetrics and gynecology from Türkiye, the United Kingdom, Canada, and Germany independently rated the AI-generated answers on a 5-point Likert scale across five domains: accuracy, comprehensiveness, clarity, safety, and appropriateness. Reliability was analyzed using Cronbach's α and intraclass correlation coefficient (ICC). Comparative analyses were performed using Friedman and Dunn-Bonferroni tests. RESULTS: Overall, ChatGPT-5 achieved high ratings for accuracy (4.23 ± 0.32), clarity (4.18 ± 0.27), and appropriateness (4.09 ± 0.31), while comprehensiveness (3.92 ± 0.29) and safety (3.88 ± 0.34) scored lower. Internal consistency was strong (Cronbach's α = 0.87) and interrater reliability was good (ICC = 0.79). Among thematic domains, "Definition, causes, and risk factors" received the highest scores (4.20 ± 0.30), whereas "Follow-up and treatment" scored the lowest (3.96 ± 0.33). Safety ratings were significantly lower than accuracy and clarity (p = 0.018). CONCLUSION: ChatGPT-5 demonstrated high accuracy and clarity in GDM counseling, suggesting its potential use as a physician-supervised educational support tool. However, limitations in comprehensiveness and safety highlight the need for guideline-based refinement and human oversight to ensure ethical and reliable integration of AI in obstetric patient education. TRIAL REGISTRATION: Not applicable. This study is an observational cross-sectional design and did not involve patient enrollment or intervention.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Diabetes, GestationalArtificial IntelligencePatient Education as TopicCounselingHumansFemalePregnancyCross-Sectional StudiesAdultReproducibility of ResultsGenerative Artificial Intelligence

Stichwörter der Autor:innen

Artificial intelligenceChatGPTDigital healthGestational diabetes mellitusPatient educationPregnancy

Autor:innen und Institutionen

  • Department of Obstetrics and Gynecology, Torbalı State Hospital, Torbalı, Izmir, Turkey. mucahitfurkanbalci@gmail.com.
  • Department of Gynecologic Oncology, İzmir City Hospital, Izmir, Turkey.
  • Department of Obstetrics and Gynecology, Tepecik Training and Research Hospital, Izmir, Turkey.

Zitieren

APA

Balcı, M. F., Akdemi̇r, C., & Yildirim, F. (2026). Can artificial intelligence counsel expectant mothers? Expert evaluation of ChatGPT’s educational performance in gestational diabetes mellitus. BMC Endocrine Disorders, 26(1). https://doi.org/10.1186/s12902-026-02490-w

Vancouver

Balcı MF, Akdemi̇r C, Yildirim F. Can artificial intelligence counsel expectant mothers? Expert evaluation of ChatGPT’s educational performance in gestational diabetes mellitus. BMC Endocrine Disorders. 2026;26(1). doi:10.1186/s12902-026-02490-w

BibTeX
@article{Balc2026,
  author = {Balcı, Mücahit Furkan and Akdemi̇r, Celal and Yildirim, Fatih},
  title = {Can artificial intelligence counsel expectant mothers? Expert evaluation of ChatGPT’s educational performance in gestational diabetes mellitus},
  journal = {BMC Endocrine Disorders},
  year = {2026},
  volume = {26},
  number = {1},
  doi = {10.1186/s12902-026-02490-w}
}
Kostenlos starten →