EUVIMEDEUVIMED entdecken
Crossref

Assessment of readability, reliability, and quality of large language models in addressing frequently asked questions regarding prenatal screening for fetal chromosomal anomalies

İbrahim Taşkum iD, Selcan Sınacı iD, Ferhat Aslan iD, Gülsüm Mina Taşkum iD, Seyhun Sucu iD

International Journal of Gynecology & Obstetrics · 2026

DOI: 10.1002/ijgo.70348 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Gynecology & Obstetrics, 2026. Verfasst von İbrahim Taşkum und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Obstetrics and Gynecology, Gaziantep City Hospital, Gaziantep, Turkey. Hauptthemen laut MEDLINE: Prenatal Diagnosis, Comprehension, Chromosome Aberrations, Chromosome Disorders. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 24 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

To evaluate the responses of large language models (LLMs) to prenatal screening questions for fetal chromosomal anomalies in terms of scientific accuracy, guideline adherence, depth of response, and clarity, as well as their potential roles in patient education and health communication.

Methods

Responses generated by ChatGPT‐4o and Gemini Advanced 1.5 Pro to frequently asked questions (FAQs) on prenatal screening for fetal chromosomal anomalies were systematically compared. Expert reviewers assessed each reply using a Likert scale across four criteria: adherence to clinical guidelines, scientific accuracy, clarity, and depth of response. Readability scores were calculated with the Flesch Reading Ease (FRE) and Flesch–Kincaid Grade Level (FKGL) formulas.

Results

LLMs were evaluated based on their responses to prenatal screening questions. ChatGPT‐4o received higher proportions of favorable ratings (“good” or “excellent”) across all evaluation criteria, including scientific accuracy, guideline adherence, clarity, and depth of response. The difference in average Global Quality Scale scores between ChatGPT and Gemini was statistically significant (3.87 vs. 3.70; P = 0.003). The mean FRE scores were 20.11 for ChatGPT‐4o and 32.25 for Gemini Advanced 1.5 Pro, and the mean FKGL scores were 15.09 and 12.64, respectively. The differences in both FRE and FKGL scores were statistically significant ( P = 0.001 and P = 0.002, respectively).

Conclusion

LLMs like ChatGPT‐4o and Gemini Advanced 1.5 Pro can provide highly accurate responses for prenatal screening for fetal chromosomal anomalies, but they should only be used for informational purposes. A healthcare professional should always be consulted before making any final decisions.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Prenatal DiagnosisComprehensionChromosome AberrationsChromosome DisordersLanguageHumansFemalePregnancyReproducibility of ResultsGuideline AdherencePatient Education as TopicSurveys and QuestionnairesLarge Language Models

Stichwörter der Autor:innen

ChatGPT‐4oGoogle Gemini advancedartificial intelligence in healthcarepatient educationprenatal screening

Autor:innen und Institutionen

  • Department of Obstetrics and Gynecology, Gaziantep City Hospital, Gaziantep, Turkey.
  • Department of Obstetrics and Gynecology, Division of Perinatology, Gaziantep City Hospital, Gaziantep, Turkey.
  • Department of Family Medicine, Gaziantep Provincial Health Directorate, Gaziantep, Turkey.

ORCID-Profile: İbrahim Taşkum, Selcan Sınacı, Ferhat Aslan, Gülsüm Mina Taşkum, Seyhun Sucu

Zitieren

APA

Taşkum, İ., Sınacı, S., Aslan, F., Taşkum, G. M., & Sucu, S. (2026). Assessment of readability, reliability, and quality of large language models in addressing frequently asked questions regarding prenatal screening for fetal chromosomal anomalies. International Journal of Gynecology & Obstetrics. https://doi.org/10.1002/ijgo.70348

Vancouver

Taşkum İ, Sınacı S, Aslan F, Taşkum GM, Sucu S. Assessment of readability, reliability, and quality of large language models in addressing frequently asked questions regarding prenatal screening for fetal chromosomal anomalies. International Journal of Gynecology & Obstetrics. 2026. doi:10.1002/ijgo.70348

BibTeX
@article{Takum2026,
  author = {Taşkum, İbrahim and Sınacı, Selcan and Aslan, Ferhat and Taşkum, Gülsüm Mina and Sucu, Seyhun},
  title = {Assessment of readability, reliability, and quality of large language models in addressing frequently asked questions regarding prenatal screening for fetal chromosomal anomalies},
  journal = {International Journal of Gynecology & Obstetrics},
  year = {2026},
  doi = {10.1002/ijgo.70348}
}
Kostenlos starten →