Can Large Language Models Support Family Communication in the Intensive Care Unit? A Comparative Accuracy Study
Sakarya Medical Journal · 30.06.2026 · 16 (2) · 200-207
DOI: 10.31832/smj.1842543 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sakarya Medical Journal, online erschienen am 30.06.2026. Verfasst von Mehmet Yıldırım und 3 weiteren Autor:innen. Die Arbeit nennt 24 Literaturangaben.
Themen: Intensivpflege
Abstract (Originalsprache)
Objective
Family members of patients admitted to the intensive care unit (ICU) frequently experience uncertainty, emotional distress, and significant informational needs. Communication gaps remain common in ICU practice due to time constraints and clinical complexity. Large language models (LLMs) may offer scalable support for patient–family information delivery; however, their performance in responding to real-world ICU family questions has not been systematically evaluated.
Methods
This evaluator-blinded, cross-sectional study compared the accuracy of responses generated by five widely used LLMs (Claude Sonnet 4.0, ChatGPT 5.0, Gemini 2.5, Grok-4, and Sonar) to questions commonly asked by ICU family members. A standardized set of 25 questions was generated by prompting each model to list frequently asked ICU family questions. All questions were subsequently posed to all five models in blinded, independent sessions. Two intensive care medicine specialists independently rated response accuracy using a 6-point Likert scale. Inter-rater reliability was assessed using Cohen’s kappa. Differences between models were analyzed using the Friedman test with post-hoc Wilcoxon signed-rank tests.
Results
A total of 125 responses were evaluated. Inter-rater agreement was moderate (Cohen’s κ = 0.56; overall agreement 73.6%). Accuracy scores differed significantly among models (p < 0.001). Claude Sonnet 4.0 achieved the highest mean accuracy score (5.66 ± 0.61), followed by ChatGPT 5.0, Gemini 2.5, and Sonar, with no statistically significant differences among these four models. Grok-4 demonstrated significantly lower accuracy compared with all other models (all p < 0.001).
Conclusions
Most contemporary LLMs demonstrated high accuracy in answering questions commonly posed by ICU family members, although performance varied across platforms. Selected LLMs may serve as supportive tools to reinforce clinician–family communication; however, careful model selection, clinical oversight, and ethical safeguards are required before implementation in high-stakes intensive care settings.
Zitieren
APA
Yıldırım, M., Demiray, T. D., Ayten, A., & Kaya, E. K. (2026). Can Large Language Models Support Family Communication in the Intensive Care Unit? A Comparative Accuracy Study. Sakarya Medical Journal, 16(2), 200-207. https://doi.org/10.31832/smj.1842543
Vancouver
Yıldırım M, Demiray TD, Ayten A, Kaya EK. Can Large Language Models Support Family Communication in the Intensive Care Unit? A Comparative Accuracy Study. Sakarya Medical Journal. 2026;16(2):200-207. doi:10.31832/smj.1842543
BibTeX
@article{Yldrm2026,
author = {Yıldırım, Mehmet and Demiray, Tulay Dilara and Ayten, Arda and Kaya, Esat Kivanc},
title = {Can Large Language Models Support Family Communication in the Intensive Care Unit? A Comparative Accuracy Study},
journal = {Sakarya Medical Journal},
year = {2026},
volume = {16},
number = {2},
pages = {200--207},
doi = {10.31832/smj.1842543}
}
EUVIMED