Reliability and safety of large language model-generated transfer notes: A retrospective validation study
Intelligent Medicine · 2026-10 · 6 (5) · 468-475
DOI: 10.1016/j.imed.2025.12.009 ↗Kurz gefasst
Fachartikel in der Zeitschrift Intelligent Medicine, 2026-10. Verfasst von Zhouxi Yu und 9 weiteren Autor:innen. Die Arbeit nennt 27 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Large language models (LLMs) show great promise in processing medical texts; The increasing specialization of clinical medicine has led to a greater demand for efficient and accurate referral. This study aims to evaluate the ability of the large language model DeepSeek-R1 to generate transfer notes for gastrointestinal surgery patients. Its performance is compared with that of clinician-provided transfer notes in terms of completeness, accuracy, and clinician preference. A retrospective clinical analysis was conducted on 204 referral patients who underwent gastrointestinal surgery at Qingdao University Affiliated Hospital between January 2022 and June 2025. The LLM was trained using a small-sample study of four cases, and 200 cases were used as the test set. LLM-generated transfer notes were based on a structured template comprising predefined units. A thorough completeness review of the LLM-generated transfer records was conducted by two trained clinicians ( κ = 0.719, p 0.05). In preference evaluation, clinicians were observed to demonstrate a pronounced preference for referral notes generated by LLMs (39% [78/200] vs. 13% [26/200], respectively; 48% [96/200] rated them as equivalent). DeepSeek can generate transfer notes that are accurate and of a quality similar to that of clinician-provided notes. Further evaluation in actual clinical settings is necessary.
Zitieren
APA
Yu, Z., Wei, J., Dong, F., Luo, H., Zhang, Z., Fan, J., Ding, H., An, H., Xie, W., & Lu, Y. (2026). Reliability and safety of large language model-generated transfer notes: A retrospective validation study. Intelligent Medicine, 6(5), 468-475. https://doi.org/10.1016/j.imed.2025.12.009
Vancouver
Yu Z, Wei J, Dong F, Luo H, Zhang Z, Fan J, et al. Reliability and safety of large language model-generated transfer notes: A retrospective validation study. Intelligent Medicine. 2026;6(5):468-475. doi:10.1016/j.imed.2025.12.009
BibTeX
@article{Yu2026,
author = {Yu, Zhouxi and Wei, Jianzhuo and Dong, Fuguo and Luo, Hao and Zhang, Zehao and Fan, Juping and Ding, Huiying and An, Haoran and Xie, Wentao and Lu, Yun},
title = {Reliability and safety of large language model-generated transfer notes: A retrospective validation study},
journal = {Intelligent Medicine},
year = {2026},
volume = {6},
number = {5},
pages = {468--475},
doi = {10.1016/j.imed.2025.12.009}
}
EUVIMED