Generative Artificial Intelligence to Transform Inpatient Discharge Summaries to Patient-Friendly Language and Format
JAMA Network Open · 11.03.2024 · 7 (3) · e240357
DOI: 10.1001/jamanetworkopen.2024.0357 ↗Kurz gefasst
Fachartikel in der Zeitschrift JAMA Network Open, online erschienen am 11.03.2024. Verfasst von Jonah Zaretsky und 8 weiteren Autor:innen. Beteiligte Einrichtung: Division of Hospital Medicine, Department of Medicine, NYU (New York University) Langone Health, New York, New York. Hauptthemen laut MEDLINE: Inpatients, Artificial Intelligence. Die Arbeit wurde bisher 332-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Importance By law, patients have immediate access to discharge notes in their medical records. Technical language and abbreviations make notes difficult to read and understand for a typical patient. Large language models (LLMs [eg, GPT-4]) have the potential to transform these notes into patient-friendly language and format.
Objective
To determine whether an LLM can transform discharge summaries into a format that is more readable and understandable. Design, Setting, and Participants This cross-sectional study evaluated a sample of the discharge summaries of adult patients discharged from the General Internal Medicine service at NYU (New York University) Langone Health from June 1 to 30, 2023. Patients discharged as deceased were excluded. All discharge summaries were processed by the LLM between July 26 and August 5, 2023.
Interventions
A secure Health Insurance Portability and Accountability Act–compliant platform, Microsoft Azure OpenAI, was used to transform these discharge summaries into a patient-friendly format between July 26 and August 5, 2023. Main Outcomes and Measures Outcomes included readability as measured by Flesch-Kincaid Grade Level and understandability using Patient Education Materials Assessment Tool (PEMAT) scores. Readability and understandability of the original discharge summaries were compared with the transformed, patient-friendly discharge summaries created through the LLM. As balancing metrics, accuracy and completeness of the patient-friendly version were measured.
Results
Discharge summaries of 50 patients (31 female [62.0%] and 19 male [38.0%]) were included. The median patient age was 65.5 (IQR, 59.0-77.5) years. Mean (SD) Flesch-Kincaid Grade Level was significantly lower in the patient-friendly discharge summaries (6.2 [0.5] vs 11.0 [1.5]; P < .001). PEMAT understandability scores were significantly higher for patient-friendly discharge summaries (81% vs 13%; P < .001). Two physicians reviewed each patient-friendly discharge summary for accuracy on a 6-point scale, with 54 of 100 reviews (54.0%) giving the best possible rating of 6. Summaries were rated entirely complete in 56 reviews (56.0%). Eighteen reviews noted safety concerns, mostly involving omissions, but also several inaccurate statements (termed hallucinations). Conclusions and Relevance The findings of this cross-sectional study of 50 discharge summaries suggest that LLMs can be used to translate discharge summaries into patient-friendly language and formats that are significantly more readable and understandable than discharge summaries as they appear in electronic health records. However, implementation will require improvements in accuracy, completeness, and safety. Given the safety concerns, initial implementation will require physician review.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Division of Hospital Medicine, Department of Medicine, NYU (New York University) Langone Health, New York, New York.
- Department of Medicine, NYU Long Island School of Medicine, Mineola.
- Department of Population Health, NYU Langone Health, New York.
- Department of Health Informatics, NYU Langone Medical Center Information Technology, New York.
- Predictive Analytics Unit, NYU Langone Health, New York.
- Department of Internal Medicine, Long Island Community Hospital, NYU Langone Health, New York.
Zitieren
APA
Zaretsky, J., Kim, J. M., Baskharoun, S., Zhao, Y., Austrian, J., Aphinyanaphongs, Y., Gupta, R., Blecker, S. B., & Feldman, J. (2024). Generative Artificial Intelligence to Transform Inpatient Discharge Summaries to Patient-Friendly Language and Format. JAMA Network Open, 7(3), e240357. https://doi.org/10.1001/jamanetworkopen.2024.0357
Vancouver
Zaretsky J, Kim JM, Baskharoun S, Zhao Y, Austrian J, Aphinyanaphongs Y, et al. Generative Artificial Intelligence to Transform Inpatient Discharge Summaries to Patient-Friendly Language and Format. JAMA Network Open. 2024;7(3):e240357. doi:10.1001/jamanetworkopen.2024.0357
BibTeX
@article{Zaretsky2024,
author = {Zaretsky, Jonah and Kim, Jeong Min and Baskharoun, Samuel and Zhao, Yunan and Austrian, Jonathan and Aphinyanaphongs, Yindalon and Gupta, Ravi and Blecker, Saul B and Feldman, Jonah},
title = {Generative Artificial Intelligence to Transform Inpatient Discharge Summaries to Patient-Friendly Language and Format},
journal = {JAMA Network Open},
year = {2024},
volume = {7},
number = {3},
pages = {e240357},
doi = {10.1001/jamanetworkopen.2024.0357}
}
EUVIMED