Application of Generative Artificial Intelligence for Physician and Patient Oncology Letters—AI-OncLetters
JCO Clinical Cancer Informatics · 2025-05 · (9)
DOI: 10.1200/cci-24-00323 ↗Kurz gefasst
Fachartikel in der Zeitschrift JCO Clinical Cancer Informatics, 2025-05. Verfasst von Adel Shahnam und 10 weiteren Autor:innen. Beteiligte Einrichtung: Department of Medical Oncology, Peter MacCallum Cancer Centre, Melbourne, VIC, Australia. Hauptthemen laut MEDLINE: Artificial Intelligence, Medical Oncology, Neoplasms, Physicians. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 20 Literaturangaben.
Abstract (Originalsprache)
PURPOSE Although large language models (LLMs) are increasingly used in clinical practice, formal assessments of their quality, accuracy, and effectiveness in medical oncology remain limited. We aimed to evaluate the ability of ChatGPT, an LLM, to generate physician and patient letters from clinical case notes. METHODS Six oncologists created 29 (four training, 25 final) synthetic oncology case notes. Structured prompts for ChatGPT were iteratively developed using the four training cases; once finalized, 25 physician-directed and patient-directed letters were generated. These underwent evaluation by expert consumers and oncologists for accuracy, relevance, and readability using Likert scales. The patient letters were also assessed with the Patient Education Materials Assessment Tool for Print (PEMAT-P), Flesch Reading Ease, and Simple Measure of Gobbledygook index. RESULTS Among physician-to-physician letters, 95% (119/125) of oncologists agreed they were accurate, comprehensive, and relevant, with no safety concerns noted. These letters demonstrated precise documentation of history, investigations, and treatment plans and were logically and concisely structured. Patient-directed letters achieved a mean Flesch Reading Ease score of 73.3 (seventh-grade reading level) and a PEMAT-P score above 80%, indicating high understandability. Consumer reviewers found them clear and appropriate for patient communication. Some omissions of details (eg, side effects), stylistic inconsistencies, and repetitive phrasing were identified, although no clinical safety issues emerged. Seventy-two percent (90/125) of consumers expressed willingness to receive artificial intelligence (AI)-generated patient letters. CONCLUSION ChatGPT, when guided by structured prompts, can generate high-quality letters that align with clinical and patient communication standards. No clinical safety concerns were identified, although addressing occasional omissions and improving natural language flow could enhance their utility in practice. Further studies comparing AI-generated and human-written letters are recommended.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Medical Oncology, Peter MacCallum Cancer Centre, Melbourne, VIC, Australia.
- Department of Medical Oncology, Liverpool Hospital, Sydney, NSW, Australia.
- Sir Peter MacCallum Department of Oncology, The University of Melbourne, Melbourne, VIC, Australia.
- Flinders Health and Medical Research Institute, College of Medicine and Public Health, Flinders University, Adelaide, SA, Australia.
ORCID-Profile: Adel Shahnam, Udit Nindra, Nadia Hitchen, Joanne Tang, Martin Hong, George Au-Yeung, Michael J Sorich
Zitieren
APA
Shahnam, A., Nindra, U., Hitchen, N., Tang, J., Hong, M., Hong, J. H., Au-Yeung, G., Chua, W., Ng, W., Hopkins, A. M., & Sorich, M. J. (2025). Application of Generative Artificial Intelligence for Physician and Patient Oncology Letters—AI-OncLetters. JCO Clinical Cancer Informatics. https://doi.org/10.1200/cci-24-00323
Vancouver
Shahnam A, Nindra U, Hitchen N, Tang J, Hong M, Hong JH, et al. Application of Generative Artificial Intelligence for Physician and Patient Oncology Letters—AI-OncLetters. JCO Clinical Cancer Informatics. 2025. doi:10.1200/cci-24-00323
BibTeX
@article{Shahnam2025,
author = {Shahnam, Adel and Nindra, Udit and Hitchen, Nadia and Tang, Joanne and Hong, Martin and Hong, Jun Hee and Au-Yeung, George and Chua, Wei and Ng, Weng and Hopkins, Ashley M and Sorich, Michael J},
title = {Application of Generative Artificial Intelligence for Physician and Patient Oncology Letters—AI-OncLetters},
journal = {JCO Clinical Cancer Informatics},
year = {2025},
number = {9},
doi = {10.1200/cci-24-00323}
}
EUVIMED