The use of large language models to enhance cancer clinical trial educational materials
JNCI Cancer Spectrum · 03.03.2025 · 9 (2)
DOI: 10.1093/jncics/pkaf021 ↗Kurz gefasst
Fachartikel in der Zeitschrift JNCI Cancer Spectrum, online erschienen am 08.02.2025. Verfasst von Mingye Gao und 17 weiteren Autor:innen. Beteiligte Einrichtung: Massachusetts Institute of Technology, Cambridge, MA 02139, United States. Hauptthemen laut MEDLINE: Clinical Trials as Topic, Large Language Models, Neoplasms, Patient Education as Topic. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 60 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: NCI NIH HHS, Woods Foundation.
Abstract (Originalsprache)
Background
Adequate patient awareness and understanding of cancer clinical trials is essential for trial recruitment, informed decision making, and protocol adherence. Although large language models (LLMs) have shown promise for patient education, their role in enhancing patient awareness of clinical trials remains unexplored. This study explored the performance and risks of LLMs in generating trial-specific educational content for potential participants.
Methods
Generative Pretrained Transformer 4 (GPT4) was prompted to generate short clinical trial summaries and multiple-choice question-answer pairs from informed consent forms from ClinicalTrials.gov. Zero-shot learning was used for summaries, using a direct summarization, sequential extraction, and summarization approach. One-shot learning was used for question-answer pairs development. We evaluated performance through patient surveys of summary effectiveness and crowdsourced annotation of question-answer pair accuracy, using held-out cancer trial informed consent forms not used in prompt development.
Results
For summaries, both prompting approaches achieved comparable results for readability and core content. Patients found summaries to be understandable and to improve clinical trial comprehension and interest in learning more about trials. The generated multiple-choice questions achieved high accuracy and agreement with crowdsourced annotators. For both summaries and multiple-choice questions, GPT4 was most likely to include inaccurate information when prompted to provide information that was not adequately described in the informed consent forms.
Conclusions
LLMs such as GPT4 show promise in generating patient-friendly educational content for clinical trials with minimal trial-specific engineering. The findings serve as a proof of concept for the role of LLMs in improving patient education and engagement in clinical trials, as well as the need for ongoing human oversight.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Massachusetts Institute of Technology, Cambridge, MA 02139, United States.
- Technical University of Munich, Munich 80333, Germany.
- Artificial Intelligence in Medicine Program, Mass General Brigham, Harvard Medical School, Boston, MA 02115, United States.
- Department of Radiation Oncology, Brigham and Women's Hospital/Dana-Farber Cancer Institute, Boston, MA 02115, United States.
- Centaur Labs, Boston, MA 02116, United States.
- Digidence, Bethesda, MD 20814, United States.
ORCID-Profile: Aman Varshney, Shan Chen, Vikram Goddla, Jack Gallifant, Patrick Doyle, Claire Novack, Teresia Perkins, Xinrong Correia, Elad Sharon, Lisa Soleymani Lehmann, Brian Anthony, Dmitriy Dligach, Danielle S Bitterman
Förderung
- NCI NIH HHS
- Woods Foundation
Zitieren
APA
Gao, M., Varshney, A., Chen, S., Goddla, V., Gallifant, J., Doyle, P., Novack, C., Dillon-Martin, M., Perkins, T., Correia, X., Duhaime, E., Isenstein, H., Sharon, E., Lehmann, L. S., Kozono, D., Anthony, B., Dligach, D., & Bitterman, D. S. (2025). The use of large language models to enhance cancer clinical trial educational materials. JNCI Cancer Spectrum, 9(2). https://doi.org/10.1093/jncics/pkaf021
Vancouver
Gao M, Varshney A, Chen S, Goddla V, Gallifant J, Doyle P, et al. The use of large language models to enhance cancer clinical trial educational materials. JNCI Cancer Spectrum. 2025;9(2). doi:10.1093/jncics/pkaf021
BibTeX
@article{Gao2025,
author = {Gao, Mingye and Varshney, Aman and Chen, Shan and Goddla, Vikram and Gallifant, Jack and Doyle, Patrick and Novack, Claire and Dillon-Martin, Maeve and Perkins, Teresia and Correia, Xinrong and Duhaime, Erik and Isenstein, Howard and Sharon, Elad and Lehmann, Lisa Soleymani and Kozono, David and Anthony, Brian and Dligach, Dmitriy and Bitterman, Danielle S},
title = {The use of large language models to enhance cancer clinical trial educational materials},
journal = {JNCI Cancer Spectrum},
year = {2025},
volume = {9},
number = {2},
doi = {10.1093/jncics/pkaf021}
}
EUVIMED