Unsupervised Large Language Models to Identify Topics in Cancer Center Patient Portal Messages
JCO Clinical Cancer Informatics · 2025
DOI: 10.1200/cci-25-00102 ↗Kurz gefasst
Fachartikel in der Zeitschrift JCO Clinical Cancer Informatics, 2025. Verfasst von Ji Hyun Chang und 10 weiteren Autor:innen. Beteiligte Einrichtung: Bakar Computational Health Sciences Institute, University of California, San Francisco, San Francisco, CA. Hauptthemen laut MEDLINE: Patient Portals, COVID-19, Natural Language Processing, Cancer Care Facilities. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NCI NIH HHS.
Abstract (Originalsprache)
PURPOSE The increasing use of patient portal messages has enhanced patient-provider communication. However, the high volume of these messages has also contributed to physician burnout. METHODS Patient-generated portal messages sent to a single cancer center from 2011 to 2023 were extracted. BERTopic, a natural language processing topic modeling technique based on large language models, was optimized. For further categorization, the topic words were labeled using GPT-4, followed by review by two oncologists. Uniform Manifold Approximation and Projection was used for dimensionality reduction and visualizing topics. Message volume changes over time were assessed using a Student's t test. RESULTS A total of 2,280,851 messages were analyzed. The monthly average number of messages increased from 2,071 in 2012 to 43,430 in 2022 ( P < .001). There was a significant rise in message volume after the COVID-19 pandemic, with a posterior probability of a causal effect of 96.4% ( P = .04). Scheduling-related messages were the most frequent across departments, whereas symptoms and health concerns were second or third most common topics. In medical oncology and surgical oncology, topics on prescriptions and medications were more common compared with radiation oncology and gynecologic oncology. Despite concurrent institutional changes in self-scheduling systems, scheduling-related messages did not decrease over time. CONCLUSION The substantial increase in patient portal messages, particularly scheduling-related inquiries, underscores the need for streamlined communication to reduce the burden on health care providers. These findings highlight the need for strategies to manage message volume and mitigate physician burnout, laying groundwork for artificial intelligence–driven future triage systems to improve message management and patient care.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Bakar Computational Health Sciences Institute, University of California, San Francisco, San Francisco, CA.
- Department of Radiation Oncology, Seoul National University Hospital, Seoul National University College of Medicine, Seoul, South Korea.
- Department of Radiation Oncology, University of California, San Francisco, San Francisco, CA.
- UCSF-UC Berkeley Joint Program in Computational Precision Health, Berkeley, CA.
ORCID-Profile: Isabel Friesner, Travis Zack, Sumi Sinha, Jason Chan, Steve Braunstein, Julian C Hong
Förderung
- NCI NIH HHS
Zitieren
APA
Chang, J. H., Ashraf-Ganjouei, A., Friesner, I., Benson, R., Zack, T., Sinha, S., Chan, J., Braunstein, S., Lin, A., Singer, L., & Hong, J. C. (2025). Unsupervised Large Language Models to Identify Topics in Cancer Center Patient Portal Messages. JCO Clinical Cancer Informatics. https://doi.org/10.1200/cci-25-00102
Vancouver
Chang JH, Ashraf-Ganjouei A, Friesner I, Benson R, Zack T, Sinha S, et al. Unsupervised Large Language Models to Identify Topics in Cancer Center Patient Portal Messages. JCO Clinical Cancer Informatics. 2025. doi:10.1200/cci-25-00102
BibTeX
@article{Chang2025,
author = {Chang, Ji Hyun and Ashraf-Ganjouei, Amir and Friesner, Isabel and Benson, Ryzen and Zack, Travis and Sinha, Sumi and Chan, Jason and Braunstein, Steve and Lin, Amy and Singer, Lisa and Hong, Julian C},
title = {Unsupervised Large Language Models to Identify Topics in Cancer Center Patient Portal Messages},
journal = {JCO Clinical Cancer Informatics},
year = {2025},
doi = {10.1200/cci-25-00102}
}
EUVIMED