Applying natural language processing to patient messages to identify depression concerns in cancer patients
Journal of the American Medical Informatics Association · 01.10.2024 · 31 (10) · 2255-2262
DOI: 10.1093/jamia/ocae188 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of the American Medical Informatics Association, online erschienen am 17.07.2024. Verfasst von Marieke M van Buchem und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Medicine (Biomedical Informatics), Stanford University, Stanford, CA 94305, United States. Hauptthemen laut MEDLINE: Natural Language Processing, Neoplasms, Depression, Support Vector Machine. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 55 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NIH HHS, NLM NIH HHS, Catharine van Tussenbroek Fund.
Themen: Onkologische Pflege, Depression
Abstract (Originalsprache)
Objective
This study aims to explore and develop tools for early identification of depression concerns among cancer patients by leveraging the novel data source of messages sent through a secure patient portal. Materials and Methods We developed classifiers based on logistic regression (LR), support vector machines (SVMs), and 2 Bidirectional Encoder Representations from Transformers (BERT) models (original and Reddit-pretrained) on 6600 patient messages from a cancer center (2009-2022), annotated by a panel of healthcare professionals. Performance was compared using AUROC scores, and model fairness and explainability were examined. We also examined correlations between model predictions and depression diagnosis and treatment.
Results
BERT and RedditBERT attained AUROC scores of 0.88 and 0.86, respectively, compared to 0.79 for LR and 0.83 for SVM. BERT showed bigger differences in performance across sex, race, and ethnicity than RedditBERT. Patients who sent messages classified as concerning had a higher chance of receiving a depression diagnosis, a prescription for antidepressants, or a referral to the psycho-oncologist. Explanations from BERT and RedditBERT differed, with no clear preference from annotators.
Discussion
We show the potential of BERT and RedditBERT in identifying depression concerns in messages from cancer patients. Performance disparities across demographic groups highlight the need for careful consideration of potential biases. Further research is needed to address biases, evaluate real-world impacts, and ensure responsible integration into clinical settings.
Conclusion
This work represents a significant methodological advancement in the early identification of depression concerns among cancer patients. Our work contributes to a route to reduce clinical burden while enhancing overall patient care, leveraging BERT-based models.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Medicine (Biomedical Informatics), Stanford University, Stanford, CA 94305, United States.
- Clinical Artificial Intelligence Implementation and Research Lab (CAIRELab), Leiden University Medical Center, Leiden 2333ZN, The Netherlands.
- Julius Centre for Health Sciences and Primary Care, University Medical Center, Utrecht 3584CX, The Netherlands.
- Department of Information Technology and Electrical Engineering, ETH Zürich, Zürich 8092, Switzerland.
- Department of Biomedical Data Science, Stanford University, Stanford, CA 94305, United States.
- Department of Digital Health, University Medical Center Utrecht, Utrecht 3584CX, The Netherlands.
ORCID-Profile: Marieke M van Buchem, Tina Hernandez-Boussard
Förderung
- NIH HHS
- NLM NIH HHS
- Catharine van Tussenbroek Fund
- Prins Bernhard Cultuur Fund
- National Center for Advancing Translational Sciences of the National Institutes of Health
- NCATS NIH HHS
- National Center for Advancing Translational Sciences
- National Institutes of Health
Zitieren
APA
van Buchem, M. M., de Hond, A. A. H., Fanconi, C., Shah, V., Schuessler, M., Kant, I. M. J., Steyerberg, E. W., & Hernandez-Boussard, T. (2024). Applying natural language processing to patient messages to identify depression concerns in cancer patients. Journal of the American Medical Informatics Association, 31(10), 2255-2262. https://doi.org/10.1093/jamia/ocae188
Vancouver
van Buchem MM, de Hond AAH, Fanconi C, Shah V, Schuessler M, Kant IMJ, et al. Applying natural language processing to patient messages to identify depression concerns in cancer patients. Journal of the American Medical Informatics Association. 2024;31(10):2255-2262. doi:10.1093/jamia/ocae188
BibTeX
@article{vanBuchem2024,
author = {van Buchem, Marieke M and de Hond, Anne A H and Fanconi, Claudio and Shah, Vaibhavi and Schuessler, Max and Kant, Ilse M J and Steyerberg, Ewout W and Hernandez-Boussard, Tina},
title = {Applying natural language processing to patient messages to identify depression concerns in cancer patients},
journal = {Journal of the American Medical Informatics Association},
year = {2024},
volume = {31},
number = {10},
pages = {2255--2262},
doi = {10.1093/jamia/ocae188}
}
EUVIMED