Natural Language Processing–Assisted Classification Models to Confirm Monoclonal Gammopathy of Undetermined Significance and Progression in Veterans' Electronic Health Records
JCO Clinical Cancer Informatics · 2023-09 · (7)
DOI: 10.1200/cci.23.00081 ↗Kurz gefasst
Fachartikel in der Zeitschrift JCO Clinical Cancer Informatics, 2023-09. Verfasst von Mei Wang und 8 weiteren Autor:innen. Beteiligte Einrichtung: Research Service, St Louis Veterans Affairs Medical Center, St Louis, MO. Hauptthemen laut MEDLINE: Monoclonal Gammopathy of Undetermined Significance, Veterans, Multiple Myeloma. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NCI NIH HHS.
Abstract (Originalsprache)
PURPOSE To develop and validate natural language processing (NLP)–assisted machine learning (ML)–based classification models to confirm diagnoses of monoclonal gammopathy of undetermined significance (MGUS) and multiple myeloma (MM) from electronic health records (EHRs) in the Veterans Health Administration (VHA). MATERIALS AND METHODS We developed precompiled lexicons and classification rules as features for the following ML classifiers: logistic regression, random forest, and support vector machines (SVMs). These features were trained on 36,044 EHR documents from a random sample of 400 patients with at least one International Classification of Disease code for MGUS diagnosis from 1999 to 2021. The best-performing feature combination was calibrated in the validation set (17,826 documents/200 patients) and evaluated in the testing set (9,250 documents/100 patients). Model performance in diagnosis confirmation was compared with manual chart review results (gold standard) using recall, precision, accuracy, and F1 score. For patients correctly labeled as disease-positive, the difference between model-identified diagnosis dates and the gold standard was also computed. RESULTS In the testing set, the NLP-assisted classification model using SVMs achieved best performance in both MGUS and MM confirmation with recall/precision/accuracy/F1 of 98.8%/93.3%/93.0%/96.0% for MGUS and 100.0%/92.3%/99.0%/96.0% for MM. Dates of diagnoses matched (±45 days) with those of gold standard in 73.0% of model-confirmed MGUS and 84.6% of model-confirmed MM. CONCLUSION An NLP-assisted classification model can reliably confirm MGUS and MM diagnoses and dates and extract laboratory results using automated interpretation of EHR data. This algorithm has the potential to be adapted to other disease areas in VHA EHR system.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Research Service, St Louis Veterans Affairs Medical Center, St Louis, MO.
- Department of Surgery, Washington University School of Medicine, St Louis, MO.
- Department of Electrical and Systems Engineering, Washington University in St Louis, St Louis, MO.
- City of Hope National Comprehensive Cancer Center, Duarte, CA.
- Department of Medicine, Saint Louis University School of Medicine, St Louis, MO.
- Department of Medicine, Washington University School of Medicine, St Louis, MO.
ORCID-Profile: Mei Wang, Lawrence Liu, Martin W Schoen, Graham Colditz, Su-Hsin Chang
Förderung
- NCI NIH HHS
Zitieren
APA
Wang, M., Yu, Y. C., Liu, L., Schoen, M. W., Kumar, A., Vargo, K., Colditz, G., Thomas, T., & Chang, S. H. (2023). Natural Language Processing–Assisted Classification Models to Confirm Monoclonal Gammopathy of Undetermined Significance and Progression in Veterans' Electronic Health Records. JCO Clinical Cancer Informatics. https://doi.org/10.1200/cci.23.00081
Vancouver
Wang M, Yu YC, Liu L, Schoen MW, Kumar A, Vargo K, et al. Natural Language Processing–Assisted Classification Models to Confirm Monoclonal Gammopathy of Undetermined Significance and Progression in Veterans' Electronic Health Records. JCO Clinical Cancer Informatics. 2023. doi:10.1200/cci.23.00081
BibTeX
@article{Wang2023,
author = {Wang, Mei and Yu, Yao-Chi and Liu, Lawrence and Schoen, Martin W and Kumar, Akhil and Vargo, Kristin and Colditz, Graham and Thomas, Theodore and Chang, Su-Hsin},
title = {Natural Language Processing–Assisted Classification Models to Confirm Monoclonal Gammopathy of Undetermined Significance and Progression in Veterans' Electronic Health Records},
journal = {JCO Clinical Cancer Informatics},
year = {2023},
number = {7},
doi = {10.1200/cci.23.00081}
}
EUVIMED