EUVIMEDEUVIMED entdecken
Open Access

Natural Language Processing–Assisted Classification Models to Confirm Monoclonal Gammopathy of Undetermined Significance and Progression in Veterans' Electronic Health Records

Mei Wang iD, Yao-Chi Yu, Lawrence Liu iD, Martin W Schoen iD, Akhil Kumar, Kristin Vargo, Graham Colditz iD, Theodore Thomas, Su-Hsin Chang iD

JCO Clinical Cancer Informatics · 2023-09 · (7)

DOI: 10.1200/cci.23.00081 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JCO Clinical Cancer Informatics, 2023-09. Verfasst von Mei Wang und 8 weiteren Autor:innen. Beteiligte Einrichtung: Research Service, St Louis Veterans Affairs Medical Center, St Louis, MO. Hauptthemen laut MEDLINE: Monoclonal Gammopathy of Undetermined Significance, Veterans, Multiple Myeloma. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NCI NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

PURPOSE To develop and validate natural language processing (NLP)–assisted machine learning (ML)–based classification models to confirm diagnoses of monoclonal gammopathy of undetermined significance (MGUS) and multiple myeloma (MM) from electronic health records (EHRs) in the Veterans Health Administration (VHA). MATERIALS AND METHODS We developed precompiled lexicons and classification rules as features for the following ML classifiers: logistic regression, random forest, and support vector machines (SVMs). These features were trained on 36,044 EHR documents from a random sample of 400 patients with at least one International Classification of Disease code for MGUS diagnosis from 1999 to 2021. The best-performing feature combination was calibrated in the validation set (17,826 documents/200 patients) and evaluated in the testing set (9,250 documents/100 patients). Model performance in diagnosis confirmation was compared with manual chart review results (gold standard) using recall, precision, accuracy, and F1 score. For patients correctly labeled as disease-positive, the difference between model-identified diagnosis dates and the gold standard was also computed. RESULTS In the testing set, the NLP-assisted classification model using SVMs achieved best performance in both MGUS and MM confirmation with recall/precision/accuracy/F1 of 98.8%/93.3%/93.0%/96.0% for MGUS and 100.0%/92.3%/99.0%/96.0% for MM. Dates of diagnoses matched (±45 days) with those of gold standard in 73.0% of model-confirmed MGUS and 84.6% of model-confirmed MM. CONCLUSION An NLP-assisted classification model can reliably confirm MGUS and MM diagnoses and dates and extract laboratory results using automated interpretation of EHR data. This algorithm has the potential to be adapted to other disease areas in VHA EHR system.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Monoclonal Gammopathy of Undetermined SignificanceVeteransMultiple MyelomaHumansNatural Language ProcessingElectronic Health Records

Autor:innen und Institutionen

  • Research Service, St Louis Veterans Affairs Medical Center, St Louis, MO.
  • Department of Surgery, Washington University School of Medicine, St Louis, MO.
  • Department of Electrical and Systems Engineering, Washington University in St Louis, St Louis, MO.
  • City of Hope National Comprehensive Cancer Center, Duarte, CA.
  • Department of Medicine, Saint Louis University School of Medicine, St Louis, MO.
  • Department of Medicine, Washington University School of Medicine, St Louis, MO.

ORCID-Profile: Mei Wang, Lawrence Liu, Martin W Schoen, Graham Colditz, Su-Hsin Chang

Förderung

  • NCI NIH HHS

Zitieren

APA

Wang, M., Yu, Y. C., Liu, L., Schoen, M. W., Kumar, A., Vargo, K., Colditz, G., Thomas, T., & Chang, S. H. (2023). Natural Language Processing–Assisted Classification Models to Confirm Monoclonal Gammopathy of Undetermined Significance and Progression in Veterans' Electronic Health Records. JCO Clinical Cancer Informatics. https://doi.org/10.1200/cci.23.00081

Vancouver

Wang M, Yu YC, Liu L, Schoen MW, Kumar A, Vargo K, et al. Natural Language Processing–Assisted Classification Models to Confirm Monoclonal Gammopathy of Undetermined Significance and Progression in Veterans' Electronic Health Records. JCO Clinical Cancer Informatics. 2023. doi:10.1200/cci.23.00081

BibTeX
@article{Wang2023,
  author = {Wang, Mei and Yu, Yao-Chi and Liu, Lawrence and Schoen, Martin W and Kumar, Akhil and Vargo, Kristin and Colditz, Graham and Thomas, Theodore and Chang, Su-Hsin},
  title = {Natural Language Processing–Assisted Classification Models to Confirm Monoclonal Gammopathy of Undetermined Significance and Progression in Veterans' Electronic Health Records},
  journal = {JCO Clinical Cancer Informatics},
  year = {2023},
  number = {7},
  doi = {10.1200/cci.23.00081}
}
Kostenlos starten →