Natural Language Processing Algorithm to Extract Multiple Myeloma Stage From Oncology Notes in the Veterans Affairs Healthcare System
JCO Clinical Cancer Informatics · 2024-07 · (8)
DOI: 10.1200/cci.23.00197 ↗Kurz gefasst
Fachartikel in der Zeitschrift JCO Clinical Cancer Informatics, 2024-07. Verfasst von Sergey D Goryachev und 10 weiteren Autor:innen. Beteiligte Einrichtung: Massachusetts Veterans Epidemiology Research and Information Center (MAVERIC), Boston, MA. Hauptthemen laut MEDLINE: Natural Language Processing, Multiple Myeloma, Algorithms, Electronic Health Records. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: BLRD VA, CSRD VA, NCI NIH HHS.
Abstract (Originalsprache)
PURPOSE Stage in multiple myeloma (MM) is an essential measure of disease risk, but its measurement in large databases is often lacking. We aimed to develop and validate a natural language processing (NLP) algorithm to extract oncologists' documentation of stage in the national Veterans Affairs (VA) Healthcare System. METHODS Using nationwide electronic health record (EHR) and cancer registry data from the VA Corporate Data Warehouse, we developed and validated a rule-based NLP algorithm to extract oncologist-determined MM stage. To that end, a clinician annotated MM stage within over 5,000 short snippets of clinical notes, and annotated MM stage at MM treatment initiation for 200 patients. These were allocated into snippet- and patient-level development and validation sets. We developed MM stage extraction and roll-up algorithms within the development sets. After the algorithms were finalized, we validated them using standard measures in held-out validation sets. RESULTS We developed algorithms for three different MM staging systems that have been in widespread use (Revised International Staging System [R-ISS], International Staging System [ISS], and Durie-Salmon [DS]) and for stage reported without a clearly defined system. Precision and recall were uniformly high for MM stage at the snippet level, ranging from 0.92 to 0.99 for the different MM staging systems. Performance in identifying for MM stage at treatment initiation at the patient level was also excellent, with precision of 0.92, 0.96, 0.90, and 0.86 and recall of 0.99, 0.98, 0.94, and 0.92 for R-ISS, ISS, DS, and unclear stage, respectively. CONCLUSION Our MM stage extraction algorithm uses rule-based NLP and data aggregation to accurately measure MM stage documented in oncology notes and pathology reports in VA's national EHR system. It may be adapted to other systems where MM stage is recorded in clinical notes.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Massachusetts Veterans Epidemiology Research and Information Center (MAVERIC), Boston, MA.
- VA Boston Healthcare System, Boston, MA.
- VA Boston Cooperative Studies Program, Boston, MA.
- New England Geriatrics Research, Education and Clinical Center, VA Boston Healthcare System, Boston, MA.
- Division of Aging, Brigham and Women's Hospital, Boston, MA.
- Divison of Population Sciences, Dana-Farber Cancer Institute, Boston, MA.
ORCID-Profile: Clark DuMontier, Jennifer La, Mary T Brophy, Nikhil C Munshi, Nhan V Do, Nathanael R Fillmore
Förderung
- BLRD VA
- CSRD VA
- NCI NIH HHS
- NIA NIH HHS
Zitieren
APA
Goryachev, S. D., Yildirim, C., DuMontier, C., La, J., Dharne, M., Gaziano, J. M., Brophy, M. T., Munshi, N. C., Driver, J. A., Do, N. V., & Fillmore, N. R. (2024). Natural Language Processing Algorithm to Extract Multiple Myeloma Stage From Oncology Notes in the Veterans Affairs Healthcare System. JCO Clinical Cancer Informatics. https://doi.org/10.1200/cci.23.00197
Vancouver
Goryachev SD, Yildirim C, DuMontier C, La J, Dharne M, Gaziano JM, et al. Natural Language Processing Algorithm to Extract Multiple Myeloma Stage From Oncology Notes in the Veterans Affairs Healthcare System. JCO Clinical Cancer Informatics. 2024. doi:10.1200/cci.23.00197
BibTeX
@article{Goryachev2024,
author = {Goryachev, Sergey D and Yildirim, Cenk and DuMontier, Clark and La, Jennifer and Dharne, Mayuri and Gaziano, J Michael and Brophy, Mary T and Munshi, Nikhil C and Driver, Jane A and Do, Nhan V and Fillmore, Nathanael R},
title = {Natural Language Processing Algorithm to Extract Multiple Myeloma Stage From Oncology Notes in the Veterans Affairs Healthcare System},
journal = {JCO Clinical Cancer Informatics},
year = {2024},
number = {8},
doi = {10.1200/cci.23.00197}
}
EUVIMED