EUVIMEDEUVIMED entdecken
KohortenstudieOpen Access

Scalable Identification of Clinically Relevant Chronic Obstructive Pulmonary Disease Documents in Large-Scale Electronic Health Record Datasets With a Lightweight Natural Language Processing Model: Retrospective Cohort Study

Mohammed Al-Garadi iD, Sharon E Davis iD, Michael E Matheny iD, Dax Westerman iD, Adrienne K Conger iD, Bradley W Richmond iD, Thomas A Lasko iD, Iben M Ricket iD, Laura M Paulin iD, Jeremiah R Brown iD, Ruth M Reeves iD

JMIR Medical Informatics · 2026

DOI: 10.2196/84326 ↗

Kurz gefasst

Kohortenstudie in der Zeitschrift JMIR Medical Informatics, 2026. Verfasst von Mohammed Al-Garadi und 10 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Informatics, Vanderbilt University Medical Center, 2525 West End Ave, Suite 1475, Nashville, TN, 37203, United States, 1 (61…. Hauptthemen laut MEDLINE: Clinical Relevance, Pulmonary Disease, Chronic Obstructive, Natural Language Processing, Classification Algorithms. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NHLBI NIH HHS, NCATS NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

The widespread adoption of electronic health records has resulted in the generation of large volumes of clinical notes. Learning algorithms and large language models can be trained on these resources, but they are susceptible to noise—irrelevant or noninformative data. This sensitivity can lead to significant challenges, including performance degradation and the generation of inaccurate predictions or “hallucinations.” This study addresses a critical challenge in clinical informatics: efficiently filtering millions of documents for relevance before advanced language model processing, particularly in resource-constrained environments.

Objective

We present a novel framework for determining document relevance in clinical settings using a chronic obstructive pulmonary disease (COPD) dataset.

Methods

We developed a novel framework using weak supervision and domain-expert heuristics to generate “silver standard” labels for training data and gold standard expert-annotated labels, creating 2 datasets to optimize the model during the development phase and subsequent testing phase. Various text representation techniques (bag of words, term frequency–inverse document frequency, lightweight document embeddings, compression-based features, and Unified Medical Language System concept extraction) were evaluated. These representations were used to train random forest, extreme gradient boosting, and k-nearest neighbor classifiers. Models were optimized on a small expert-annotated dataset and evaluated on a held-out test set.

Results

The combination of lightweight document embedding with a random forest classifier demonstrated the best performance, achieving a precision of 0.73, recall of 0.86, and F 1 -score of 0.80 (95% CI 0.76-0.87) for identifying relevant COPD documents. This significantly outperformed baseline heuristics (precision=0.70; recall=0.38; F 1 -score=0.50, 95% CI 0.43-0.56) and other tested methods.

Conclusions

Our study presents a novel framework for identifying COPD-relevant clinical documents using lightweight embedding and machine learning. This approach effectively filters pertinent documents, enhancing information retrieval precision. The framework’s scalability and minimal annotation needs make it promising for diverse health care applications, potentially optimizing clinical outcomes through efficient document selection for data-driven decision support systems.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Clinical RelevancePulmonary Disease, Chronic ObstructiveNatural Language ProcessingClassification AlgorithmsData MiningDatasets as TopicElectronic Health RecordsRetrospective StudiesHumansRandom ForestBoosting Machine Learning AlgorithmsDocument Analysis

Stichwörter der Autor:innen

AIartificial intelligencechronic obstructive pulmonary diseasedata miningelectronic health recordmachine learningnatural language processing

Autor:innen und Institutionen

  • Department of Biomedical Informatics, Vanderbilt University Medical Center, 2525 West End Ave, Suite 1475, Nashville, TN, 37203, United States, 1 (615) 936-6867.
  • Department of Medicine, Vanderbilt University Medical Center, Nashville, TN, United States.
  • Department of Biostatistics, Vanderbilt University Medical Center, Nashville, TN, United States.
  • Tennessee Valley Healthcare System, Department of Veterans Affairs, Nashville, TN, United States.
  • Division of Allergy, Pulmonology, and Critical Care Medicine, Vanderbilt University Medical Center, Nashville, TN, United States.
  • Department of Computer Science, Vanderbilt University, Nashville, TN, United States.

ORCID-Profile: Mohammed Al-Garadi, Sharon E Davis, Michael E Matheny, Dax Westerman, Adrienne K Conger, Bradley W Richmond, Thomas A Lasko, Iben M Ricket, Laura M Paulin, Jeremiah R Brown, Ruth M Reeves

Förderung

  • NHLBI NIH HHS
  • NCATS NIH HHS

Zitieren

APA

Al-Garadi, M., Davis, S. E., Matheny, M. E., Westerman, D., Conger, A. K., Richmond, B. W., Lasko, T. A., Ricket, I. M., Paulin, L. M., Brown, J. R., & Reeves, R. M. (2026). Scalable Identification of Clinically Relevant Chronic Obstructive Pulmonary Disease Documents in Large-Scale Electronic Health Record Datasets With a Lightweight Natural Language Processing Model: Retrospective Cohort Study. JMIR Medical Informatics. https://doi.org/10.2196/84326

Vancouver

Al-Garadi M, Davis SE, Matheny ME, Westerman D, Conger AK, Richmond BW, et al. Scalable Identification of Clinically Relevant Chronic Obstructive Pulmonary Disease Documents in Large-Scale Electronic Health Record Datasets With a Lightweight Natural Language Processing Model: Retrospective Cohort Study. JMIR Medical Informatics. 2026. doi:10.2196/84326

BibTeX
@article{AlGaradi2026,
  author = {Al-Garadi, Mohammed and Davis, Sharon E and Matheny, Michael E and Westerman, Dax and Conger, Adrienne K and Richmond, Bradley W and Lasko, Thomas A and Ricket, Iben M and Paulin, Laura M and Brown, Jeremiah R and Reeves, Ruth M},
  title = {Scalable Identification of Clinically Relevant Chronic Obstructive Pulmonary Disease Documents in Large-Scale Electronic Health Record Datasets With a Lightweight Natural Language Processing Model: Retrospective Cohort Study},
  journal = {JMIR Medical Informatics},
  year = {2026},
  doi = {10.2196/84326}
}
Kostenlos starten →