EUVIMEDEUVIMED entdecken
Open Access

LeafAI: query generator for clinical cohort discovery rivaling a human programmer

Nicholas J Dobbins iD, Bin Han, Weipeng Zhou, Kristine F Lan, H Nina Kim, Robert Harrington, Özlem Uzuner iD, Meliha Yetisgen

Journal of the American Medical Informatics Association · 17.11.2023 · 30 (12) · 1954-1964

DOI: 10.1093/jamia/ocad149 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of the American Medical Informatics Association, online erschienen am 07.08.2023. Verfasst von Nicholas J Dobbins und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Informatics & Medical Education, University of Washington, Seattle, Washington, USA. Hauptthemen laut MEDLINE: Natural Language Processing, Unified Medical Language System. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 56 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NLM NIH HHS, NCATS NIH HHS, NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

Identifying study-eligible patients within clinical databases is a critical step in clinical research. However, accurate query design typically requires extensive technical and biomedical expertise. We sought to create a system capable of generating data model-agnostic queries while also providing novel logical reasoning capabilities for complex clinical trial eligibility criteria. Materials and Methods The task of query creation from eligibility criteria requires solving several text-processing problems, including named entity recognition and relation extraction, sequence-to-sequence transformation, normalization, and reasoning. We incorporated hybrid deep learning and rule-based modules for these, as well as a knowledge base of the Unified Medical Language System (UMLS) and linked ontologies. To enable data-model agnostic query creation, we introduce a novel method for tagging database schema elements using UMLS concepts. To evaluate our system, called LeafAI, we compared the capability of LeafAI to a human database programmer to identify patients who had been enrolled in 8 clinical trials conducted at our institution. We measured performance by the number of actual enrolled patients matched by generated queries.

Results

LeafAI matched a mean 43% of enrolled patients with 27 225 eligible across 8 clinical trials, compared to 27% matched and 14 587 eligible in queries by a human database programmer. The human programmer spent 26 total hours crafting queries compared to several minutes by LeafAI.

Conclusions

Our work contributes a state-of-the-art data model-agnostic query generation system capable of conditional reasoning using a knowledge base. We demonstrate that LeafAI can rival an experienced human programmer in finding patients eligible for clinical trials.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Natural Language ProcessingUnified Medical Language SystemHumansKnowledge BasesClinical Trials as Topic

Stichwörter der Autor:innen

clinical trialscohort definitionelectronic health recordsmachine learningnatural language processing

Autor:innen und Institutionen

  • Department of Biomedical Informatics & Medical Education, University of Washington, Seattle, Washington, USA.
  • Department of Research IT, UW Medicine, University of Washington, Seattle, Washington, USA.
  • Information School, University of Washington, Seattle, Washington, USA.
  • Department of Medicine, University of Washington, Seattle, Washington, USA.
  • Department of Information Sciences and Technology, George Mason University, Fairfax, Virginia, USA.

ORCID-Profile: Nicholas J Dobbins, Özlem Uzuner

Förderung

  • NLM NIH HHS
  • NCATS NIH HHS
  • NIH HHS
  • National Library of Medicine
  • National Center for Advancing Translational Sciences
  • National Institutes of Health

Zitieren

APA

Dobbins, N. J., Han, B., Zhou, W., Lan, K. F., Kim, H. N., Harrington, R., Uzuner, Ö., & Yetisgen, M. (2023). LeafAI: query generator for clinical cohort discovery rivaling a human programmer. Journal of the American Medical Informatics Association, 30(12), 1954-1964. https://doi.org/10.1093/jamia/ocad149

Vancouver

Dobbins NJ, Han B, Zhou W, Lan KF, Kim HN, Harrington R, et al. LeafAI: query generator for clinical cohort discovery rivaling a human programmer. Journal of the American Medical Informatics Association. 2023;30(12):1954-1964. doi:10.1093/jamia/ocad149

BibTeX
@article{Dobbins2023,
  author = {Dobbins, Nicholas J and Han, Bin and Zhou, Weipeng and Lan, Kristine F and Kim, H Nina and Harrington, Robert and Uzuner, Özlem and Yetisgen, Meliha},
  title = {LeafAI: query generator for clinical cohort discovery rivaling a human programmer},
  journal = {Journal of the American Medical Informatics Association},
  year = {2023},
  volume = {30},
  number = {12},
  pages = {1954--1964},
  doi = {10.1093/jamia/ocad149}
}
Kostenlos starten →