LeafAI: query generator for clinical cohort discovery rivaling a human programmer
Journal of the American Medical Informatics Association · 17.11.2023 · 30 (12) · 1954-1964
DOI: 10.1093/jamia/ocad149 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of the American Medical Informatics Association, online erschienen am 07.08.2023. Verfasst von Nicholas J Dobbins und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Informatics & Medical Education, University of Washington, Seattle, Washington, USA. Hauptthemen laut MEDLINE: Natural Language Processing, Unified Medical Language System. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 56 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NLM NIH HHS, NCATS NIH HHS, NIH HHS.
Abstract (Originalsprache)
Objective
Identifying study-eligible patients within clinical databases is a critical step in clinical research. However, accurate query design typically requires extensive technical and biomedical expertise. We sought to create a system capable of generating data model-agnostic queries while also providing novel logical reasoning capabilities for complex clinical trial eligibility criteria. Materials and Methods The task of query creation from eligibility criteria requires solving several text-processing problems, including named entity recognition and relation extraction, sequence-to-sequence transformation, normalization, and reasoning. We incorporated hybrid deep learning and rule-based modules for these, as well as a knowledge base of the Unified Medical Language System (UMLS) and linked ontologies. To enable data-model agnostic query creation, we introduce a novel method for tagging database schema elements using UMLS concepts. To evaluate our system, called LeafAI, we compared the capability of LeafAI to a human database programmer to identify patients who had been enrolled in 8 clinical trials conducted at our institution. We measured performance by the number of actual enrolled patients matched by generated queries.
Results
LeafAI matched a mean 43% of enrolled patients with 27 225 eligible across 8 clinical trials, compared to 27% matched and 14 587 eligible in queries by a human database programmer. The human programmer spent 26 total hours crafting queries compared to several minutes by LeafAI.
Conclusions
Our work contributes a state-of-the-art data model-agnostic query generation system capable of conditional reasoning using a knowledge base. We demonstrate that LeafAI can rival an experienced human programmer in finding patients eligible for clinical trials.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Biomedical Informatics & Medical Education, University of Washington, Seattle, Washington, USA.
- Department of Research IT, UW Medicine, University of Washington, Seattle, Washington, USA.
- Information School, University of Washington, Seattle, Washington, USA.
- Department of Medicine, University of Washington, Seattle, Washington, USA.
- Department of Information Sciences and Technology, George Mason University, Fairfax, Virginia, USA.
ORCID-Profile: Nicholas J Dobbins, Özlem Uzuner
Förderung
- NLM NIH HHS
- NCATS NIH HHS
- NIH HHS
- National Library of Medicine
- National Center for Advancing Translational Sciences
- National Institutes of Health
Zitieren
APA
Dobbins, N. J., Han, B., Zhou, W., Lan, K. F., Kim, H. N., Harrington, R., Uzuner, Ö., & Yetisgen, M. (2023). LeafAI: query generator for clinical cohort discovery rivaling a human programmer. Journal of the American Medical Informatics Association, 30(12), 1954-1964. https://doi.org/10.1093/jamia/ocad149
Vancouver
Dobbins NJ, Han B, Zhou W, Lan KF, Kim HN, Harrington R, et al. LeafAI: query generator for clinical cohort discovery rivaling a human programmer. Journal of the American Medical Informatics Association. 2023;30(12):1954-1964. doi:10.1093/jamia/ocad149
BibTeX
@article{Dobbins2023,
author = {Dobbins, Nicholas J and Han, Bin and Zhou, Weipeng and Lan, Kristine F and Kim, H Nina and Harrington, Robert and Uzuner, Özlem and Yetisgen, Meliha},
title = {LeafAI: query generator for clinical cohort discovery rivaling a human programmer},
journal = {Journal of the American Medical Informatics Association},
year = {2023},
volume = {30},
number = {12},
pages = {1954--1964},
doi = {10.1093/jamia/ocad149}
}
EUVIMED