Sociotechnical feasibility of natural language processing-driven tools in clinical trial eligibility prescreening for Alzheimer’s disease and related dementias
Journal of the American Medical Informatics Association · 2024
DOI: 10.1093/jamia/ocae032 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of the American Medical Informatics Association, 2024. Verfasst von Betina Idnay und 10 weiteren Autor:innen. Beteiligte Einrichtung: School of Nursing, Columbia University Irving Medical Center, New York, NY 10032, United States. Hauptthemen laut MEDLINE: Alzheimer Disease, Medical Informatics. Die Arbeit nennt 81 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NLM NIH HHS, NINR NIH HHS, AHRQ HHS.
Themen: Demenz
Abstract (Originalsprache)
Background
Alzheimer’s disease and related dementias (ADRD) affect over 55 million globally. Current clinical trials suffer from low recruitment rates, a challenge potentially addressable via natural language processing (NLP) technologies for researchers to effectively identify eligible clinical trial participants.
Objective
This study investigates the sociotechnical feasibility of NLP-driven tools for ADRD research prescreening and analyzes the tools’ cognitive complexity's effect on usability to identify cognitive support strategies.
Methods
A randomized experiment was conducted with 60 clinical research staff using three prescreening tools (Criteria2Query, Informatics for Integrating Biology and the Bedside [i2b2], and Leaf). Cognitive task analysis was employed to analyze the usability of each tool using the Health Information Technology Usability Evaluation Scale. Data analysis involved calculating descriptive statistics, interrater agreement via intraclass correlation coefficient, cognitive complexity, and Generalized Estimating Equations models.
Results
Leaf scored highest for usability followed by Criteria2Query and i2b2. Cognitive complexity was found to be affected by age, computer literacy, and number of criteria, but was not significantly associated with usability.
Discussion
Adopting NLP for ADRD prescreening demands careful task delegation, comprehensive training, precise translation of eligibility criteria, and increased research accessibility. The study highlights the relevance of these factors in enhancing NLP-driven tools’ usability and efficacy in clinical research prescreening.
Conclusion
User-modifiable NLP-driven prescreening tools were favorably received, with system type, evaluation sequence, and user's computer literacy influencing usability more than cognitive complexity. The study emphasizes NLP's potential in improving recruitment for clinical trials, endorsing a mixed-methods approach for future system evaluation and enhancements.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Nursing, Columbia University Irving Medical Center, New York, NY 10032, United States.
- Department of Biomedical Informatics, Columbia University Irving Medical Center, New York, NY 10032, United States.
- New York University Grossman School of Medicine, New York, NY 10016, United States.
- New York University Steinhardt School of Culture, Education, and Human Development, New York, NY 10003, United States.
- Department of Neurology, Columbia University Irving Medical Center, New York, NY 10032, United States.
- Mailman School of Public Health, Columbia University, New York, NY 10032, United States.
ORCID-Profile: Betina Idnay, Yilu Fang, Chunhua Weng, Rebecca Schnall
Förderung
- NLM NIH HHS
- NINR NIH HHS
- AHRQ HHS
- NIH HHS
- NCATS NIH HHS
- Agency for Healthcare Research and Quality
- National Institute of Nursing Research
- National Library of Medicine
Zitieren
APA
Idnay, B., Liu, J., Fang, Y., Hernandez, A., Kaw, S., Etwaru, A., Juarez Padilla, J., Ramírez, S. O., Marder, K., Weng, C., & Schnall, R. (2024). Sociotechnical feasibility of natural language processing-driven tools in clinical trial eligibility prescreening for Alzheimer’s disease and related dementias. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocae032
Vancouver
Idnay B, Liu J, Fang Y, Hernandez A, Kaw S, Etwaru A, et al. Sociotechnical feasibility of natural language processing-driven tools in clinical trial eligibility prescreening for Alzheimer’s disease and related dementias. Journal of the American Medical Informatics Association. 2024. doi:10.1093/jamia/ocae032
BibTeX
@article{Idnay2024,
author = {Idnay, Betina and Liu, Jianfang and Fang, Yilu and Hernandez, Alex and Kaw, Shivani and Etwaru, Alicia and Juarez Padilla, Janeth and Ramírez, Sergio Ozoria and Marder, Karen and Weng, Chunhua and Schnall, Rebecca},
title = {Sociotechnical feasibility of natural language processing-driven tools in clinical trial eligibility prescreening for Alzheimer’s disease and related dementias},
journal = {Journal of the American Medical Informatics Association},
year = {2024},
doi = {10.1093/jamia/ocae032}
}
EUVIMED