EUVIMEDEUVIMED entdecken
Open Access

Sociotechnical feasibility of natural language processing-driven tools in clinical trial eligibility prescreening for Alzheimer’s disease and related dementias

Betina Idnay iD, Jianfang Liu, Yilu Fang iD, Alex Hernandez, Shivani Kaw, Alicia Etwaru, Janeth Juarez Padilla, Sergio Ozoria Ramírez, Karen Marder, Chunhua Weng iD, Rebecca Schnall iD

Journal of the American Medical Informatics Association · 2024

DOI: 10.1093/jamia/ocae032 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of the American Medical Informatics Association, 2024. Verfasst von Betina Idnay und 10 weiteren Autor:innen. Beteiligte Einrichtung: School of Nursing, Columbia University Irving Medical Center, New York, NY 10032, United States. Hauptthemen laut MEDLINE: Alzheimer Disease, Medical Informatics. Die Arbeit nennt 81 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NLM NIH HHS, NINR NIH HHS, AHRQ HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Alzheimer’s disease and related dementias (ADRD) affect over 55 million globally. Current clinical trials suffer from low recruitment rates, a challenge potentially addressable via natural language processing (NLP) technologies for researchers to effectively identify eligible clinical trial participants.

Objective

This study investigates the sociotechnical feasibility of NLP-driven tools for ADRD research prescreening and analyzes the tools’ cognitive complexity's effect on usability to identify cognitive support strategies.

Methods

A randomized experiment was conducted with 60 clinical research staff using three prescreening tools (Criteria2Query, Informatics for Integrating Biology and the Bedside [i2b2], and Leaf). Cognitive task analysis was employed to analyze the usability of each tool using the Health Information Technology Usability Evaluation Scale. Data analysis involved calculating descriptive statistics, interrater agreement via intraclass correlation coefficient, cognitive complexity, and Generalized Estimating Equations models.

Results

Leaf scored highest for usability followed by Criteria2Query and i2b2. Cognitive complexity was found to be affected by age, computer literacy, and number of criteria, but was not significantly associated with usability.

Discussion

Adopting NLP for ADRD prescreening demands careful task delegation, comprehensive training, precise translation of eligibility criteria, and increased research accessibility. The study highlights the relevance of these factors in enhancing NLP-driven tools’ usability and efficacy in clinical research prescreening.

Conclusion

User-modifiable NLP-driven prescreening tools were favorably received, with system type, evaluation sequence, and user's computer literacy influencing usability more than cognitive complexity. The study emphasizes NLP's potential in improving recruitment for clinical trials, endorsing a mixed-methods approach for future system evaluation and enhancements.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Alzheimer DiseaseMedical InformaticsHumansNatural Language ProcessingFeasibility StudiesEligibility Determination

Stichwörter der Autor:innen

clinical trialinformaticsresearch recruitment

Autor:innen und Institutionen

  • School of Nursing, Columbia University Irving Medical Center, New York, NY 10032, United States.
  • Department of Biomedical Informatics, Columbia University Irving Medical Center, New York, NY 10032, United States.
  • New York University Grossman School of Medicine, New York, NY 10016, United States.
  • New York University Steinhardt School of Culture, Education, and Human Development, New York, NY 10003, United States.
  • Department of Neurology, Columbia University Irving Medical Center, New York, NY 10032, United States.
  • Mailman School of Public Health, Columbia University, New York, NY 10032, United States.

ORCID-Profile: Betina Idnay, Yilu Fang, Chunhua Weng, Rebecca Schnall

Förderung

  • NLM NIH HHS
  • NINR NIH HHS
  • AHRQ HHS
  • NIH HHS
  • NCATS NIH HHS
  • Agency for Healthcare Research and Quality
  • National Institute of Nursing Research
  • National Library of Medicine

Zitieren

APA

Idnay, B., Liu, J., Fang, Y., Hernandez, A., Kaw, S., Etwaru, A., Juarez Padilla, J., Ramírez, S. O., Marder, K., Weng, C., & Schnall, R. (2024). Sociotechnical feasibility of natural language processing-driven tools in clinical trial eligibility prescreening for Alzheimer’s disease and related dementias. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocae032

Vancouver

Idnay B, Liu J, Fang Y, Hernandez A, Kaw S, Etwaru A, et al. Sociotechnical feasibility of natural language processing-driven tools in clinical trial eligibility prescreening for Alzheimer’s disease and related dementias. Journal of the American Medical Informatics Association. 2024. doi:10.1093/jamia/ocae032

BibTeX
@article{Idnay2024,
  author = {Idnay, Betina and Liu, Jianfang and Fang, Yilu and Hernandez, Alex and Kaw, Shivani and Etwaru, Alicia and Juarez Padilla, Janeth and Ramírez, Sergio Ozoria and Marder, Karen and Weng, Chunhua and Schnall, Rebecca},
  title = {Sociotechnical feasibility of natural language processing-driven tools in clinical trial eligibility prescreening for Alzheimer’s disease and related dementias},
  journal = {Journal of the American Medical Informatics Association},
  year = {2024},
  doi = {10.1093/jamia/ocae032}
}
Kostenlos starten →