Leveraging explainable artificial intelligence to optimize clinical decision support
Journal of the American Medical Informatics Association · 2024
DOI: 10.1093/jamia/ocae019 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of the American Medical Informatics Association, 2024. Verfasst von Siru Liu und 11 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN 37203, United States. Hauptthemen laut MEDLINE: Artificial Intelligence, Decision Support Systems, Clinical. Die Arbeit wurde bisher 45-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NLM NIH HHS, NIA NIH HHS, NIH HHS.
Abstract (Originalsprache)
Objective
To develop and evaluate a data-driven process to generate suggestions for improving alert criteria using explainable artificial intelligence (XAI) approaches.
Methods
We extracted data on alerts generated from January 1, 2019 to December 31, 2020, at Vanderbilt University Medical Center. We developed machine learning models to predict user responses to alerts. We applied XAI techniques to generate global explanations and local explanations. We evaluated the generated suggestions by comparing with alert’s historical change logs and stakeholder interviews. Suggestions that either matched (or partially matched) changes already made to the alert or were considered clinically correct were classified as helpful.
Results
The final dataset included 2 991 823 firings with 2689 features. Among the 5 machine learning models, the LightGBM model achieved the highest Area under the ROC Curve: 0.919 [0.918, 0.920]. We identified 96 helpful suggestions. A total of 278 807 firings (9.3%) could have been eliminated. Some of the suggestions also revealed workflow and education issues.
Conclusion
We developed a data-driven process to generate suggestions for improving alert criteria using XAI techniques. Our approach could identify improvements regarding clinical decision support (CDS) that might be overlooked or delayed in manual reviews. It also unveils a secondary purpose for the XAI: to improve quality by discovering scenarios where CDS alerts are not accepted due to workflow, education, or staffing issues.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN 37203, United States.
- Department of Computer Science, Vanderbilt University, Nashville, TN 37212, United States.
- Department of Medicine, Vanderbilt University Medical Center, Nashville, TN 37203, United States.
- School of Biomedical Informatics, University of Texas Health Science Center, Houston, TX 77030, United States.
- Department of Pediatrics, Vanderbilt University Medical Center, Nashville, TN 37203, United States.
- Department of Pathology, Microbiology and Immunology, Vanderbilt University Medical Center, Nashville, TN 37203, United States.
ORCID-Profile: Allison B McCoy, Dean F Sittig, Scott D Nelson, Adam Wright
Förderung
- NLM NIH HHS
- NIA NIH HHS
- NIH HHS
- NIH
Zitieren
APA
Liu, S., McCoy, A. B., Peterson, J. F., Lasko, T. A., Sittig, D. F., Nelson, S. D., Andrews, J., Patterson, L., Cobb, C. M., Mulherin, D., Morton, C. T., & Wright, A. (2024). Leveraging explainable artificial intelligence to optimize clinical decision support. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocae019
Vancouver
Liu S, McCoy AB, Peterson JF, Lasko TA, Sittig DF, Nelson SD, et al. Leveraging explainable artificial intelligence to optimize clinical decision support. Journal of the American Medical Informatics Association. 2024. doi:10.1093/jamia/ocae019
BibTeX
@article{Liu2024,
author = {Liu, Siru and McCoy, Allison B and Peterson, Josh F and Lasko, Thomas A and Sittig, Dean F and Nelson, Scott D and Andrews, Jennifer and Patterson, Lorraine and Cobb, Cheryl M and Mulherin, David and Morton, Colleen T and Wright, Adam},
title = {Leveraging explainable artificial intelligence to optimize clinical decision support},
journal = {Journal of the American Medical Informatics Association},
year = {2024},
doi = {10.1093/jamia/ocae019}
}
EUVIMED