EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Leveraging explainable artificial intelligence to optimize clinical decision support

Siru Liu, Allison B McCoy iD, Josh F Peterson, Thomas A Lasko, Dean F Sittig iD, Scott D Nelson iD, Jennifer Andrews, Lorraine Patterson, Cheryl M Cobb, David Mulherin, Colleen T Morton, Adam Wright iD

Journal of the American Medical Informatics Association · 2024

DOI: 10.1093/jamia/ocae019 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of the American Medical Informatics Association, 2024. Verfasst von Siru Liu und 11 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN 37203, United States. Hauptthemen laut MEDLINE: Artificial Intelligence, Decision Support Systems, Clinical. Die Arbeit wurde bisher 45-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NLM NIH HHS, NIA NIH HHS, NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

To develop and evaluate a data-driven process to generate suggestions for improving alert criteria using explainable artificial intelligence (XAI) approaches.

Methods

We extracted data on alerts generated from January 1, 2019 to December 31, 2020, at Vanderbilt University Medical Center. We developed machine learning models to predict user responses to alerts. We applied XAI techniques to generate global explanations and local explanations. We evaluated the generated suggestions by comparing with alert’s historical change logs and stakeholder interviews. Suggestions that either matched (or partially matched) changes already made to the alert or were considered clinically correct were classified as helpful.

Results

The final dataset included 2 991 823 firings with 2689 features. Among the 5 machine learning models, the LightGBM model achieved the highest Area under the ROC Curve: 0.919 [0.918, 0.920]. We identified 96 helpful suggestions. A total of 278 807 firings (9.3%) could have been eliminated. Some of the suggestions also revealed workflow and education issues.

Conclusion

We developed a data-driven process to generate suggestions for improving alert criteria using XAI techniques. Our approach could identify improvements regarding clinical decision support (CDS) that might be overlooked or delayed in manual reviews. It also unveils a secondary purpose for the XAI: to improve quality by discovering scenarios where CDS alerts are not accepted due to workflow, education, or staffing issues.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceDecision Support Systems, ClinicalHumansMachine LearningAcademic Medical CentersEducational Status

Stichwörter der Autor:innen

clinical decision supportelectronic health recordexplainable artificial intelligence

Autor:innen und Institutionen

  • Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN 37203, United States.
  • Department of Computer Science, Vanderbilt University, Nashville, TN 37212, United States.
  • Department of Medicine, Vanderbilt University Medical Center, Nashville, TN 37203, United States.
  • School of Biomedical Informatics, University of Texas Health Science Center, Houston, TX 77030, United States.
  • Department of Pediatrics, Vanderbilt University Medical Center, Nashville, TN 37203, United States.
  • Department of Pathology, Microbiology and Immunology, Vanderbilt University Medical Center, Nashville, TN 37203, United States.

ORCID-Profile: Allison B McCoy, Dean F Sittig, Scott D Nelson, Adam Wright

Förderung

  • NLM NIH HHS
  • NIA NIH HHS
  • NIH HHS
  • NIH

Zitieren

APA

Liu, S., McCoy, A. B., Peterson, J. F., Lasko, T. A., Sittig, D. F., Nelson, S. D., Andrews, J., Patterson, L., Cobb, C. M., Mulherin, D., Morton, C. T., & Wright, A. (2024). Leveraging explainable artificial intelligence to optimize clinical decision support. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocae019

Vancouver

Liu S, McCoy AB, Peterson JF, Lasko TA, Sittig DF, Nelson SD, et al. Leveraging explainable artificial intelligence to optimize clinical decision support. Journal of the American Medical Informatics Association. 2024. doi:10.1093/jamia/ocae019

BibTeX
@article{Liu2024,
  author = {Liu, Siru and McCoy, Allison B and Peterson, Josh F and Lasko, Thomas A and Sittig, Dean F and Nelson, Scott D and Andrews, Jennifer and Patterson, Lorraine and Cobb, Cheryl M and Mulherin, David and Morton, Colleen T and Wright, Adam},
  title = {Leveraging explainable artificial intelligence to optimize clinical decision support},
  journal = {Journal of the American Medical Informatics Association},
  year = {2024},
  doi = {10.1093/jamia/ocae019}
}
Kostenlos starten →