Toward a responsible future: recommendations for AI-enabled clinical decision support
Journal of the American Medical Informatics Association · 01.11.2024 · 31 (11) · 2730-2739
DOI: 10.1093/jamia/ocae209 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of the American Medical Informatics Association, online erschienen am 26.09.2024. Verfasst von Steven Labkoff und 26 weiteren Autor:innen. Beteiligte Einrichtung: Quantori, Boston, MA 02142, United States. Hauptthemen laut MEDLINE: Decision Support Systems, Clinical, Artificial Intelligence. Die Arbeit wurde bisher 273-mal zitiert (Crossref) und nennt 68 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: NIDA NIH HHS.
Abstract (Originalsprache)
Background
Integrating artificial intelligence (AI) in healthcare settings has the potential to benefit clinical decision-making. Addressing challenges such as ensuring trustworthiness, mitigating bias, and maintaining safety is paramount. The lack of established methodologies for pre- and post-deployment evaluation of AI tools regarding crucial attributes such as transparency, performance monitoring, and adverse event reporting makes this situation challenging.
Objectives
This paper aims to make practical suggestions for creating methods, rules, and guidelines to ensure that the development, testing, supervision, and use of AI in clinical decision support (CDS) systems are done well and safely for patients. Materials and Methods In May 2023, the Division of Clinical Informatics at Beth Israel Deaconess Medical Center and the American Medical Informatics Association co-sponsored a working group on AI in healthcare. In August 2023, there were 4 webinars on AI topics and a 2-day workshop in September 2023 for consensus-building. The event included over 200 industry stakeholders, including clinicians, software developers, academics, ethicists, attorneys, government policy experts, scientists, and patients. The goal was to identify challenges associated with the trusted use of AI-enabled CDS in medical practice. Key issues were identified, and solutions were proposed through qualitative analysis and a 4-month iterative consensus process.
Results
Our work culminated in several key recommendations: (1) building safe and trustworthy systems; (2) developing validation, verification, and certification processes for AI-CDS systems; (3) providing a means of safety monitoring and reporting at the national level; and (4) ensuring that appropriate documentation and end-user training are provided.
Discussion
AI-enabled Clinical Decision Support (AI-CDS) systems promise to revolutionize healthcare decision-making, necessitating a comprehensive framework for their development, implementation, and regulation that emphasizes trustworthiness, transparency, and safety. This framework encompasses various aspects including model training, explainability, validation, certification, monitoring, and continuous evaluation, while also addressing challenges such as data privacy, fairness, and the need for regulatory oversight to ensure responsible integration of AI into clinical workflow.
Conclusions
Achieving responsible AI-CDS systems requires a collective effort from many healthcare stakeholders. This involves implementing robust safety, monitoring, and transparency measures while fostering innovation. Future steps include testing and piloting proposed trust mechanisms, such as safety reporting protocols, and establishing best practice guidelines.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Quantori, Boston, MA 02142, United States.
- Division of Clinical Informatics, Department of Medicine, Beth Israel Deaconess Medical Center, Boston, MA 02215, United States.
- UnitedHealth Group, Minnetonka, MN, United States.
- Division of General Internal Medicine, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, NY 10029, United States.
- Research Institute, Endeavor Health, Evanston, IL 60035, United States.
- Department of Biomedical Informatics, Vanderbilt University, Nashville, TN, United States.
ORCID-Profile: Steven Labkoff, Bilikis Oladimeji, Joseph Kannry, Anthony Solomonides, Russell Leftwich, Eileen Koski, Amanda L Joseph, Monica Lopez-Gonzalez, Lee A Fleisher, Kimberly Nolen, Sayon Dutta, Deborah R Levy, Amy Price, Paul J Barr, Jonathan D Hron, Baihan Lin, Gyana Srivastava, Nuria Pastor, Unai Sanchez Luque, Tien Thi Thuy Bui, Reva Singh, Tayler Williams, Mark G Weiner, Tristan Naumann, Dean F Sittig, Gretchen Purcell Jackson, Yuri Quintana
Förderung
- NIDA NIH HHS
Zitieren
APA
Labkoff, S., Oladimeji, B., Kannry, J., Solomonides, A., Leftwich, R., Koski, E., Joseph, A. L., Lopez-Gonzalez, M., Fleisher, L. A., Nolen, K., Dutta, S., Levy, D. R., Price, A., Barr, P. J., Hron, J. D., Lin, B., Srivastava, G., Pastor, N., Luque, U. S., …, & Quintana, Y. (2024). Toward a responsible future: recommendations for AI-enabled clinical decision support. Journal of the American Medical Informatics Association, 31(11), 2730-2739. https://doi.org/10.1093/jamia/ocae209
Vancouver
Labkoff S, Oladimeji B, Kannry J, Solomonides A, Leftwich R, Koski E, et al. Toward a responsible future: recommendations for AI-enabled clinical decision support. Journal of the American Medical Informatics Association. 2024;31(11):2730-2739. doi:10.1093/jamia/ocae209
BibTeX
@article{Labkoff2024,
author = {Labkoff, Steven and Oladimeji, Bilikis and Kannry, Joseph and Solomonides, Anthony and Leftwich, Russell and Koski, Eileen and Joseph, Amanda L and Lopez-Gonzalez, Monica and Fleisher, Lee A and Nolen, Kimberly and Dutta, Sayon and Levy, Deborah R and Price, Amy and Barr, Paul J and Hron, Jonathan D and Lin, Baihan and Srivastava, Gyana and Pastor, Nuria and Luque, Unai Sanchez and Bui, Tien Thi Thuy and Singh, Reva and Williams, Tayler and Weiner, Mark G and Naumann, Tristan and Sittig, Dean F and Jackson, Gretchen Purcell and Quintana, Yuri},
title = {Toward a responsible future: recommendations for AI-enabled clinical decision support},
journal = {Journal of the American Medical Informatics Association},
year = {2024},
volume = {31},
number = {11},
pages = {2730--2739},
doi = {10.1093/jamia/ocae209}
}
EUVIMED