Frameworks for procurement, integration, monitoring, and evaluation of artificial intelligence tools in clinical settings: A systematic review
Frameworks für Beschaffung, Integration, Monitoring und Evaluation von KI-Tools in klinischen Settings: systematische Übersichtsarbeit
PLOS Digital Health · 29.05.2024 · 3 (5) · e0000514
DOI: 10.1371/journal.pdig.0000514 ↗Auf einen Blick
Die Übersichtsarbeit fasst 25 Artikel zu Frameworks für die Beschaffung, Integration, Überwachung und Bewertung von KI-Tools in der klinischen Praxis zusammen. Häufig genannte Themen waren Transparenz und die Einbindung in bestehende Arbeitsabläufe.
Fragestellung
Welche Frameworks empfehlen Vorgehen zur Beschaffung, Integration, Überwachung und Bewertung von KI-Tools in der klinischen Praxis?
Methode
Systematische Übersichtsarbeit nach PRISMA; Literaturrecherche in MEDLINE, Wiley Cochrane, Scopus und EBSCO; Einordnung in Donabedian sowie Plan-Do-Study-Act.
Ergebnisse
17.537 eindeutige Artikel identifiziert, 47 im Volltext geprüft, 25 in die Übersicht eingeschlossen. Häufigster Bereich war Plan (84 %, n = 21), gefolgt von Study (60 %, n = 15), Do (52 %, n = 13) und Act (24 %, n = 6).
Einschränkungen
Niedriges Evidenzniveau für Integration in den Do- und Act-Domänen wird als Herausforderung genannt.
Schlussfolgerung der Autor:innen
Die Autor:innen sehen einen Bedarf an mehr Datenteilung und Wissensübersetzung, um gemeinsame Ziele zu unterstützen und den klinischen Nutzen zu erhöhen.
Kernaussagen
- 25 Artikel zu Frameworks für KI in der klinischen Praxis
- Plan war die häufigste PDSA-Domäne (84 %, n = 21)
- Integration in Do- und Act-Domänen bleibt laut Autor:innen schwierig
Deutsche Zusammenfassung: KI-gestützt aus dem Original-Abstract erstellt; alle Zahlen wurden automatisch mit dem Original abgeglichen. Maßgeblich ist der Original-Abstract.
Kurz gefasst
Systematische Übersicht in der Zeitschrift PLOS Digital Health, online erschienen am 29.05.2024. Verfasst von Sarim Dawar Khan und 14 weiteren Autor:innen. Beteiligte Einrichtung: CITRIC Health Data Science Centre, Department of Medicine, Aga Khan University, Karachi, Pakistan. Die Arbeit wurde bisher 36-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Patrick J. McGovern Foundation.
Abstract (Originalsprache)
Research on the applications of artificial intelligence (AI) tools in medicine has increased exponentially over the last few years but its implementation in clinical practice has not seen a commensurate increase with a lack of consensus on implementing and maintaining such tools. This systematic review aims to summarize frameworks focusing on procuring, implementing, monitoring, and evaluating AI tools in clinical practice. A comprehensive literature search, following PRSIMA guidelines was performed on MEDLINE, Wiley Cochrane, Scopus, and EBSCO databases, to identify and include articles recommending practices, frameworks or guidelines for AI procurement, integration, monitoring, and evaluation. From the included articles, data regarding study aim, use of a framework, rationale of the framework, details regarding AI implementation involving procurement, integration, monitoring, and evaluation were extracted. The extracted details were then mapped on to the Donabedian Plan, Do, Study, Act cycle domains. The search yielded 17,537 unique articles, out of which 47 were evaluated for inclusion based on their full texts and 25 articles were included in the review. Common themes extracted included transparency, feasibility of operation within existing workflows, integrating into existing workflows, validation of the tool using predefined performance indicators and improving the algorithm and/or adjusting the tool to improve performance. Among the four domains (Plan, Do, Study, Act) the most common domain was Plan (84%, n = 21), followed by Study (60%, n = 15), Do (52%, n = 13), & Act (24%, n = 6). Among 172 authors, only 1 (0.6%) was from a low-income country (LIC) and 2 (1.2%) were from lower-middle-income countries (LMICs). Healthcare professionals cite the implementation of AI tools within clinical settings as challenging owing to low levels of evidence focusing on integration in the Do and Act domains. The current healthcare AI landscape calls for increased data sharing and knowledge translation to facilitate common goals and reap maximum clinical benefit.
Autor:innen und Institutionen
- CITRIC Health Data Science Centre, Department of Medicine, Aga Khan University, Karachi, Pakistan.
- Department of Paediatrics and Child Health, Aga Khan University, Karachi, Pakistan.
- Duke Institute for Health Innovation, Duke University School of Medicine, Durham, North Carolina, United States.
- Population Health Science Institute, Newcastle University, Newcastle upon Tyne, United Kingdom.
- Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, United Kingdom.
- Moorfields Eye Hospital NHS Foundation Trust, London, United Kingdom.
ORCID-Profile: Mohummad Hassan Raza Raja, Jee Young Kim, Mark P Sendak
Förderung
- Patrick J. McGovern Foundation
Zitieren
APA
Khan, S. D., Hoodbhoy, Z., Raja, M. H. R., Kim, J. Y., Hogg, H. D. J., Manji, A. A. A., Gulamali, F., Hasan, A., Shaikh, A., Tajuddin, S., Khan, N. S., Patel, M. R., Balu, S., Samad, Z., & Sendak, M. P. (2024). Frameworks for procurement, integration, monitoring, and evaluation of artificial intelligence tools in clinical settings: A systematic review. PLOS Digital Health, 3(5), e0000514. https://doi.org/10.1371/journal.pdig.0000514
Vancouver
Khan SD, Hoodbhoy Z, Raja MHR, Kim JY, Hogg HDJ, Manji AAA, et al. Frameworks for procurement, integration, monitoring, and evaluation of artificial intelligence tools in clinical settings: A systematic review. PLOS Digital Health. 2024;3(5):e0000514. doi:10.1371/journal.pdig.0000514
BibTeX
@article{Khan2024,
author = {Khan, Sarim Dawar and Hoodbhoy, Zahra and Raja, Mohummad Hassan Raza and Kim, Jee Young and Hogg, Henry David Jeffry and Manji, Afshan Anwar Ali and Gulamali, Freya and Hasan, Alifia and Shaikh, Asim and Tajuddin, Salma and Khan, Nida Saddaf and Patel, Manesh R and Balu, Suresh and Samad, Zainab and Sendak, Mark P},
title = {Frameworks for procurement, integration, monitoring, and evaluation of artificial intelligence tools in clinical settings: A systematic review},
journal = {PLOS Digital Health},
year = {2024},
volume = {3},
number = {5},
pages = {e0000514},
doi = {10.1371/journal.pdig.0000514}
}
EUVIMED