EUVIMEDEUVIMED entdecken
Systematische ÜbersichtOpen Access · CC BY 4.0

Software with artificial intelligence-derived algorithms for analysing CT brain scans in people with a suspected acute stroke: a systematic review and cost-effectiveness analysis

Software mit aus künstlicher Intelligenz abgeleiteten Algorithmen zur Analyse von CT-Gehirnscans bei Verdacht auf akuten Schlaganfall: systematische Übersichtsarbeit und Kosten-Nutzen-Analyse

Marie Westwood iD, Bram Ramaekers iD, Sabine Grimm iD, Nigel Armstrong iD, Ben Wijnen iD, Charlotte Ahmadu iD, Shelley de Kock iD, Caro Noake iD, Manuela Joore iD

Health Technology Assessment · 2024-03 · 1-204

DOI: 10.3310/rdpa1487 ↗

Auf einen Blick

Die Übersichtsarbeit bewertete den klinischen und ökonomischen Nutzen von KI-Software zur Unterstützung der CT-Gehirnscan-Befundung bei akutem Schlaganfall. Die verfügbare Evidenz reichte für keine sichere Aussage zur klinischen Wirksamkeit.

Fragestellung

Wie klinisch und kosteneffektiv ist KI-Software zur Unterstützung der Befundung von CT-Gehirnscans bei akutem Schlaganfall im NHS-Setting?

Methode

Systematische Übersichtsarbeit und Kosten-Nutzen-Analyse; 25 Datenbanken bis Juli 2021; ökonomisches Modell zu CT-Angiografie bei ischämischem Schlaganfall mit Verdacht auf Large-Vessel-Occlusion.

Ergebnisse

22 Studien (30 Publikationen) eingeschlossen; 18/22 zu CT-Angiografie und Large-Vessel-Occlusion. Für einzelne Systeme lagen Sensitivität und Spezifität zwischen 83,8 % und 98,1 % sowie 79,4 % und 98,2 %.

Einschränkungen

Keine Studie entsprach exakt den Einschlusskriterien; die Evidenz war nicht geeignet, die klinische Wirksamkeit zu bestimmen.

Schlussfolgerung der Autor:innen

Die verfügbare Evidenz genügt nicht, um die klinische Wirksamkeit von KI-Software zur Unterstützung der CT-Befundung bei akutem Schlaganfall zu bestimmen. Die ökonomischen Analysen bevorzugten die KI-Strategie gegenüber der aktuellen Praxis nicht.

Kernaussagen

  • 22 Studien (30 Publikationen) eingeschlossen
  • Keine Studie entsprach exakt den Einschlusskriterien
  • Mehrkosten von £8.61 bei einem QALY-Gewinn von 0.003

Deutsche Zusammenfassung: KI-gestützt aus dem Original-Abstract erstellt; alle Zahlen wurden automatisch mit dem Original abgeglichen. Maßgeblich ist der Original-Abstract.

Kurz gefasst

Systematische Übersicht in der Zeitschrift Health Technology Assessment, 2024-03. Verfasst von Marie Westwood und 8 weiteren Autor:innen. Beteiligte Einrichtung: Kleijnen Systematic Reviews (KSR) Ltd, York, UK. Hauptthemen laut MEDLINE: Cost-Benefit Analysis, Artificial Intelligence, Tomography, X-Ray Computed, Quality-Adjusted Life Years. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 235 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Health Technology Assessment programme.

Auf einen BlickAbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Artificial intelligence-derived software technologies have been developed that are intended to facilitate the review of computed tomography brain scans in patients with suspected stroke.

Objectives

To evaluate the clinical and cost-effectiveness of using artificial intelligence-derived software to support review of computed tomography brain scans in acute stroke in the National Health Service setting.

Methods

Twenty-five databases were searched to July 2021. The review process included measures to minimise error and bias. Results were summarised by research question, artificial intelligence-derived software technology and study type. The health economic analysis focused on the addition of artificial intelligence-derived software-assisted review of computed tomography angiography brain scans for guiding mechanical thrombectomy treatment decisions for people with an ischaemic stroke. The de novo model (developed in R Shiny, R Foundation for Statistical Computing, Vienna, Austria) consisted of a decision tree (short-term) and a state transition model (long-term) to calculate the mean expected costs and quality-adjusted life-years for people with ischaemic stroke and suspected large-vessel occlusion comparing artificial intelligence-derived software-assisted review to usual care.

Results

A total of 22 studies (30 publications) were included in the review; 18/22 studies concerned artificial intelligence-derived software for the interpretation of computed tomography angiography to detect large-vessel occlusion. No study evaluated an artificial intelligence-derived software technology used as specified in the inclusion criteria for this assessment. For artificial intelligence-derived software technology alone, sensitivity and specificity estimates for proximal anterior circulation large-vessel occlusion were 95.4% (95% confidence interval 92.7% to 97.1%) and 79.4% (95% confidence interval 75.8% to 82.6%) for Rapid (iSchemaView, Menlo Park, CA, USA) computed tomography angiography, 91.2% (95% confidence interval 77.0% to 97.0%) and 85.0 (95% confidence interval 64.0% to 94.8%) for Viz LVO (Viz.ai, Inc., San Fransisco, VA, USA) large-vessel occlusion, 83.8% (95% confidence interval 77.3% to 88.7%) and 95.7% (95% confidence interval 91.0% to 98.0%) for Brainomix (Brainomix Ltd, Oxford, UK) e-computed tomography angiography and 98.1% (95% confidence interval 94.5% to 99.3%) and 98.2% (95% confidence interval 95.5% to 99.3%) for Avicenna CINA (Avicenna AI, La Ciotat, France) large-vessel occlusion, based on one study each. These studies were not considered appropriate to inform cost-effectiveness modelling but formed the basis by which the accuracy of artificial intelligence plus human reader could be elicited by expert opinion. Probabilistic analyses based on the expert elicitation to inform the sensitivity of the diagnostic pathway indicated that the addition of artificial intelligence to detect large-vessel occlusion is potentially more effective (quality-adjusted life-year gain of 0.003), more costly (increased costs of £8.61) and cost-effective for willingness-to-pay thresholds of £3380 per quality-adjusted life-year and higher. Limitations and conclusions The available evidence is not suitable to determine the clinical effectiveness of using artificial intelligence-derived software to support the review of computed tomography brain scans in acute stroke. The economic analyses did not provide evidence to prefer the artificial intelligence-derived software strategy over current clinical practice. However, results indicated that if the addition of artificial intelligence-derived software-assisted review for guiding mechanical thrombectomy treatment decisions increased the sensitivity of the diagnostic pathway (i.e. reduced the proportion of undetected large-vessel occlusions), this may be considered cost-effective. Future work Large, preferably multicentre, studies are needed (for all artificial intelligence-derived software technologies) that evaluate these technologies as they would be implemented in clinical practice. Study registration This study is registered as PROSPERO CRD42021269609. Funding This award was funded by the National Institute for Health and Care Research (NIHR) Evidence Synthesis programme (NIHR award ref: NIHR133836) and is published in full in Health Technology Assessment ; Vol. 28, No. 11. See the NIHR Funding and Awards website for further award information.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Cost-Benefit AnalysisArtificial IntelligenceTomography, X-Ray ComputedQuality-Adjusted Life YearsTechnology Assessment, BiomedicalStrokeHumansAlgorithmsSoftwareBrainComputed Tomography AngiographyCost-Effectiveness Analysis

Stichwörter der Autor:innen

ARTIFICIAL INTELLIGENCECOST-EFFECTIVENESS ANALYSISISCHEMIC STROKE DIAGNOSISLARGE VESSEL OCCLUSION DETECTIONMACHINE LEARNINGSYSTEMATIC REVIEW

Autor:innen und Institutionen

  • Kleijnen Systematic Reviews (KSR) Ltd, York, UK.
  • Department of Clinical Epidemiology and Medical Technology Assessment, Maastricht University Medical Centre (MUMC), Maastricht, Netherlands.

ORCID-Profile: Marie Westwood, Bram Ramaekers, Sabine Grimm, Nigel Armstrong, Ben Wijnen, Charlotte Ahmadu, Shelley de Kock, Caro Noake, Manuela Joore

Förderung

  • Health Technology Assessment programme

Zitieren

APA

Westwood, M., Ramaekers, B., Grimm, S., Armstrong, N., Wijnen, B., Ahmadu, C., de Kock, S., Noake, C., & Joore, M. (2024). Software with artificial intelligence-derived algorithms for analysing CT brain scans in people with a suspected acute stroke: a systematic review and cost-effectiveness analysis. Health Technology Assessment, 1-204. https://doi.org/10.3310/rdpa1487

Vancouver

Westwood M, Ramaekers B, Grimm S, Armstrong N, Wijnen B, Ahmadu C, et al. Software with artificial intelligence-derived algorithms for analysing CT brain scans in people with a suspected acute stroke: a systematic review and cost-effectiveness analysis. Health Technology Assessment. 2024:1-204. doi:10.3310/rdpa1487

BibTeX
@article{Westwood2024,
  author = {Westwood, Marie and Ramaekers, Bram and Grimm, Sabine and Armstrong, Nigel and Wijnen, Ben and Ahmadu, Charlotte and de Kock, Shelley and Noake, Caro and Joore, Manuela},
  title = {Software with artificial intelligence-derived algorithms for analysing CT brain scans in people with a suspected acute stroke: a systematic review and cost-effectiveness analysis},
  journal = {Health Technology Assessment},
  year = {2024},
  pages = {1--204},
  doi = {10.3310/rdpa1487}
}
Kostenlos starten →