Prospective Evaluation of Artificial Intelligence Triage of Intracranial Hemorrhage on Noncontrast Head CT Examinations
American Journal of Roentgenology · 2024-11 · 223 (5)
DOI: 10.2214/ajr.24.31639 ↗Kurz gefasst
Fachartikel in der Zeitschrift American Journal of Roentgenology, 2024-11. Verfasst von Cody H Savage und 16 weiteren Autor:innen. Beteiligte Einrichtung: Department of Diagnostic Radiology & Nuclear Medicine, University of Maryland Medical Intelligent Imaging (UM2ii) Center, University of Maryland Scho…. Hauptthemen laut MEDLINE: Triage, Tomography, X-Ray Computed, Artificial Intelligence, Intracranial Hemorrhages. Die Arbeit wurde bisher 69-mal zitiert (Crossref) und nennt 20 Literaturangaben.
Abstract (Originalsprache)
BACKGROUND. Retrospective studies evaluating artificial intelligence (AI) algorithms for intracranial hemorrhage (ICH) detection on noncontrast CT (NCCT) have shown promising results but lack prospective validation. OBJECTIVE. The purpose of this article was to evaluate the impact on radiologists' real-world aggregate performance for ICH detection and report turnaround times for ICH-positive examinations of a radiology department's implementation of an AI triage and notification system for ICH detection on head NCCT examinations. METHODS. This prospective single-center study included adult patients who underwent head NCCT examinations from May 12, 2021, to June 30, 2021 (phase 1), or from September 30, 2021, to December 4, 2021 (phase 2). Before phase 1, the radiology department implemented a commercial AI triage system for ICH detection that processed head NCCT examinations and notified radiologists of positive results through a widget with a floating pop-up display. Examinations were interpreted by neuroradiologists or emergency radiologists, who evaluated examinations without and with AI assistance in phases 1 and 2, respectively. A panel of radiologists conducted a review process for all examinations with discordance between the radiology report and AI and a subset of remaining examinations to establish the reference standard. Diagnostic performance and report turnaround times were compared using the Pearson chi-square test and Wilcoxon rank sum test, respectively. Bonferroni correction was used to account for five diagnostic performance metrics (adjusted significance threshold, .01 [α = .05/5]). RESULTS. A total of 9954 examinations from 7371 patients (mean age, 54.8 ± 19.8 [SD] years; 3773 women, 3598 men) were included. In phases 1 and 2, 19.8% (735/3716) and 21.9% (1368/6238) of examinations, respectively, were positive for ICH (p = .01). Radiologists without versus with AI showed no significant difference in accuracy (99.5% vs 99.2%), sensitivity (98.6% vs 98.9%), PPV (99.0% vs 97.5%), or NPV (99.7% vs 99.7%) (all p > .01); specificity was higher for radiologists without than with AI (99.8% vs 99.3%, respectively, p = .004). Mean report turnaround time for ICH-positive examinations was 147.1 minutes without AI versus 149.9 minutes with AI (p = .11). CONCLUSION. An AI triage system for ICH detection did not improve radiologists' diagnostic performance or report turnaround times. CLINICAL IMPACT. This large prospective real-world study does not support use of AI assistance for ICH detection.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Diagnostic Radiology & Nuclear Medicine, University of Maryland Medical Intelligent Imaging (UM2ii) Center, University of Maryland School of Medicine, Baltimore, MD.
- Department of Radiology, University of Alabama at Birmingham Heersink School of Medicine, Birmingham, AL.
- Department of Radiology, St. Jude Children's Research Hospital, 262 Danny Thomas Pl, Memphis, TN 38105-3678.
Zitieren
APA
Savage, C. H., Tanwar, M., Elkassem, A. A., Sturdivant, A., Hamki, O., Sotoudeh, H., Sirineni, G., Singhal, A., Milner, D., Jones, J., Rehder, D., Li, M., Li, Y., Junck, K., Tridandapani, S., Rothenberg, S. A., & Smith, A. D. (2024). Prospective Evaluation of Artificial Intelligence Triage of Intracranial Hemorrhage on Noncontrast Head CT Examinations. American Journal of Roentgenology, 223(5). https://doi.org/10.2214/ajr.24.31639
Vancouver
Savage CH, Tanwar M, Elkassem AA, Sturdivant A, Hamki O, Sotoudeh H, et al. Prospective Evaluation of Artificial Intelligence Triage of Intracranial Hemorrhage on Noncontrast Head CT Examinations. American Journal of Roentgenology. 2024;223(5). doi:10.2214/ajr.24.31639
BibTeX
@article{Savage2024,
author = {Savage, Cody H and Tanwar, Manoj and Elkassem, Asser Abou and Sturdivant, Adam and Hamki, Omar and Sotoudeh, Houman and Sirineni, Gopi and Singhal, Aparna and Milner, Desmin and Jones, Jesse and Rehder, Dirk and Li, Mei and Li, Yufeng and Junck, Kevin and Tridandapani, Srini and Rothenberg, Steven A and Smith, Andrew D},
title = {Prospective Evaluation of Artificial Intelligence Triage of Intracranial Hemorrhage on Noncontrast Head CT Examinations},
journal = {American Journal of Roentgenology},
year = {2024},
volume = {223},
number = {5},
doi = {10.2214/ajr.24.31639}
}
EUVIMED