Blinded, randomized trial of sonographer versus AI cardiac function assessment
Nature · 2023-04-20 · 616 (7957) · 520-524
DOI: 10.1038/s41586-023-05947-3 ↗At a glance
Vergleichsstudie in Nature, published online on 2023-04-05. Written by Bryan He and 15 co-authors. Institution: Department of Computer Science, Stanford University, Palo Alto, CA, USA. Major MEDLINE topics: Artificial Intelligence, Echocardiography, Heart Function Tests, Cardiologists. Cited 272 times so far (Crossref); 31 references. The full text is freely available (open access, CC BY 4.0). Funded by: NHLBI NIH HHS.
Abstract (original language)
Artificial intelligence (AI) has been developed for echocardiography 1–3 , although it has not yet been tested with blinding and randomization. Here we designed a blinded, randomized non-inferiority clinical trial (ClinicalTrials.gov ID: NCT05140642; no outside funding) of AI versus sonographer initial assessment of left ventricular ejection fraction (LVEF) to evaluate the impact of AI in the interpretation workflow. The primary end point was the change in the LVEF between initial AI or sonographer assessment and final cardiologist assessment, evaluated by the proportion of studies with substantial change (more than 5% change). From 3,769 echocardiographic studies screened, 274 studies were excluded owing to poor image quality. The proportion of studies substantially changed was 16.8% in the AI group and 27.2% in the sonographer group (difference of −10.4%, 95% confidence interval: −13.2% to −7.7%, P < 0.001 for non-inferiority, P < 0.001 for superiority). The mean absolute difference between final cardiologist assessment and independent previous cardiologist assessment was 6.29% in the AI group and 7.23% in the sonographer group (difference of −0.96%, 95% confidence interval: −1.34% to −0.54%, P < 0.001 for superiority). The AI-guided workflow saved time for both sonographers and cardiologists, and cardiologists were not able to distinguish between the initial assessments by AI versus the sonographer (blinding index of 0.088). For patients undergoing echocardiographic quantification of cardiac function, initial assessment of LVEF by AI was non-inferior to assessment by sonographers.
Subjects
MeSH terms (MEDLINE)
Authors and institutions
- Department of Computer Science, Stanford University, Palo Alto, CA, USA.
- Department of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
- Department of Medicine, Division of Cardiology, San Francisco VA, UCSF, San Francisco, CA, USA.
- Enterprise Information Services, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
- Department of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center, Los Angeles, CA, USA. susan.cheng@cshs.org.
- Department of Computer Science, Stanford University, Palo Alto, CA, USA. jamesz@stanford.edu.
Funding
- NHLBI NIH HHS
Cite
APA
He, B., Kwan, A. C., Cho, J. H., Yuan, N., Pollick, C., Shiota, T., Ebinger, J., Bello, N. A., Wei, J., Josan, K., Duffy, G., Jujjavarapu, M., Siegel, R., Cheng, S., Zou, J. Y., & Ouyang, D. (2023). Blinded, randomized trial of sonographer versus AI cardiac function assessment. Nature, 616(7957), 520-524. https://doi.org/10.1038/s41586-023-05947-3
Vancouver
He B, Kwan AC, Cho JH, Yuan N, Pollick C, Shiota T, et al. Blinded, randomized trial of sonographer versus AI cardiac function assessment. Nature. 2023;616(7957):520-524. doi:10.1038/s41586-023-05947-3
BibTeX
@article{He2023,
author = {He, Bryan and Kwan, Alan C and Cho, Jae Hyung and Yuan, Neal and Pollick, Charles and Shiota, Takahiro and Ebinger, Joseph and Bello, Natalie A and Wei, Janet and Josan, Kiranbir and Duffy, Grant and Jujjavarapu, Melvin and Siegel, Robert and Cheng, Susan and Zou, James Y and Ouyang, David},
title = {Blinded, randomized trial of sonographer versus AI cardiac function assessment},
journal = {Nature},
year = {2023},
volume = {616},
number = {7957},
pages = {520--524},
doi = {10.1038/s41586-023-05947-3}
}
EUVIMED