EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Demonstrating the False-Positive Paradox in Radiology with Artificial Intelligence: Estimating Clinically Anticipated PPV, FDR, NPV, and FOR of FDA-Cleared Devices Using Performance Metrics from 510(k) Summaries and Prevalences from Local and Published Data

Erin Sparnon, Kelvin Stevens, Elizabeth C Song, Robert J Harris, Benjamin W Strong, Michael A Bruno, Woojin Kim, Christoph Wald, Grayson L Baird

Journal of Imaging Informatics in Medicine · 09.11.2026

DOI: 10.1007/s10278-026-02488-9 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Imaging Informatics in Medicine, online erschienen am 09.11.2026. Verfasst von Erin Sparnon und 8 weiteren Autor:innen. Beteiligte Einrichtung: SEI (Systems Evolution, Inc.), Philadelphia, USA. Die Arbeit nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The false-positive paradox (FPP) describes the counterintuitive phenomenon whereby a test can achieve high sensitivity and specificity yet still produce mostly false-positive results when applied to low-prevalence populations. This phenomenon is particularly relevant to radiology artificial intelligence (AI), where devices are typically marketed and cleared using diagnostic accuracy metrics such as sensitivity, specificity, and area under the receiver operating characteristic curve (ROC-AUC). However, these metrics do not indicate the proportion of false-positive and false-negative outputs clinicians should expect in local practice. This study estimated the positive predictive value (PPV), false discovery rate (FDR), negative predictive value (NPV), and false omission rate (FOR) for recent Food and Drug Administration (FDA)-cleared radiology AI devices by combining publicly reported 510(k) sensitivity and specificity with local or literature-derived prevalence estimates. Public FDA summaries for 38 radiology AI devices authorized in 2024 or 2025 were reviewed, yielding 57 target pathology entries. Median reported sensitivity, specificity, and ROC-AUC exceeded 90%; nevertheless, clinically anticipated FDRs were often high. For example, a large vessel occlusion detector with 90.6% sensitivity and 88.8% specificity was estimated to have a PPV of 29.3% and an FDR of 70.7% at a prevalence of 4.87%, meaning most positive AI alerts would be false positives. These findings do not evaluate device performance but instead illustrate the FPP in radiology AI. Public 510(k) summaries should consistently report sensitivity, specificity, and test set prevalence so that radiologists and other stakeholders can estimate PPV, FDR, NPV, and FOR for their own patient populations before implementation.

Schlagwörter

Stichwörter der Autor:innen

510(k)AIAccuracy paradoxAnd False omission rateArtificial intelligenceFalse discovery rateFalse-positive paradoxNegative predictive valuePositive predictive valueRadiology

Autor:innen und Institutionen

  • SEI (Systems Evolution, Inc.), Philadelphia, USA.
  • Faculty of Medicine, University of Freiburg, Freiburg im Breisgau, Germany.
  • The Warren Alpert Medical School, Brown University, Providence, USA.
  • vRad® (Virtual Radiologic), Edina, USA.
  • Department of Radiology, Penn State Milton S. Hershey Medical Center, Hershey, USA.
  • American College of Radiology Data Science Institute, Reston, VA, USA.

Zitieren

APA

Sparnon, E., Stevens, K., Song, E. C., Harris, R. J., Strong, B. W., Bruno, M. A., Kim, W., Wald, C., & Baird, G. L. (2026). Demonstrating the False-Positive Paradox in Radiology with Artificial Intelligence: Estimating Clinically Anticipated PPV, FDR, NPV, and FOR of FDA-Cleared Devices Using Performance Metrics from 510(k) Summaries and Prevalences from Local and Published Data. Journal of Imaging Informatics in Medicine. https://doi.org/10.1007/s10278-026-02488-9

Vancouver

Sparnon E, Stevens K, Song EC, Harris RJ, Strong BW, Bruno MA, et al. Demonstrating the False-Positive Paradox in Radiology with Artificial Intelligence: Estimating Clinically Anticipated PPV, FDR, NPV, and FOR of FDA-Cleared Devices Using Performance Metrics from 510(k) Summaries and Prevalences from Local and Published Data. Journal of Imaging Informatics in Medicine. 2026. doi:10.1007/s10278-026-02488-9

BibTeX
@article{Sparnon2026,
  author = {Sparnon, Erin and Stevens, Kelvin and Song, Elizabeth C and Harris, Robert J and Strong, Benjamin W and Bruno, Michael A and Kim, Woojin and Wald, Christoph and Baird, Grayson L},
  title = {Demonstrating the False-Positive Paradox in Radiology with Artificial Intelligence: Estimating Clinically Anticipated PPV, FDR, NPV, and FOR of FDA-Cleared Devices Using Performance Metrics from 510(k) Summaries and Prevalences from Local and Published Data},
  journal = {Journal of Imaging Informatics in Medicine},
  year = {2026},
  doi = {10.1007/s10278-026-02488-9}
}
Kostenlos starten →