EUVIMEDEUVIMED entdecken
Open Access

Generalizability of FDA-Approved AI-Enabled Medical Devices for Clinical Use

Daniel Windecker, Giovanni Baj, Isaac Shiri, Pooya Mohammadi Kazaj, Johannes Kaesmacher, Christoph Gräni, George C M Siontis

JAMA Network Open · 30.04.2025 · 8 (4) · e258052

DOI: 10.1001/jamanetworkopen.2025.8052 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JAMA Network Open, online erschienen am 30.04.2025. Verfasst von Daniel Windecker und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Diagnostic and Interventional Neuroradiology, University of Bern, Bern, Switzerland. Hauptthemen laut MEDLINE: Artificial Intelligence, Device Approval, Equipment and Supplies. Die Arbeit wurde bisher 115-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Importance The primary objective of any newly developed medical device using artificial intelligence (AI) is to ensure its safe and effective use in broader clinical practice.

Objective

To evaluate key characteristics of AI-enabled medical devices approved by the US Food and Drug Administration (FDA) that are relevant to their clinical generalizability and are reported in the public domain. Design, Setting, and Participants This cross-sectional study collected information on all AI-enabled medical devices that received FDA approval and were listed on the FDA website as of August 31, 2024. Main Outcomes and Measures For each AI-enabled medical device, detailed information and key characteristics relevant for the generalizability of the devices at the time of approval were summarized, specifically examining clinical evaluation aspects, such as the presence and design of clinical performance studies, availability of discriminatory performance metrics, and age- and sex-specific data.

Results

In total, 903 FDA-approved AI-enabled medical devices were analyzed, most of which became available in the last decade. The devices primarily related to the specialties of radiology (692 devices [76.6.%]), cardiovascular medicine (91 devices [10.1%]), and neurology (29 devices [3.2%]). Most devices were software only (664 devices [73.5%]), and only 6 devices (0.7%) were implantable. Detailed descriptions of development were absent from most publicly provided summaries. Clinical performance studies were reported for 505 devices (55.9%), while 218 devices (24.1%) explicitly stated no performance studies were conducted. Retrospective study designs were most common (193 studies [38.2%]), with only 41 studies (8.1%) being prospective and 12 studies (2.4%) randomized. Discriminatory performance metrics were reported in 200 of the available summaries (sensitivity: 183 devices [36.2%]; specificity: 176 devices [34.9%]; area under the curve: 82 devices [16.2%]). Among clinical studies, less than one-third provided sex-specific data (145 studies [28.7%]), and only 117 studies (23.2%) addressed age-related subgroups. Conclusions and Relevance In this cross-sectional study, clinical performance studies at the time of approval were reported for approximately half of AI-enabled medical devices, yet the information was often insufficient for a comprehensive assessment of their clinical generalizability, emphasizing the need for ongoing monitoring and regular re-evaluation to identify and address unexpected performance changes during broader use.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceDevice ApprovalEquipment and SuppliesUnited StatesHumansCross-Sectional StudiesUnited States Food and Drug AdministrationMaleFemale

Autor:innen und Institutionen

  • Department of Diagnostic and Interventional Neuroradiology, University of Bern, Bern, Switzerland.
  • Department of Cardiology, Bern University Hospital, Inselspital, University of Bern, Bern, Switzerland.
  • Diagnostic and Interventional Neuroradiology, CIC-IT 1415, CHRU de Tours, Tours, France.
  • Le Studium Loire Valley Institute for Advanced Studies, Orléans, France.

Zitieren

APA

Windecker, D., Baj, G., Shiri, I., Kazaj, P. M., Kaesmacher, J., Gräni, C., & Siontis, G. C. M. (2025). Generalizability of FDA-Approved AI-Enabled Medical Devices for Clinical Use. JAMA Network Open, 8(4), e258052. https://doi.org/10.1001/jamanetworkopen.2025.8052

Vancouver

Windecker D, Baj G, Shiri I, Kazaj PM, Kaesmacher J, Gräni C, et al. Generalizability of FDA-Approved AI-Enabled Medical Devices for Clinical Use. JAMA Network Open. 2025;8(4):e258052. doi:10.1001/jamanetworkopen.2025.8052

BibTeX
@article{Windecker2025,
  author = {Windecker, Daniel and Baj, Giovanni and Shiri, Isaac and Kazaj, Pooya Mohammadi and Kaesmacher, Johannes and Gräni, Christoph and Siontis, George C M},
  title = {Generalizability of FDA-Approved AI-Enabled Medical Devices for Clinical Use},
  journal = {JAMA Network Open},
  year = {2025},
  volume = {8},
  number = {4},
  pages = {e258052},
  doi = {10.1001/jamanetworkopen.2025.8052}
}
Kostenlos starten →