EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Accuracy of an artificial intelligence-enabled diagnostic assistance device in recognizing normal chest radiographs: a service evaluation

Amrita Kumar, Puja Patel, Dennis Robert iD, Shamie Kumar, Aneesh Khetani, Bhargava Reddy, Anumeha Srivastava

BJR|Open · 12.12.2023 · 6 (1)

DOI: 10.1093/bjro/tzae029 ↗

Kurz gefasst

Fachartikel in der Zeitschrift BJR|Open, online erschienen am 14.09.2024. Verfasst von Amrita Kumar und 6 weiteren Autor:innen. Beteiligte Einrichtung: Frimley Health NHS Foundation Trust, Frimley, United Kingdom. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Qure.ai.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objectives

Artificial intelligence (AI) enabled devices may be able to optimize radiologists’ productivity by identifying normal and abnormal chest X-rays (CXRs) for triaging. In this service evaluation, we investigated the accuracy of one such AI device (qXR).

Methods

A randomly sampled subset of general practice and outpatient-referred frontal CXRs from a National Health Service Trust was collected retrospectively from examinations conducted during November 2022 to January 2023. Ground truth was established by consensus between 2 radiologists. The main objective was to estimate negative predictive value (NPV) of AI.

Results

A total of 522 CXRs (458 [87.74%] normal CXRs) from 522 patients (median age, 64 years [IQR, 49-77]; 305 [58.43%] female) were analysed. AI predicted 348 CXRs as normal, of which 346 were truly normal (NPV: 99.43% [95% CI, 97.94-99.93]). The sensitivity, specificity, positive predictive value, and area under the ROC curve of AI were found to be 96.88% (95% CI, 89.16-99.62), 75.55% (95% CI, 71.34-79.42), 35.63% (95% CI, 28.53-43.23), and 91.92% (95% CI, 89.38-94.45), respectively. A sensitivity analysis was conducted to estimate NPV by varying assumptions of the prevalence of normal CXRs. The NPV ranged from 88.96% to 99.54% as prevalence increased.

Conclusions

The AI device recognized normal CXRs with high NPV and has the potential to increase radiologists’ productivity. Advances in knowledge There is a need for more evidence on the utility of AI-enabled devices in identifying normal CXRs. This work adds to such limited evidence and enables researchers to plan studies to further evaluate the impact of such devices.

Schlagwörter

Stichwörter der Autor:innen

artificial intelligenceautonormal chest X-ray reportingchest X-raycomputer-assisted diagnosisradiology

Autor:innen und Institutionen

  • Frimley Health NHS Foundation Trust, Frimley, United Kingdom.
  • Qure.ai, Bangalore, India.
  • Qure.ai, London, United Kingdom.
  • Qure.ai, Mumbai, India.

ORCID-Profile: Dennis Robert

Förderung

  • Qure.ai

Zitieren

APA

Kumar, A., Patel, P., Robert, D., Kumar, S., Khetani, A., Reddy, B., & Srivastava, A. (2023). Accuracy of an artificial intelligence-enabled diagnostic assistance device in recognizing normal chest radiographs: a service evaluation. BJR|Open, 6(1). https://doi.org/10.1093/bjro/tzae029

Vancouver

Kumar A, Patel P, Robert D, Kumar S, Khetani A, Reddy B, et al. Accuracy of an artificial intelligence-enabled diagnostic assistance device in recognizing normal chest radiographs: a service evaluation. BJR|Open. 2023;6(1). doi:10.1093/bjro/tzae029

BibTeX
@article{Kumar2023,
  author = {Kumar, Amrita and Patel, Puja and Robert, Dennis and Kumar, Shamie and Khetani, Aneesh and Reddy, Bhargava and Srivastava, Anumeha},
  title = {Accuracy of an artificial intelligence-enabled diagnostic assistance device in recognizing normal chest radiographs: a service evaluation},
  journal = {BJR|Open},
  year = {2023},
  volume = {6},
  number = {1},
  doi = {10.1093/bjro/tzae029}
}
Kostenlos starten →