EUVIMEDEUVIMED entdecken
Open Access

A Competition, Benchmark, Code, and Data for Using Artificial Intelligence to Detect Lesions in Digital Breast Tomosynthesis

Nicholas Konz, Mateusz Buda, Hanxue Gu, Ashirbani Saha, Jichen Yang, Jakub Chledowski, Jungkyu Park, Jan Witowski, Krzysztof J Geras, Yoel Shoshan, Flora Gilboa-Solomon, Daniel Khapun und 22 weitere

JAMA Network Open · 2023

DOI: 10.1001/jamanetworkopen.2023.0524 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JAMA Network Open, 2023. Verfasst von Nicholas Konz und 33 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical and Computer Engineering, Duke University, Durham, North Carolina. Hauptthemen laut MEDLINE: Artificial Intelligence, Breast Neoplasms. Die Arbeit wurde bisher 32-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NIBIB NIH HHS, NCI NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Importance An accurate and robust artificial intelligence (AI) algorithm for detecting cancer in digital breast tomosynthesis (DBT) could significantly improve detection accuracy and reduce health care costs worldwide.

Objectives

To make training and evaluation data for the development of AI algorithms for DBT analysis available, to develop well-defined benchmarks, and to create publicly available code for existing methods. Design, Setting, and Participants This diagnostic study is based on a multi-institutional international grand challenge in which research teams developed algorithms to detect lesions in DBT. A data set of 22 032 reconstructed DBT volumes was made available to research teams. Phase 1, in which teams were provided 700 scans from the training set, 120 from the validation set, and 180 from the test set, took place from December 2020 to January 2021, and phase 2, in which teams were given the full data set, took place from May to July 2021. Main Outcomes and Measures The overall performance was evaluated by mean sensitivity for biopsied lesions using only DBT volumes with biopsied lesions; ties were broken by including all DBT volumes.

Results

A total of 8 teams participated in the challenge. The team with the highest mean sensitivity for biopsied lesions was the NYU B-Team, with 0.957 (95% CI, 0.924-0.984), and the second-place team, ZeDuS, had a mean sensitivity of 0.926 (95% CI, 0.881-0.964). When the results were aggregated, the mean sensitivity for all submitted algorithms was 0.879; for only those who participated in phase 2, it was 0.926. Conclusions and Relevance In this diagnostic study, an international competition produced algorithms with high sensitivity for using AI to detect lesions on DBT images. A standardized performance benchmark for the detection task using publicly available clinical imaging data was released, with detailed descriptions and analyses of submitted algorithms accompanied by a public release of their predictions and code for selected methods. These resources will serve as a foundation for future research on computer-assisted diagnosis methods for DBT, significantly lowering the barrier of entry for new researchers.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceBreast NeoplasmsHumansFemaleBenchmarkingMammographyAlgorithmsRadiographic Image Interpretation, Computer-Assisted

Autor:innen und Institutionen

  • Department of Electrical and Computer Engineering, Duke University, Durham, North Carolina.
  • Department of Radiology, Duke University Medical Center, Durham, North Carolina.
  • Faculty of Mathematics and Information Science, Warsaw University of Technology, Warsaw, Poland.
  • Department of Oncology, McMaster University, Hamilton, Ontario, Canada.
  • Jagiellonian University, Kraków, Poland.
  • Department of Radiology, NYU Grossman School of Medicine, New York, New York.

Förderung

  • NIBIB NIH HHS
  • NCI NIH HHS

Zitieren

APA

Konz, N., Buda, M., Gu, H., Saha, A., Yang, J., Chledowski, J., Park, J., Witowski, J., Geras, K. J., Shoshan, Y., Gilboa-Solomon, F., Khapun, D., Ratner, V., Barkan, E., Ozery-Flato, M., Martí, R., Omigbodun, A., Marasinou, C., Nakhaei, N., …, & Mazurowski, M. A. (2023). A Competition, Benchmark, Code, and Data for Using Artificial Intelligence to Detect Lesions in Digital Breast Tomosynthesis. JAMA Network Open. https://doi.org/10.1001/jamanetworkopen.2023.0524

Vancouver

Konz N, Buda M, Gu H, Saha A, Yang J, Chledowski J, et al. A Competition, Benchmark, Code, and Data for Using Artificial Intelligence to Detect Lesions in Digital Breast Tomosynthesis. JAMA Network Open. 2023. doi:10.1001/jamanetworkopen.2023.0524

BibTeX
@article{Konz2023,
  author = {Konz, Nicholas and Buda, Mateusz and Gu, Hanxue and Saha, Ashirbani and Yang, Jichen and Chledowski, Jakub and Park, Jungkyu and Witowski, Jan and Geras, Krzysztof J and Shoshan, Yoel and Gilboa-Solomon, Flora and Khapun, Daniel and Ratner, Vadim and Barkan, Ella and Ozery-Flato, Michal and Martí, Robert and Omigbodun, Akinyinka and Marasinou, Chrysostomos and Nakhaei, Noor and Hsu, William and Sahu, Pranjal and Hossain, Md Belayat and Lee, Juhun and Santos, Carlos and Przelaskowski, Artur and Kalpathy-Cramer, Jayashree and Bearce, Benjamin and Cha, Kenny and Farahani, Keyvan and Petrick, Nicholas and Hadjiiski, Lubomir and Drukker, Karen and Armato, Samuel G and Mazurowski, Maciej A},
  title = {A Competition, Benchmark, Code, and Data for Using Artificial Intelligence to Detect Lesions in Digital Breast Tomosynthesis},
  journal = {JAMA Network Open},
  year = {2023},
  doi = {10.1001/jamanetworkopen.2023.0524}
}
Kostenlos starten →