EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A quantitative analysis of the improvement provided by comprehensive annotation on CT lesion detection using deep learning

Jingchen Ma, Jin H Yoon, Lin Lu, Hao Yang, Pingzhen Guo, Dawei Yang, Jing Li, Jingxian Shen, Lawrence H Schwartz, Binsheng Zhao

Journal of Applied Clinical Medical Physics · 2024

DOI: 10.1002/acm2.14434 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Applied Clinical Medical Physics, 2024. Verfasst von Jingchen Ma und 9 weiteren Autor:innen. Beteiligte Einrichtung: Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, New York, USA. Hauptthemen laut MEDLINE: Deep Learning, Tomography, X-Ray Computed, Algorithms, Radiographic Image Interpretation, Computer-Assisted. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 16 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NCI NIH HHS, National Cancer Institute.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Data collected from hospitals are usually partially annotated by radiologists due to time constraints. Developing and evaluating deep learning models on these data may result in over or under estimation Purpose We aimed to quantitatively investigate how the percentage of annotated lesions in CT images will influence the performance of universal lesion detection (ULD) algorithms.

Methods

We trained a multi‐view feature pyramid network with position‐aware attention (MVP‐Net) to perform ULD. Three versions of the DeepLesion dataset were created for training MVP‐Net. Original DeepLesion Dataset (OriginalDL) is the publicly available, widely studied DeepLesion dataset that includes 32 735 lesions in 4427 patients which were partially labeled during routine clinical practice. Enriched DeepLesion Dataset (EnrichedDL) is an enhanced dataset that features fully labeled at one or more time points for 4145 patients with 34 317 lesions. UnionDL is the union of the OriginalDL and EnrichedDL with 54 510 labeled lesions in 4427 patients. Each dataset was used separately to train MVP‐Net, resulting in the following models: OriginalCNN (replicating the original result), EnrichedCNN (testing the effect of increased annotation), and UnionCNN (featuring the greatest number of annotations).

Results

Although the reported mean sensitivity of OriginalCNN was 84.3% using the OriginalDL testing set, the performance fell sharply when tested on the EnrichedDL testing set, yielding mean sensitivities of 56.1%, 66.0%, and 67.8% for OriginalCNN, EnrichedCNN, and UnionCNN, respectively. We also found that increasing the percentage of annotated lesions in the training set increased sensitivity, but the margin of increase in performance gradually diminished according to the power law.

Conclusions

We expanded and improved the existing DeepLesion dataset by annotating additional 21 775 lesions, and we demonstrated that using fully labeled CT images avoided overestimation of MVP‐Net's performance while increasing the algorithm's sensitivity, which may have a huge impact to the future CT lesion detection research. The annotated lesions are at https://github.com/ComputationalImageAnalysisLab/DeepLesionData .

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Deep LearningTomography, X-Ray ComputedAlgorithmsRadiographic Image Interpretation, Computer-AssistedHumansImage Processing, Computer-AssistedNeoplasmsDatabases, FactualNeural Networks, Computer

Stichwörter der Autor:innen

CTdeep learninglesion detectionmedical image dataset

Autor:innen und Institutionen

  • Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, New York, USA.
  • Department of Radiology, Columbia University Irving Medical Center, New York, New York, USA.
  • Department of Radiology, Beijing Friendship Hospital, Capital Medical University, Beijing, China.
  • Medical Imaging Department, Sun Yat-Sen University Cancer Center, State Key Laboratory of Oncology in South China, Guangzhou, China.

Förderung

  • NCI NIH HHS
  • National Cancer Institute

Zitieren

APA

Ma, J., Yoon, J. H., Lu, L., Yang, H., Guo, P., Yang, D., Li, J., Shen, J., Schwartz, L. H., & Zhao, B. (2024). A quantitative analysis of the improvement provided by comprehensive annotation on CT lesion detection using deep learning. Journal of Applied Clinical Medical Physics. https://doi.org/10.1002/acm2.14434

Vancouver

Ma J, Yoon JH, Lu L, Yang H, Guo P, Yang D, et al. A quantitative analysis of the improvement provided by comprehensive annotation on CT lesion detection using deep learning. Journal of Applied Clinical Medical Physics. 2024. doi:10.1002/acm2.14434

BibTeX
@article{Ma2024,
  author = {Ma, Jingchen and Yoon, Jin H and Lu, Lin and Yang, Hao and Guo, Pingzhen and Yang, Dawei and Li, Jing and Shen, Jingxian and Schwartz, Lawrence H and Zhao, Binsheng},
  title = {A quantitative analysis of the improvement provided by comprehensive annotation on CT lesion detection using deep learning},
  journal = {Journal of Applied Clinical Medical Physics},
  year = {2024},
  doi = {10.1002/acm2.14434}
}
Kostenlos starten →