A quantitative analysis of the improvement provided by comprehensive annotation on CT lesion detection using deep learning
Journal of Applied Clinical Medical Physics · 2024
DOI: 10.1002/acm2.14434 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Applied Clinical Medical Physics, 2024. Verfasst von Jingchen Ma und 9 weiteren Autor:innen. Beteiligte Einrichtung: Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, New York, USA. Hauptthemen laut MEDLINE: Deep Learning, Tomography, X-Ray Computed, Algorithms, Radiographic Image Interpretation, Computer-Assisted. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 16 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NCI NIH HHS, National Cancer Institute.
Abstract (Originalsprache)
Background
Data collected from hospitals are usually partially annotated by radiologists due to time constraints. Developing and evaluating deep learning models on these data may result in over or under estimation Purpose We aimed to quantitatively investigate how the percentage of annotated lesions in CT images will influence the performance of universal lesion detection (ULD) algorithms.
Methods
We trained a multi‐view feature pyramid network with position‐aware attention (MVP‐Net) to perform ULD. Three versions of the DeepLesion dataset were created for training MVP‐Net. Original DeepLesion Dataset (OriginalDL) is the publicly available, widely studied DeepLesion dataset that includes 32 735 lesions in 4427 patients which were partially labeled during routine clinical practice. Enriched DeepLesion Dataset (EnrichedDL) is an enhanced dataset that features fully labeled at one or more time points for 4145 patients with 34 317 lesions. UnionDL is the union of the OriginalDL and EnrichedDL with 54 510 labeled lesions in 4427 patients. Each dataset was used separately to train MVP‐Net, resulting in the following models: OriginalCNN (replicating the original result), EnrichedCNN (testing the effect of increased annotation), and UnionCNN (featuring the greatest number of annotations).
Results
Although the reported mean sensitivity of OriginalCNN was 84.3% using the OriginalDL testing set, the performance fell sharply when tested on the EnrichedDL testing set, yielding mean sensitivities of 56.1%, 66.0%, and 67.8% for OriginalCNN, EnrichedCNN, and UnionCNN, respectively. We also found that increasing the percentage of annotated lesions in the training set increased sensitivity, but the margin of increase in performance gradually diminished according to the power law.
Conclusions
We expanded and improved the existing DeepLesion dataset by annotating additional 21 775 lesions, and we demonstrated that using fully labeled CT images avoided overestimation of MVP‐Net's performance while increasing the algorithm's sensitivity, which may have a huge impact to the future CT lesion detection research. The annotated lesions are at https://github.com/ComputationalImageAnalysisLab/DeepLesionData .
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, New York, USA.
- Department of Radiology, Columbia University Irving Medical Center, New York, New York, USA.
- Department of Radiology, Beijing Friendship Hospital, Capital Medical University, Beijing, China.
- Medical Imaging Department, Sun Yat-Sen University Cancer Center, State Key Laboratory of Oncology in South China, Guangzhou, China.
Förderung
- NCI NIH HHS
- National Cancer Institute
Zitieren
APA
Ma, J., Yoon, J. H., Lu, L., Yang, H., Guo, P., Yang, D., Li, J., Shen, J., Schwartz, L. H., & Zhao, B. (2024). A quantitative analysis of the improvement provided by comprehensive annotation on CT lesion detection using deep learning. Journal of Applied Clinical Medical Physics. https://doi.org/10.1002/acm2.14434
Vancouver
Ma J, Yoon JH, Lu L, Yang H, Guo P, Yang D, et al. A quantitative analysis of the improvement provided by comprehensive annotation on CT lesion detection using deep learning. Journal of Applied Clinical Medical Physics. 2024. doi:10.1002/acm2.14434
BibTeX
@article{Ma2024,
author = {Ma, Jingchen and Yoon, Jin H and Lu, Lin and Yang, Hao and Guo, Pingzhen and Yang, Dawei and Li, Jing and Shen, Jingxian and Schwartz, Lawrence H and Zhao, Binsheng},
title = {A quantitative analysis of the improvement provided by comprehensive annotation on CT lesion detection using deep learning},
journal = {Journal of Applied Clinical Medical Physics},
year = {2024},
doi = {10.1002/acm2.14434}
}
EUVIMED