Technical note: Progressive deep learning: An accelerated training strategy for medical image segmentation
Medical Physics · 2023-08 · 50 (8) · 5075-5087
DOI: 10.1002/mp.16267 ↗Kurz gefasst
Fachartikel in der Zeitschrift Medical Physics, online erschienen am 17.02.2023. Verfasst von Byongsu Choi und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Radiation Oncology, Yonsei Cancer Center, Yonsei University College of Medicine, Seoul, South Korea. Hauptthemen laut MEDLINE: Deep Learning. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 55 Literaturangaben. Gefördert von: Ministry of Health & Welfare, Republic of Korea, National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT).
Abstract (Originalsprache)
Background
Recent advancements in Deep Learning (DL) methodologies have led to state‐of‐the‐art performance in a wide range of applications especially in object recognition, classification, and segmentation of medical images. However, training modern DL models requires a large amount of computation and long training times due to the complex nature of network structures and the large number of training datasets involved. Moreover, it is an intensive, repetitive manual process to select the optimized configuration of hyperparameters for a given DL network.
Purpose
In this study, we present a novel approach to accelerate the training time of DL models via the progressive feeding of training datasets based on similarity measures for medical image segmentation. We term this approach Progressive Deep Learning (PDL).
Methods
The two‐stage PDL approach was tested on the auto‐segmentation task for two imaging modalities: CT and MRI. The training datasets were ranked according to similarity measures between each sample based on Mean Square Error (MSE), Peak Signal‐to‐Noise Ratio (PSNR), Structural Similarity Index (SSIM), and the Universal Quality Image Index (UQI) values. At the start of the training process, a relatively coarse sampling of training datasets with higher ranks was used to optimize the hyperparameters of the DL network. Following this, the samples with higher ranks were used in step 1 to yield accelerated loss minimization in early training epochs and the total dataset was added in step 2 for the remainder of training.
Results
Our results demonstrate that the PDL approach can reduce the training time by nearly half (∼49%) and can predict segmentations (CT U‐net/DenseNet dice coefficient: 0.9506/0.9508, MR U‐net/DenseNet dice coefficient: 0.9508/0.9510) without major statistical difference (Wilcoxon signed‐rank test) compared to the conventional DL approach. The total training times with a fixed cutoff at 0.95 DSC for the CT dataset using DenseNet and U‐Net architectures, respectively, were 17 h, 20 min and 4 h, 45 min in the conventional case compared to 8 h, 45 min and 2 h, 20 min with PDL. For the MRI dataset, the total training times using the same architectures were 2 h, 54 min and 52 min in the conventional case and 1 h, 14 min and 25 min with PDL.
Conclusion
The proposed PDL training approach offers the ability to substantially reduce the training time for medical image segmentation while maintaining the performance achieved in the conventional case.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Radiation Oncology, Yonsei Cancer Center, Yonsei University College of Medicine, Seoul, South Korea.
- Medical Physics and Biomedical Engineering Lab (MPBEL), Yonsei University College of Medicine, Seoul, South Korea.
- Department of Radiation Oncology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, USA.
- Department of Radiation Oncology, Mayo Clinic, Jacksonville, Florida, USA.
- Oncosoft Inc., Seoul, South Korea.
Förderung
- Ministry of Health & Welfare, Republic of Korea
- National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT)
Zitieren
APA
Choi, B., Olberg, S., Park, J. C., Kim, J. S., Shrestha, D. K., Yaddanapudi, S., Furutani, K. M., & Beltran, C. J. (2023). Technical note: Progressive deep learning: An accelerated training strategy for medical image segmentation. Medical Physics, 50(8), 5075-5087. https://doi.org/10.1002/mp.16267
Vancouver
Choi B, Olberg S, Park JC, Kim JS, Shrestha DK, Yaddanapudi S, et al. Technical note: Progressive deep learning: An accelerated training strategy for medical image segmentation. Medical Physics. 2023;50(8):5075-5087. doi:10.1002/mp.16267
BibTeX
@article{Choi2023,
author = {Choi, Byongsu and Olberg, Sven and Park, Justin C and Kim, Jin Sung and Shrestha, Deepak K and Yaddanapudi, Shridhar and Furutani, Keith M and Beltran, Chris J},
title = {Technical note: Progressive deep learning: An accelerated training strategy for medical image segmentation},
journal = {Medical Physics},
year = {2023},
volume = {50},
number = {8},
pages = {5075--5087},
doi = {10.1002/mp.16267}
}
EUVIMED