EUVIMEDObjevte EUVIMED
Crossref

Region‐related focal loss for 3D brain tumor MRI segmentation

Bo Li, Xinge You, Qinmu Peng, Jing Wang, Chuanwu Yang

Medical Physics · 2023-07 · 50 (7) · 4325-4339

DOI: 10.1002/mp.16244 ↗

At a glance

Journal article in Medical Physics, published online on 2023-02-16. Written by Bo Li and 4 co-authors. Institution: School of Electronic Information and Communication, Huazhong University of Science and Technology, Wuhan, China. Major MEDLINE topics: Image Processing, Computer-Assisted, Brain Neoplasms. Cited 7 times so far (Crossref); 40 references. Funded by: National Natural Science Foundation of China, Key Program for International S&T Cooperation Projects of China, Special Projects for Technology Innovation of Hubei Province.

AbstraktSubjectsBibliografické údajeCiteRelated studies

Abstract (original language)

Background

In the brain tumor magnetic resonance image (MRI) segmentation, although the 3D convolution networks (CNNs) has achieved state‐of‐the‐art results, the class and hard‐voxel imbalances in the 3D images have not been well addressed. Voxel independent losses are dependent on the setting of class weights for the class imbalance issue, and are hard to assign each class equally. Region‐related losses cannot correctly focus on hard voxels dynamically and not be robust to misclassification of small structures. Meanwhile, repeatedly training on the additional hard samples augmented by existing methods would bring more class imbalance, overfitting and incorrect knowledge learning to the model.

Purpose

A novel region‐related loss with balanced dynamic weighting while alleviating the sensitivity to small structures is necessary. In addition, we need to increase the diversity of hard samples in the training to improve the performance of model.

Methods

The proposed Region‐related Focal Loss (RFL) reshapes standard Dice Loss (DL) by up‐weighting the loss assigned to hard‐classified voxels. Compared to DL, RFL adaptively modulate its gradient with an invariant focalized point that voxels with lower‐confidence than it would achieve a larger gradient, and higher‐confidence voxels would get a smaller gradient. Meanwhile, RFL can adjust the parameters to set where and how much the network is focused. In addition, an Intra‐classly Transformed Augmentation network (ITA‐NET) is proposed to increase the diversity of hard samples, in which the 3D registration network and intra‐class transfer layer are used to transform the shape and intensity respectively. A selective hard sample mining(SHSM) strategy is used to train the ITA‐NET for avoiding excessive class imbalance. Source code (in Tensorflow) is available at: https://github.com/lb‐whu/RFL_ITA .

Results

The experiments are carried out on public data set: Brain Tumor Segmentation Challenge 2020 (BratS2020). Experiments with BraTS2020 online validation set show that proposed methods achieve an average Dice scores of 0.905, 0.821, and 0.806 for whole tumor (WT), tumor core (TC) and enhancing tumor (ET), respectively. Compared with DL (baseline), the proposed RFL significantly improves the Dice scores by an average of 1%, and for the small region ET it can even increase by 3%. And the proposed method combined with ITA‐NET improves the Dice scores of ET and TC by 5% and 3% respectively.

Conclusions

The proposed RFL can converge with a invariant focalized point in the training of segmentation network, thus effectively alleviating the hard‐voxel imbalance in brain tumor MRI segmentation. The negative region term of RFL can effectively reduce the sensitivity of the segmentation model to the misclassification of small structures. The proposed ITA‐NET can increase the diversity of hard samples by transforming their shape and transfer their intra‐class intensity, thereby effectively improving the robustness of the segmentation network to hard samples.

Subjects

MeSH terms (MEDLINE)

Image Processing, Computer-AssistedBrain NeoplasmsHumansMagnetic Resonance ImagingImaging, Three-Dimensional

Author keywords

brain tumor segmentationmagnetic resonance imageregion-related focal loss

Authors and institutions

  • School of Electronic Information and Communication, Huazhong University of Science and Technology, Wuhan, China.
  • Shenzhen Research Institute, Huazhong University of Science and Technology, Shenzhen, China.
  • Department of Radiology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China.

Funding

  • National Natural Science Foundation of China
  • Key Program for International S&T Cooperation Projects of China
  • Special Projects for Technology Innovation of Hubei Province
  • Key Science and Technology Innovation Program of Hubei Province
  • Natural Science Foundation of Hubei Province
  • Science, Technology and Innovation Commission of Shenzhen Municipality
  • International Science and Technology Cooperation Programme

Cite

APA

Li, B., You, X., Peng, Q., Wang, J., & Yang, C. (2023). Region‐related focal loss for 3D brain tumor MRI segmentation. Medical Physics, 50(7), 4325-4339. https://doi.org/10.1002/mp.16244

Vancouver

Li B, You X, Peng Q, Wang J, Yang C. Region‐related focal loss for 3D brain tumor MRI segmentation. Medical Physics. 2023;50(7):4325-4339. doi:10.1002/mp.16244

BibTeX
@article{Li2023,
  author = {Li, Bo and You, Xinge and Peng, Qinmu and Wang, Jing and Yang, Chuanwu},
  title = {Region‐related focal loss for 3D brain tumor MRI segmentation},
  journal = {Medical Physics},
  year = {2023},
  volume = {50},
  number = {7},
  pages = {4325--4339},
  doi = {10.1002/mp.16244}
}
Start for free →