EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

A Fuzzy Adjustment Mechanism to Tune Focal Loss Hyperparameters in Imbalanced Deep Learning

Tzung-Pei Hong, Wei-Chun Peng, Ja-Hwung Su, Chun-Hao Chen

Mathematics · 2026-10-29 · 14 (21) · 3952

DOI: 10.3390/math14213952 ↗

At a glance

Journal article in Mathematics, published online on 2026-10-29. Written by Tzung-Pei Hong and 3 co-authors. 51 references. The full text is freely available (open access, CC BY 4.0). Funded by: National Science and Technology Council.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

To address the problem of data imbalance in deep learning, this paper proposes a fuzzy adjustment mechanism that dynamically adjusts the focal loss focusing parameter according to the class-specific learning status. Instead of using a single fixed focusing parameter for all classes, the proposed method adjusts the class-wise parameter based on three factors: class size, class-specific focal loss, and changes in focal loss. This enables the model to adjust the focus on different classes during training according to their learning conditions. The experimental results show that the proposed approach achieves a competitive performance compared with the evaluated fixed focal loss baselines. Based on paired t-tests across five trials, the proposed method shows statistically significant improvements over cross-entropy loss on both CIFAR-10 and SVHN datasets. For the fixed focal loss baselines, some differences are statistically significant, while others are not. Given the small number of paired trials (n = 5), these statistical results should be interpreted with caution. Overall, the proposed fuzzy dynamic mechanism provides a practical alternative to manually specifying a fixed focusing parameter by adaptively adjusting the parameter according to class-level learning conditions.

Funding

  • National Science and Technology Council

Cite

APA

Hong, T., Peng, W., Su, J., & Chen, C. (2026). A Fuzzy Adjustment Mechanism to Tune Focal Loss Hyperparameters in Imbalanced Deep Learning. Mathematics, 14(21), 3952. https://doi.org/10.3390/math14213952

Vancouver

Hong T, Peng W, Su J, Chen C. A Fuzzy Adjustment Mechanism to Tune Focal Loss Hyperparameters in Imbalanced Deep Learning. Mathematics. 2026;14(21):3952. doi:10.3390/math14213952

BibTeX
@article{Hong2026,
  author = {Hong, Tzung-Pei and Peng, Wei-Chun and Su, Ja-Hwung and Chen, Chun-Hao},
  title = {A Fuzzy Adjustment Mechanism to Tune Focal Loss Hyperparameters in Imbalanced Deep Learning},
  journal = {Mathematics},
  year = {2026},
  volume = {14},
  number = {21},
  pages = {3952},
  doi = {10.3390/math14213952}
}
Start for free →