Saliency-Guided Local Semantic Mixing for Long-Tailed Image Classification
Machine Learning and Knowledge Extraction · 2025-09-22 · 7 (3) · 107
DOI: 10.3390/make7030107 ↗At a glance
Journal article in Machine Learning and Knowledge Extraction, published online on 2025-09-22. Written by Jiahui Lv and 4 co-authors. Cited 2 times so far (Crossref); 57 references. The full text is freely available (open access, CC BY 4.0). Funded by: Laboratory of Big Data and Decision Making of National University of Defense Technology.
Abstract (original language)
In real-world visual recognition tasks, long-tailed distributions pose a widespread challenge, with extreme class imbalance severely limiting the representational learning capability of deep models. In practice, due to this imbalance, deep models often exhibit poor generalization performance on tail classes. To address this issue, data augmentation through the synthesis of new tail-class samples has become an effective method. One popular approach is CutMix, which explicitly mixes images from tail and other classes, constructing labels based on the ratio of the regions cropped from both images. However, region-based labels completely ignore the inherent semantic information of the augmented samples. To overcome this problem, we propose a saliency-guided local semantic mixing (LSM) method, which uses differentiable block decoupling and semantic-aware local mixing techniques. This method integrates head-class backgrounds while preserving the key discriminative features of tail classes and dynamically assigns labels to effectively augment tail-class samples. This results in efficient balancing of long-tailed data distributions and significant improvements in classification performance. The experimental validation shows that this method demonstrates significant advantages across three long-tailed benchmark datasets, improving classification accuracy by 5.0%, 7.3%, and 6.1%, respectively. Notably, the LSM framework is highly compatible, seamlessly integrating with existing classification models and providing significant performance gains, validating its broad applicability.
Funding
- Laboratory of Big Data and Decision Making of National University of Defense Technology
Cite
APA
Lv, J., Lei, J., Zhang, J., Chen, C., & Li, S. (2025). Saliency-Guided Local Semantic Mixing for Long-Tailed Image Classification. Machine Learning and Knowledge Extraction, 7(3), 107. https://doi.org/10.3390/make7030107
Vancouver
Lv J, Lei J, Zhang J, Chen C, Li S. Saliency-Guided Local Semantic Mixing for Long-Tailed Image Classification. Machine Learning and Knowledge Extraction. 2025;7(3):107. doi:10.3390/make7030107
BibTeX
@article{Lv2025,
author = {Lv, Jiahui and Lei, Jun and Zhang, Jun and Chen, Chao and Li, Shuohao},
title = {Saliency-Guided Local Semantic Mixing for Long-Tailed Image Classification},
journal = {Machine Learning and Knowledge Extraction},
year = {2025},
volume = {7},
number = {3},
pages = {107},
doi = {10.3390/make7030107}
}
EUVIMED