Layer-Specific Knowledge Distillation for Class Incremental Semantic Segmentation
IEEE Transactions on Image Processing · 2024 · 33 · 1977-1989
DOI: 10.1109/tip.2024.3372448 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2024. Verfasst von Qilong Wang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 58 Literaturangaben. Gefördert von: National Key Research Development Program of China, National Natural Science Foundation of China, Haihe Laboratory of Information Technology Application Innovation.
Abstract (Originalsprache)
Recently, class incremental semantic segmentation (CISS) towards the practical open-world setting has attracted increasing research interest, which is mainly challenged by the well-known issue of catastrophic forgetting. Particularly, knowledge distillation (KD) techniques have been widely studied to alleviate catastrophic forgetting. Despite the promising performance, existing KD-based methods generally use the same distillation schemes for different intermediate layers to transfer old knowledge, while employing manually tuned and fixed trade-off weights to control the effect of KD. These KD-based methods take no consideration of feature characteristics from different intermediate layers, limiting the effectiveness of KD for CISS. In this paper, we propose a layer-specific knowledge distillation (LSKD) method to assign appropriate knowledge schemes and weights for various intermediate layers by considering feature characteristics, aiming to further explore the potential of KD in improving the performance of CISS. Specifically, we present a mask-guided distillation (MD) to alleviate the background shift on semantic features, which performs distillation by masking the features affected by the background. Furthermore, a mask-guided context distillation (MCD) is presented to explore global context information lying in high-level semantic features. Based on them, our LSKD assigns different distillation schemes according to feature characteristics. To adjust the effect of layer-specific distillation adaptively, LSKD introduces a regularized gradient equilibrium method to learn dynamic trade-off weights. Additionally, our LSKD makes an attempt to simultaneously learn distillation schemes and trade-off weights of different layers by developing a bi-level optimization method. Extensive experiments on widely used Pascal VOC 12 and ADE20K show our LSKD clearly outperforms its counterparts while achieving state-of-the-art results.
Förderung
- National Key Research Development Program of China
- National Natural Science Foundation of China
- Haihe Laboratory of Information Technology Application Innovation
Zitieren
APA
Wang, Q., Wu, Y., Yang, L., Zuo, W., & Hu, Q. (2024). Layer-Specific Knowledge Distillation for Class Incremental Semantic Segmentation. IEEE Transactions on Image Processing, 33, 1977-1989. https://doi.org/10.1109/tip.2024.3372448
Vancouver
Wang Q, Wu Y, Yang L, Zuo W, Hu Q. Layer-Specific Knowledge Distillation for Class Incremental Semantic Segmentation. IEEE Transactions on Image Processing. 2024;33:1977-1989. doi:10.1109/tip.2024.3372448
BibTeX
@article{Wang2024,
author = {Wang, Qilong and Wu, Yiwen and Yang, Liu and Zuo, Wangmeng and Hu, Qinghua},
title = {Layer-Specific Knowledge Distillation for Class Incremental Semantic Segmentation},
journal = {IEEE Transactions on Image Processing},
year = {2024},
volume = {33},
pages = {1977--1989},
doi = {10.1109/tip.2024.3372448}
}
EUVIMED