EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

BiaMix Contrastive Learning and Memory Similarity Distillation in Class‐Incremental Learning

Mang Ye, Wenke Huang, Zekun Shi, Zhiwei Ye, Bo Du

CAAI Transactions on Intelligence Technology · 2025-12 · 10 (6) · 1745-1758

DOI: 10.1049/cit2.70064 ↗

Kurz gefasst

Fachartikel in der Zeitschrift CAAI Transactions on Intelligence Technology, online erschienen am 23.10.2025. Verfasst von Mang Ye und 4 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 121 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Class‐incremental learning studies the problem of continually learning new classes from data streams. But networks suffer from catastrophic forgetting problems, forgetting past knowledge when acquiring new knowledge. Among different approaches, replay methods have shown exceptional promise for this challenge. But performance still baffles from two aspects: (i) data in imbalanced distribution and (ii) networks with semantic inconsistency. First, due to limited memory buffer, there exists imbalance between old and new classes. Direct optimisation would lead feature space skewed towards new classes, resulting in performance degradation on old classes. Second, existing methods normally leverage previous network to regularise the present network. However, the previous network is not trained on new classes, which means that these two networks are semantic inconsistent, leading to misleading guidance information. To address these two problems, we propose BCSD (BiaMix contrastive learning and memory similarity distillation). For imbalanced distribution, we design Biased MixUp, where mixed samples are in high weight from old classes and low weight from new classes. Thus, network learns to push decision boundaries towards new classes. We further leverage label information to construct contrastive learning in order to ensure discriminability. Meanwhile, for semantic inconsistency, we distill knowledge from the previous network by capturing the similarity of new classes in current tasks to old classes from the memory buffer and transfer that knowledge to the present network. Empirical results on various datasets demonstrate its effectiveness and efficiency.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Ye, M., Huang, W., Shi, Z., Ye, Z., & Du, B. (2025). BiaMix Contrastive Learning and Memory Similarity Distillation in Class‐Incremental Learning. CAAI Transactions on Intelligence Technology, 10(6), 1745-1758. https://doi.org/10.1049/cit2.70064

Vancouver

Ye M, Huang W, Shi Z, Ye Z, Du B. BiaMix Contrastive Learning and Memory Similarity Distillation in Class‐Incremental Learning. CAAI Transactions on Intelligence Technology. 2025;10(6):1745-1758. doi:10.1049/cit2.70064

BibTeX
@article{Ye2025,
  author = {Ye, Mang and Huang, Wenke and Shi, Zekun and Ye, Zhiwei and Du, Bo},
  title = {BiaMix Contrastive Learning and Memory Similarity Distillation in Class‐Incremental Learning},
  journal = {CAAI Transactions on Intelligence Technology},
  year = {2025},
  volume = {10},
  number = {6},
  pages = {1745--1758},
  doi = {10.1049/cit2.70064}
}
Kostenlos starten →