EUVIMEDEUVIMED entdecken
Crossref

Expandable and Differentiable Dual Memories with Orthogonal Regularization for Exemplar-free Continual Learning

Hyung-Jun Moon, Sung-Bae Cho

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (29) · 24441-24448

DOI: 10.1609/aaai.v40i29.39626 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Hyung-Jun Moon und 1 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Continual learning methods used to force neural networks to process sequential tasks in isolation, preventing them from leveraging useful inter-task relationships and causing them to repeatedly relearn similar features or overly differentiate them. To address this problem, we propose a fully differentiable, exemplar-free expandable method composed of two complementary memories: One learns common features that can be used across all tasks, and the other combines the shared features to learn discriminative characteristics unique to each sample. Both memories are differentiable so that the network can autonomously learn latent representations for each sample. For each task, the memory adjustment module adaptively prunes critical slots and minimally expands capacity to accommodate new concepts, and orthogonal regularization enforces geometric separation between preserved and newly learned memory components to prevent interference. Experiments on CIFAR-10, CIFAR-100, and Tiny-ImageNet show that the proposed method outperforms 14 state-of-the-art methods for class-incremental learning, achieving final accuracies of 55.13%, 37.24%, and 30.11%, respectively. Additional analysis confirms that, through effective integration and utilization of knowledge, the proposed method can increase average performance across sequential tasks, and it produces feature extraction results closest to the upper bound, thus establishing a new milestone in continual learning.

Zitieren

APA

Moon, H., & Cho, S. (2026). Expandable and Differentiable Dual Memories with Orthogonal Regularization for Exemplar-free Continual Learning. Proceedings of the AAAI Conference on Artificial Intelligence, 40(29), 24441-24448. https://doi.org/10.1609/aaai.v40i29.39626

Vancouver

Moon H, Cho S. Expandable and Differentiable Dual Memories with Orthogonal Regularization for Exemplar-free Continual Learning. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(29):24441-24448. doi:10.1609/aaai.v40i29.39626

BibTeX
@article{Moon2026,
  author = {Moon, Hyung-Jun and Cho, Sung-Bae},
  title = {Expandable and Differentiable Dual Memories with Orthogonal Regularization for Exemplar-free Continual Learning},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {29},
  pages = {24441--24448},
  doi = {10.1609/aaai.v40i29.39626}
}
Kostenlos starten →