Hypercorrelation Evolution for Video Class-Incremental Learning
Proceedings of the AAAI Conference on Artificial Intelligence · 24.03.2024 · 38 (4) · 3315-3323
DOI: 10.1609/aaai.v38i4.28117 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 24.03.2024. Verfasst von Sen Liang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref).
Abstract (Originalsprache)
Video class-incremental learning aims to recognize new actions while restricting the catastrophic forgetting of old ones, whose representative samples can only be saved in limited memory. Semantically variable subactions are susceptible to class confusion due to data imbalance. While existing methods address the problem by estimating and distilling the spatio-temporal knowledge, we further explores that the refinement of hierarchical correlations is crucial for the alignment of spatio-temporal features. To enhance the adaptability on evolved actions, we proposes a hierarchical aggregation strategy, in which hierarchical matching matrices are combined and jointly optimized to selectively store and retrieve relevant features from previous tasks. Meanwhile, a correlation refinement mechanism is presented to reinforce the bias on informative exemplars according to online hypercorrelation distribution. Experimental results demonstrate the effectiveness of the proposed method on three standard video class-incremental learning benchmarks, outperforming state-of-the-art methods. Code is available at: https://github.com/Lsen991031/HCE
Zitieren
APA
Liang, S., Zhu, K., Zhai, W., Liu, Z., & Cao, Y. (2024). Hypercorrelation Evolution for Video Class-Incremental Learning. Proceedings of the AAAI Conference on Artificial Intelligence, 38(4), 3315-3323. https://doi.org/10.1609/aaai.v38i4.28117
Vancouver
Liang S, Zhu K, Zhai W, Liu Z, Cao Y. Hypercorrelation Evolution for Video Class-Incremental Learning. Proceedings of the AAAI Conference on Artificial Intelligence. 2024;38(4):3315-3323. doi:10.1609/aaai.v38i4.28117
BibTeX
@article{Liang2024,
author = {Liang, Sen and Zhu, Kai and Zhai, Wei and Liu, Zhiheng and Cao, Yang},
title = {Hypercorrelation Evolution for Video Class-Incremental Learning},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2024},
volume = {38},
number = {4},
pages = {3315--3323},
doi = {10.1609/aaai.v38i4.28117}
}
EUVIMED