Intra- and inter-video context-aware action spotting
PeerJ Computer Science · 09.03.2026 · 12 · e3667
DOI: 10.7717/peerj-cs.3667 ↗Kurz gefasst
Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 09.03.2026. Verfasst von Yi Chen und 4 weiteren Autor:innen. Die Arbeit nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Innovation of Policing Science and Technology, Fujian Province, National Natural Science Foundation of China.
Abstract (Originalsprache)
As a recently proposed task on video understanding, action spotting aims to locate and classify action in a long video clip and it can be applied for automatically generating video summaries and highlights. To resolve this problem, this article proposes a novel framework capable of capturing both intra- and inter-video contextual information. In particular, we present a transformer based model that views the task as a set prediction problem that aims to match the set of predicted action instances and the set of ground-truths. It is able to capture long-range intra-video temporal information and discovers causal relationships between actions. Next, based on the observation that actions of the same type recur in different videos, we propose to exploit the inter-video contextual information from dataset. To do so, we design an action memory module which stores the compact feature representation of each action class during training, so as to improve action recognition and localization performance. We evaluate our model on public benchmark and demonstrate that our model outperforms the state-of-the-art methods by a large margin.
Förderung
- Innovation of Policing Science and Technology, Fujian Province
- National Natural Science Foundation of China
Zitieren
APA
Chen, Y., Cai, J., Lin, X., Lin, X., & Liu, W. (2026). Intra- and inter-video context-aware action spotting. PeerJ Computer Science, 12, e3667. https://doi.org/10.7717/peerj-cs.3667
Vancouver
Chen Y, Cai J, Lin X, Lin X, Liu W. Intra- and inter-video context-aware action spotting. PeerJ Computer Science. 2026;12:e3667. doi:10.7717/peerj-cs.3667
BibTeX
@article{Chen2026,
author = {Chen, Yi and Cai, Jiaxin and Lin, Xinyang and Lin, Xiang and Liu, Wenxi},
title = {Intra- and inter-video context-aware action spotting},
journal = {PeerJ Computer Science},
year = {2026},
volume = {12},
pages = {e3667},
doi = {10.7717/peerj-cs.3667}
}
EUVIMED