EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Intra- and inter-video context-aware action spotting

Yi Chen, Jiaxin Cai, Xinyang Lin, Xiang Lin, Wenxi Liu

PeerJ Computer Science · 09.03.2026 · 12 · e3667

DOI: 10.7717/peerj-cs.3667 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 09.03.2026. Verfasst von Yi Chen und 4 weiteren Autor:innen. Die Arbeit nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Innovation of Policing Science and Technology, Fujian Province, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As a recently proposed task on video understanding, action spotting aims to locate and classify action in a long video clip and it can be applied for automatically generating video summaries and highlights. To resolve this problem, this article proposes a novel framework capable of capturing both intra- and inter-video contextual information. In particular, we present a transformer based model that views the task as a set prediction problem that aims to match the set of predicted action instances and the set of ground-truths. It is able to capture long-range intra-video temporal information and discovers causal relationships between actions. Next, based on the observation that actions of the same type recur in different videos, we propose to exploit the inter-video contextual information from dataset. To do so, we design an action memory module which stores the compact feature representation of each action class during training, so as to improve action recognition and localization performance. We evaluate our model on public benchmark and demonstrate that our model outperforms the state-of-the-art methods by a large margin.

Förderung

  • Innovation of Policing Science and Technology, Fujian Province
  • National Natural Science Foundation of China

Zitieren

APA

Chen, Y., Cai, J., Lin, X., Lin, X., & Liu, W. (2026). Intra- and inter-video context-aware action spotting. PeerJ Computer Science, 12, e3667. https://doi.org/10.7717/peerj-cs.3667

Vancouver

Chen Y, Cai J, Lin X, Lin X, Liu W. Intra- and inter-video context-aware action spotting. PeerJ Computer Science. 2026;12:e3667. doi:10.7717/peerj-cs.3667

BibTeX
@article{Chen2026,
  author = {Chen, Yi and Cai, Jiaxin and Lin, Xinyang and Lin, Xiang and Liu, Wenxi},
  title = {Intra- and inter-video context-aware action spotting},
  journal = {PeerJ Computer Science},
  year = {2026},
  volume = {12},
  pages = {e3667},
  doi = {10.7717/peerj-cs.3667}
}
Kostenlos starten →