Effective Video Summarization by Extracting Parameter-Free Motion Attention
ACM Transactions on Multimedia Computing, Communications, and Applications · 31.07.2024 · 20 (7) · 1-20
DOI: 10.1145/3654670 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 16.05.2024. Verfasst von Tingting Han und 5 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 64 Literaturangaben. Gefördert von: Zhejiang Provincial Natural Science Foundation of China, National Natural Science Foundation of China.
Abstract (Originalsprache)
Video summarization remains a challenging task despite increasing research efforts. Traditional methods focus solely on long-range temporal modeling of video frames, overlooking important local motion information that cannot be captured by frame-level video representations. In this article, we propose the Parameter-free Motion Attention Module (PMAM) to exploit the crucial motion clues potentially contained in adjacent video frames, using a multi-head attention architecture. The PMAM requires no additional training for model parameters, leading to an efficient and effective understanding of video dynamics. Moreover, we introduce the Multi-feature Motion Attention Network (MMAN), integrating the PMAM with local and global multi-head attention based on object-centric and scene-centric video representations. The synergistic combination of local motion information, extracted by the proposed PMAM, with long-range interactions modeled by the local and global multi-head attention mechanism, can significantly enhance the performance of video summarization. Extensive experimental results on the benchmark datasets, SumMe and TVSum, demonstrate that the proposed MMAN outperforms other state-of-the-art methods, resulting in remarkable performance gains.
Förderung
- Zhejiang Provincial Natural Science Foundation of China
- National Natural Science Foundation of China
Zitieren
APA
Han, T., Zhou, Q., Yu, J., Yu, Z., Zhang, J., & Zhao, S. (2024). Effective Video Summarization by Extracting Parameter-Free Motion Attention. ACM Transactions on Multimedia Computing, Communications, and Applications, 20(7), 1-20. https://doi.org/10.1145/3654670
Vancouver
Han T, Zhou Q, Yu J, Yu Z, Zhang J, Zhao S. Effective Video Summarization by Extracting Parameter-Free Motion Attention. ACM Transactions on Multimedia Computing, Communications, and Applications. 2024;20(7):1-20. doi:10.1145/3654670
BibTeX
@article{Han2024,
author = {Han, Tingting and Zhou, Quan and Yu, Jun and Yu, Zhou and Zhang, Jianhui and Zhao, Sicheng},
title = {Effective Video Summarization by Extracting Parameter-Free Motion Attention},
journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
year = {2024},
volume = {20},
number = {7},
pages = {1--20},
doi = {10.1145/3654670}
}
EUVIMED