EUVIMEDEUVIMED entdecken
Crossref

Effective Video Summarization by Extracting Parameter-Free Motion Attention

Tingting Han, Quan Zhou, Jun Yu, Zhou Yu, Jianhui Zhang, Sicheng Zhao

ACM Transactions on Multimedia Computing, Communications, and Applications · 31.07.2024 · 20 (7) · 1-20

DOI: 10.1145/3654670 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 16.05.2024. Verfasst von Tingting Han und 5 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 64 Literaturangaben. Gefördert von: Zhejiang Provincial Natural Science Foundation of China, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Video summarization remains a challenging task despite increasing research efforts. Traditional methods focus solely on long-range temporal modeling of video frames, overlooking important local motion information that cannot be captured by frame-level video representations. In this article, we propose the Parameter-free Motion Attention Module (PMAM) to exploit the crucial motion clues potentially contained in adjacent video frames, using a multi-head attention architecture. The PMAM requires no additional training for model parameters, leading to an efficient and effective understanding of video dynamics. Moreover, we introduce the Multi-feature Motion Attention Network (MMAN), integrating the PMAM with local and global multi-head attention based on object-centric and scene-centric video representations. The synergistic combination of local motion information, extracted by the proposed PMAM, with long-range interactions modeled by the local and global multi-head attention mechanism, can significantly enhance the performance of video summarization. Extensive experimental results on the benchmark datasets, SumMe and TVSum, demonstrate that the proposed MMAN outperforms other state-of-the-art methods, resulting in remarkable performance gains.

Förderung

  • Zhejiang Provincial Natural Science Foundation of China
  • National Natural Science Foundation of China

Zitieren

APA

Han, T., Zhou, Q., Yu, J., Yu, Z., Zhang, J., & Zhao, S. (2024). Effective Video Summarization by Extracting Parameter-Free Motion Attention. ACM Transactions on Multimedia Computing, Communications, and Applications, 20(7), 1-20. https://doi.org/10.1145/3654670

Vancouver

Han T, Zhou Q, Yu J, Yu Z, Zhang J, Zhao S. Effective Video Summarization by Extracting Parameter-Free Motion Attention. ACM Transactions on Multimedia Computing, Communications, and Applications. 2024;20(7):1-20. doi:10.1145/3654670

BibTeX
@article{Han2024,
  author = {Han, Tingting and Zhou, Quan and Yu, Jun and Yu, Zhou and Zhang, Jianhui and Zhao, Sicheng},
  title = {Effective Video Summarization by Extracting Parameter-Free Motion Attention},
  journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
  year = {2024},
  volume = {20},
  number = {7},
  pages = {1--20},
  doi = {10.1145/3654670}
}
Kostenlos starten →