Conditional Modeling-Based Automatic Video Summarization
ACM Transactions on Multimedia Computing, Communications, and Applications · 31.03.2026 · 22 (3) · 1-21
DOI: 10.1145/3786783 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 27.02.2026. Verfasst von Jia-Hong Huang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 101 Literaturangaben. Gefördert von: European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie.
Abstract (Originalsprache)
The aim of video summarization is to shorten videos automatically while retaining the key information necessary to convey the overall story. Video summarization methods mainly rely on visual factors, such as visual consecutiveness and diversity, which may not be sufficient to fully understand the content of the video. There are other non-visual factors, such as interestingness, representativeness, and storyline consistency that should also be considered for generating high-quality video summaries. Current methods do not adequately take into account these non-visual factors, resulting in suboptimal performance. In this work, a new approach to video summarization is proposed based on insights gained from how humans create ground truth video summaries. The method utilizes a conditional modeling perspective and introduces multiple meaningful random variables and joint distributions to characterize the key components of video summarization. Helper distributions are employed to improve the training of the model. A conditional attention module is designed to mitigate potential performance degradation in the presence of multi-modal input. The proposed video summarization method incorporates the above innovative design choices that aim to narrow the gap between human-generated and machine-generated video summaries. Extensive experiments show that the proposed approach outperforms existing methods and achieves state-of-the-art performance on commonly used video summarization datasets.
Förderung
- European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie
Zitieren
APA
Huang, J., Yang, C. H., Chen, P., Chen, M., & Worring, M. (2026). Conditional Modeling-Based Automatic Video Summarization. ACM Transactions on Multimedia Computing, Communications, and Applications, 22(3), 1-21. https://doi.org/10.1145/3786783
Vancouver
Huang J, Yang CH, Chen P, Chen M, Worring M. Conditional Modeling-Based Automatic Video Summarization. ACM Transactions on Multimedia Computing, Communications, and Applications. 2026;22(3):1-21. doi:10.1145/3786783
BibTeX
@article{Huang2026,
author = {Huang, Jia-Hong and Yang, Chao-Han Huck and Chen, Pin-Yu and Chen, Min-Hung and Worring, Marcel},
title = {Conditional Modeling-Based Automatic Video Summarization},
journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
year = {2026},
volume = {22},
number = {3},
pages = {1--21},
doi = {10.1145/3786783}
}
EUVIMED