Graph-Based Event and Sub-Event Grouping in User-Generated Videos with Distortion-Aware Keyframe Clustering
ACM Transactions on Multimedia Computing, Communications, and Applications · 31.08.2026 · 22 (8) · 1-24
DOI: 10.1145/3820503 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 22.07.2026. Verfasst von Malya Singh und 3 weiteren Autor:innen. Die Arbeit nennt 71 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
User-generated content (UGC) videos recorded in uncontrolled environments often exhibit blur, camera shake, lighting fluctuations, and large viewpoint differences, making it difficult to organize multiple recordings of the same event. This work proposes an integrated pipeline that groups UGC videos into coherent events and sub-events by combining distortion-aware keyframe selection, adaptive audio–visual fusion, and confidence-weighted graph construction. The method first filters and clusters segment-level representations to obtain reliable keyframes, then fuses audio and visual cues through a lightweight gating module to produce robust multimodal descriptors. These descriptors populate a similarity graph whose strong and weak edges reveal sub-event and event structure without requiring shot boundaries or manual segmentation. Although distortion modeling, keyframe extraction, and multimodal similarity have been studied separately, existing approaches do not integrate them for hierarchical UGC video grouping. Experiments on the JIKU dataset and a curated YouTube dataset show consistent improvements in fidelity, diversity, and clustering metrics, demonstrating the applicability of the approach to video summarization, multi-view organization, and other UGC analysis tasks.
Zitieren
APA
Singh, M., Ooi, W. T., Saddik, A. E., & Saini, M. (2026). Graph-Based Event and Sub-Event Grouping in User-Generated Videos with Distortion-Aware Keyframe Clustering. ACM Transactions on Multimedia Computing, Communications, and Applications, 22(8), 1-24. https://doi.org/10.1145/3820503
Vancouver
Singh M, Ooi WT, Saddik AE, Saini M. Graph-Based Event and Sub-Event Grouping in User-Generated Videos with Distortion-Aware Keyframe Clustering. ACM Transactions on Multimedia Computing, Communications, and Applications. 2026;22(8):1-24. doi:10.1145/3820503
BibTeX
@article{Singh2026,
author = {Singh, Malya and Ooi, Wei Tsang and Saddik, Abdulmotaleb El and Saini, Mukesh},
title = {Graph-Based Event and Sub-Event Grouping in User-Generated Videos with Distortion-Aware Keyframe Clustering},
journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
year = {2026},
volume = {22},
number = {8},
pages = {1--24},
doi = {10.1145/3820503}
}
EUVIMED