EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Graph-Based Event and Sub-Event Grouping in User-Generated Videos with Distortion-Aware Keyframe Clustering

Malya Singh, Wei Tsang Ooi, Abdulmotaleb El Saddik, Mukesh Saini

ACM Transactions on Multimedia Computing, Communications, and Applications · 31.08.2026 · 22 (8) · 1-24

DOI: 10.1145/3820503 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 22.07.2026. Verfasst von Malya Singh und 3 weiteren Autor:innen. Die Arbeit nennt 71 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

User-generated content (UGC) videos recorded in uncontrolled environments often exhibit blur, camera shake, lighting fluctuations, and large viewpoint differences, making it difficult to organize multiple recordings of the same event. This work proposes an integrated pipeline that groups UGC videos into coherent events and sub-events by combining distortion-aware keyframe selection, adaptive audio–visual fusion, and confidence-weighted graph construction. The method first filters and clusters segment-level representations to obtain reliable keyframes, then fuses audio and visual cues through a lightweight gating module to produce robust multimodal descriptors. These descriptors populate a similarity graph whose strong and weak edges reveal sub-event and event structure without requiring shot boundaries or manual segmentation. Although distortion modeling, keyframe extraction, and multimodal similarity have been studied separately, existing approaches do not integrate them for hierarchical UGC video grouping. Experiments on the JIKU dataset and a curated YouTube dataset show consistent improvements in fidelity, diversity, and clustering metrics, demonstrating the applicability of the approach to video summarization, multi-view organization, and other UGC analysis tasks.

Zitieren

APA

Singh, M., Ooi, W. T., Saddik, A. E., & Saini, M. (2026). Graph-Based Event and Sub-Event Grouping in User-Generated Videos with Distortion-Aware Keyframe Clustering. ACM Transactions on Multimedia Computing, Communications, and Applications, 22(8), 1-24. https://doi.org/10.1145/3820503

Vancouver

Singh M, Ooi WT, Saddik AE, Saini M. Graph-Based Event and Sub-Event Grouping in User-Generated Videos with Distortion-Aware Keyframe Clustering. ACM Transactions on Multimedia Computing, Communications, and Applications. 2026;22(8):1-24. doi:10.1145/3820503

BibTeX
@article{Singh2026,
  author = {Singh, Malya and Ooi, Wei Tsang and Saddik, Abdulmotaleb El and Saini, Mukesh},
  title = {Graph-Based Event and Sub-Event Grouping in User-Generated Videos with Distortion-Aware Keyframe Clustering},
  journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
  year = {2026},
  volume = {22},
  number = {8},
  pages = {1--24},
  doi = {10.1145/3820503}
}
Kostenlos starten →