Video feature guidance for temporal action segmentation
Journal of King Saud University Computer and Information Sciences · 2026-08 · 38 (6)
DOI: 10.1007/s44443-026-00734-2 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of King Saud University Computer and Information Sciences, online erschienen am 25.04.2026. Verfasst von Yue Li und 2 weiteren Autor:innen. Die Arbeit nennt 73 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
High-level semantic understanding of long-form videos critically depends on accurate temporal action segmentation. Although generative diffusion models have recently introduced a new modeling paradigm for this task, most existing methods initialize the diffusion process with random gaussian noise, which induces substantial uncertainty in the generated outputs and makes it difficult to ensure stable and reproducible predictions. To address this limitation, we propose a video feature-guided temporal action segmentation method (VFG), which uses semantically rich video features as a deterministic prior for the generation process to guide the model toward learning task-relevant discriminative representations. Specifically, instead of relying on purely random gaussian initialization as in prior diffusion-based methods, we construct a feature-guided latent representation during training by combining encoded video features with a scheduled amount of ground-truth guidance. This provides stronger task-aligned supervision and improves the accuracy and consistency of action boundary prediction. In addition, we design a dedicated decoding architecture that enhances sensitivity to local details while also modeling long-range contextual dependencies. Extensive experiments on three benchmark datasets show that VFG is competitive in accuracy and computational efficiency.
Zitieren
APA
Li, Y., Fu, Z., & Gao, R. (2026). Video feature guidance for temporal action segmentation. Journal of King Saud University Computer and Information Sciences, 38(6). https://doi.org/10.1007/s44443-026-00734-2
Vancouver
Li Y, Fu Z, Gao R. Video feature guidance for temporal action segmentation. Journal of King Saud University Computer and Information Sciences. 2026;38(6). doi:10.1007/s44443-026-00734-2
BibTeX
@article{Li2026,
author = {Li, Yue and Fu, Zixun and Gao, Rui},
title = {Video feature guidance for temporal action segmentation},
journal = {Journal of King Saud University Computer and Information Sciences},
year = {2026},
volume = {38},
number = {6},
doi = {10.1007/s44443-026-00734-2}
}
EUVIMED