Hyperbolic Active Learning for Label-Efficient Action Segmentation
ACM Transactions on Multimedia Computing, Communications, and Applications · 31.07.2026 · 22 (7) · 1-18
DOI: 10.1145/3797032 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 24.06.2026. Verfasst von Jingqiao Xiu und 6 weiteren Autor:innen. Die Arbeit nennt 87 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: State Key Laboratory for Novel Software Technology, Nanjing University, Natural Science Foundation of Zhejiang Province of China, National Natural Science Foundation of China.
Abstract (Originalsprache)
Recent advances in action segmentation have greatly enhanced our understanding of complex and dynamic scenes in video content. Despite these improvements, the field continues to face persistent challenges, particularly in terms of model efficiency and the substantial cost associated with manual annotation. In this work, we introduce a novel framework that integrates active learning within hyperbolic space to effectively address these issues. By leveraging the hierarchical representational capacity of hyperbolic space, which is naturally suited for modeling structured data, and combining it with the selective efficiency of active learning, our method introduces hyperbolic uncertainty metrics to guide the targeted selection of the most informative video frames and sequences for annotation. This enables the model to prioritize annotation efforts where they are most impactful. Furthermore, the model iteratively refines pseudo labels using all available annotations, significantly reducing the need for exhaustive labeling while preserving high segmentation accuracy. To further mitigate reliance on precise annotations, we enhance the MS-TCN model by incorporating soft pseudo labels and a weighting mechanism that dynamically adjusts learning based on label confidence, allowing for more robust training in the presence of noisy or weakly labeled data. Extensive experiments conducted on two widely used action segmentation benchmark datasets validate the effectiveness of our approach, demonstrating that it can substantially reduce annotation effort while maintaining overall segmentation performance.
Förderung
- State Key Laboratory for Novel Software Technology, Nanjing University
- Natural Science Foundation of Zhejiang Province of China
- National Natural Science Foundation of China
- Hangzhou Key Scientific Research Program
Zitieren
APA
Xiu, J., Ji, W., Yang, M., Chen, Y., Zhao, H., Wang, F., & Zimmermann, R. (2026). Hyperbolic Active Learning for Label-Efficient Action Segmentation. ACM Transactions on Multimedia Computing, Communications, and Applications, 22(7), 1-18. https://doi.org/10.1145/3797032
Vancouver
Xiu J, Ji W, Yang M, Chen Y, Zhao H, Wang F, et al. Hyperbolic Active Learning for Label-Efficient Action Segmentation. ACM Transactions on Multimedia Computing, Communications, and Applications. 2026;22(7):1-18. doi:10.1145/3797032
BibTeX
@article{Xiu2026,
author = {Xiu, Jingqiao and Ji, Wei and Yang, Menglin and Chen, Yufeng and Zhao, Hanbin and Wang, Fangfang and Zimmermann, Roger},
title = {Hyperbolic Active Learning for Label-Efficient Action Segmentation},
journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
year = {2026},
volume = {22},
number = {7},
pages = {1--18},
doi = {10.1145/3797032}
}
EUVIMED