EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Hyperbolic Active Learning for Label-Efficient Action Segmentation

Jingqiao Xiu, Wei Ji, Menglin Yang, Yufeng Chen, Hanbin Zhao, Fangfang Wang, Roger Zimmermann

ACM Transactions on Multimedia Computing, Communications, and Applications · 31.07.2026 · 22 (7) · 1-18

DOI: 10.1145/3797032 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 24.06.2026. Verfasst von Jingqiao Xiu und 6 weiteren Autor:innen. Die Arbeit nennt 87 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: State Key Laboratory for Novel Software Technology, Nanjing University, Natural Science Foundation of Zhejiang Province of China, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent advances in action segmentation have greatly enhanced our understanding of complex and dynamic scenes in video content. Despite these improvements, the field continues to face persistent challenges, particularly in terms of model efficiency and the substantial cost associated with manual annotation. In this work, we introduce a novel framework that integrates active learning within hyperbolic space to effectively address these issues. By leveraging the hierarchical representational capacity of hyperbolic space, which is naturally suited for modeling structured data, and combining it with the selective efficiency of active learning, our method introduces hyperbolic uncertainty metrics to guide the targeted selection of the most informative video frames and sequences for annotation. This enables the model to prioritize annotation efforts where they are most impactful. Furthermore, the model iteratively refines pseudo labels using all available annotations, significantly reducing the need for exhaustive labeling while preserving high segmentation accuracy. To further mitigate reliance on precise annotations, we enhance the MS-TCN model by incorporating soft pseudo labels and a weighting mechanism that dynamically adjusts learning based on label confidence, allowing for more robust training in the presence of noisy or weakly labeled data. Extensive experiments conducted on two widely used action segmentation benchmark datasets validate the effectiveness of our approach, demonstrating that it can substantially reduce annotation effort while maintaining overall segmentation performance.

Förderung

  • State Key Laboratory for Novel Software Technology, Nanjing University
  • Natural Science Foundation of Zhejiang Province of China
  • National Natural Science Foundation of China
  • Hangzhou Key Scientific Research Program

Zitieren

APA

Xiu, J., Ji, W., Yang, M., Chen, Y., Zhao, H., Wang, F., & Zimmermann, R. (2026). Hyperbolic Active Learning for Label-Efficient Action Segmentation. ACM Transactions on Multimedia Computing, Communications, and Applications, 22(7), 1-18. https://doi.org/10.1145/3797032

Vancouver

Xiu J, Ji W, Yang M, Chen Y, Zhao H, Wang F, et al. Hyperbolic Active Learning for Label-Efficient Action Segmentation. ACM Transactions on Multimedia Computing, Communications, and Applications. 2026;22(7):1-18. doi:10.1145/3797032

BibTeX
@article{Xiu2026,
  author = {Xiu, Jingqiao and Ji, Wei and Yang, Menglin and Chen, Yufeng and Zhao, Hanbin and Wang, Fangfang and Zimmermann, Roger},
  title = {Hyperbolic Active Learning for Label-Efficient Action Segmentation},
  journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
  year = {2026},
  volume = {22},
  number = {7},
  pages = {1--18},
  doi = {10.1145/3797032}
}
Kostenlos starten →