SUGAR: A Sequence Unfolding Based Transformer Model for Group Activity Recognition
Transactions on Artificial Intelligence · 2025
DOI: 10.53941/tai.2025.100015 ↗Kurz gefasst
Fachartikel in der Zeitschrift Transactions on Artificial Intelligence, 2025. Verfasst von Yash Gondkar und 5 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Deep learning models built upon Transformer architectures have led to substantial advancements in sequential data analysis. Nevertheless, their direct application to video-based tasks, such as Group Activity Recognition (GAR), remains constrained by the quadratic computational complexity and excessive memory requirements of global self-attention, especially when handling long video sequences. To overcome these limitations, we propose SUGAR: A Sequence Unfolding Based Transformer Model for Group Activity Recognition. Our approach introduces a novel sequence unfolding and folding mechanism that partitions long video sequences into overlapping local windows, enabling the model to concentrate attention within compact temporal regions. This local attention design dramatically reduces computational cost and memory footprint while maintaining high recognition accuracy. Within the Bi-Causal framework, SUGAR replaces conventional Transformer blocks, and experimental results on the Volleyball dataset demonstrate that our model achieves state-of-the-art performance, consistently exceeding 93% accuracy, with significantly improved efficiency. In addition, we investigate Lightning Attention 2 as an alternative linear-complexity attention module, identifying practical challenges such as increased memory usage and unstable convergence. To ensure robustness and training stability, we incorporate a dedicated safety mechanism that mitigates these issues. In summary, SUGAR offers a scalable, resource-efficient solution for group activity analysis in videos and exhibits strong potential for broader applications involving lengthy sequential data in computer vision and bioinformatics.
Zitieren
APA
Gondkar, Y., Zheng, C., Yang, Y., Shen, S., Ding, W., & Chen, P. (2025). SUGAR: A Sequence Unfolding Based Transformer Model for Group Activity Recognition. Transactions on Artificial Intelligence. https://doi.org/10.53941/tai.2025.100015
Vancouver
Gondkar Y, Zheng C, Yang Y, Shen S, Ding W, Chen P. SUGAR: A Sequence Unfolding Based Transformer Model for Group Activity Recognition. Transactions on Artificial Intelligence. 2025. doi:10.53941/tai.2025.100015
BibTeX
@article{Gondkar2025,
author = {Gondkar, Yash and Zheng, Chengjie and Yang, Yumeng and Shen, Shiqian and Ding, Wei and Chen, Ping},
title = {SUGAR: A Sequence Unfolding Based Transformer Model for Group Activity Recognition},
journal = {Transactions on Artificial Intelligence},
year = {2025},
doi = {10.53941/tai.2025.100015}
}
EUVIMED