Dynamic graph neural networks for UAV-based group activity recognition in structured team sports
Frontiers in Neurorobotics · 08.09.2025 · 19
DOI: 10.3389/fnbot.2025.1631998 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Neurorobotics, online erschienen am 08.09.2025. Verfasst von Ishrat Zahra und 6 weiteren Autor:innen. Beteiligte Einrichtung: Guodian Nanjing Automation Co., Ltd., Nanjing, China. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Introduction
Understanding group actions in real-world settings is essential for the advancement of applications in surveillance, robotics, and autonomous systems. Group activity recognition, particularly in sports scenarios, presents unique challenges due to dynamic interactions, occlusions, and varying viewpoints. To address these challenges, we develop a deep learning system that recognizes multi-person behaviors by integrating appearance-based features (HOG, LBP, SIFT), skeletal data (MediaPipe, MOCON), and motion features. Our approach employs a Dynamic Graph Neural Network (DGNN) and Bi-LSTM architecture, enabling robust recognition of group activities in diverse and dynamic environments. To further validate our framework’s adaptability, we include evaluations on Volleyball and SoccerTrack UAV-recorded datasets, which offer unique perspectives and challenges.
Method
Our framework integrates YOLOv11 for object detection and SORT for tracking to extract multi-modal features—including HOG, LBP, SIFT, skeletal data (MediaPipe), and motion context (MOCON). These features are optimized using genetic algorithms and fused within a Dynamic Graph Neural Network (DGNN), which models players as nodes in a spatio-temporal graph, effectively capturing both spatial formations and temporal dynamics.
Results
We evaluated our framework on three datasets: a volleyball dataset, SoccerTrack UAV-based soccer dataset, and NBA basketball dataset. Our system achieved 94.5% accuracy on the volleyball dataset (mAP: 94.2%, MPCA: 93.8%) with an inference time of 0.18 s per frame. On the SoccerTrack UAV dataset, accuracy was 91.8% (mAP: 91.5%, MPCA: 90.5%) with 0.20 s inference, and on the NBA basketball dataset, it was 91.1% (mAP: 90.8%, MPCA: 89.8%) with the same 0.20 s per frame. These results highlight our framework’s high performance and efficient computational efficiency across various sports and perspectives.
Discussion
Our approach demonstrates robust performance in recognizing multi-person actions across diverse conditions, highlighting its adaptability to both conventional and UAV-based video sources.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Guodian Nanjing Automation Co., Ltd., Nanjing, China.
- Department of Computer Science, Air University, Islamabad, Pakistan.
- Department of Information Technology, College of Computer, Qassim University, Buraydah, Saudi Arabia.
- Computer Sciences Department, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University (PNU), Riyadh, Saudi Arabia.
- Department of Computer Science and Engineering, College of Informatics, Korea University, Seoul, Republic of Korea.
- School of Future Technology, Nanjing University of Information Science and Technology, Nanjing, China.
Zitieren
APA
Zahra, I., Wu, Y., Alhasson, H. F., Alharbi, S. S., Aljuaid, H., Jalal, A., & Liu, H. (2025). Dynamic graph neural networks for UAV-based group activity recognition in structured team sports. Frontiers in Neurorobotics, 19. https://doi.org/10.3389/fnbot.2025.1631998
Vancouver
Zahra I, Wu Y, Alhasson HF, Alharbi SS, Aljuaid H, Jalal A, et al. Dynamic graph neural networks for UAV-based group activity recognition in structured team sports. Frontiers in Neurorobotics. 2025;19. doi:10.3389/fnbot.2025.1631998
BibTeX
@article{Zahra2025,
author = {Zahra, Ishrat and Wu, Yanfeng and Alhasson, Haifa F and Alharbi, Shuaa S and Aljuaid, Hanan and Jalal, Ahmad and Liu, Hui},
title = {Dynamic graph neural networks for UAV-based group activity recognition in structured team sports},
journal = {Frontiers in Neurorobotics},
year = {2025},
volume = {19},
doi = {10.3389/fnbot.2025.1631998}
}
EUVIMED