SkelFormer: An adaptive hierarchical transformer-based approach on skeleton graphs for human action recognition in video sequences
PLOS One · 12.01.2026 · 21 (1) · e0340390
DOI: 10.1371/journal.pone.0340390 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS One, online erschienen am 12.01.2026. Verfasst von Jiexing Yan und 3 weiteren Autor:innen. Beteiligte Einrichtung: College of Military and Political Basic Education, National University of Defense Technology, Changsha, China. Hauptthemen laut MEDLINE: Video Recording, Pattern Recognition, Automated, Image Processing, Computer-Assisted. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Human skeleton-based action recognition represents a pivotal field of study, capturing the intricate interplay between physical dynamics and intentional actions. Current research primarily focuses on extracting structural and temporal information from static skeleton-based graphs, but it grapples with a myriad of challenges. These include 1) an absence of hierarchical structure in encoding the skeleton-based graphs. 2) A requirement for substantial prior knowledge to interpret the diverse spatial dynamics within singular action labels. 3) An intricate task of representing the multifaceted temporal dynamics of individual actions. To address these challenges, we propose SkelFormer, a novel framework that captures spatiotemporal variations in skeleton-based graphs extracted from video sequences. The proposed SkelFormer incorporates the SKT Block as a central element, effectively facilitating information exchange through node concentration and diffusion across both structural and temporal dimensions. This design enables the extraction of hierarchical representations without relying on handcrafted rules, thereby improving the understanding of complex action patterns. Our rigorous experimental evaluations further substantiate SkelFormer’s supremacy, outperforming several state-of-the-art benchmarks in skeleton-based action recognition and achieving accuracy rates of 92.8% on the NTU RGB+D 60, 89.4% on the NTU RGB+D 120 (cross-subject split), and 96.1% on the NW-UCLA dataset.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- College of Military and Political Basic Education, National University of Defense Technology, Changsha, China.
- School of Arts, Sun Yat-Sen University, Guangzhou, China.
- School of Artificial Intelligence, Guangzhou University, Guangzhou, China.
ORCID-Profile: Xi Zhang
Zitieren
APA
Yan, J., Zhang, X., Tan, C., & Li, D. (2026). SkelFormer: An adaptive hierarchical transformer-based approach on skeleton graphs for human action recognition in video sequences. PLOS One, 21(1), e0340390. https://doi.org/10.1371/journal.pone.0340390
Vancouver
Yan J, Zhang X, Tan C, Li D. SkelFormer: An adaptive hierarchical transformer-based approach on skeleton graphs for human action recognition in video sequences. PLOS One. 2026;21(1):e0340390. doi:10.1371/journal.pone.0340390
BibTeX
@article{Yan2026,
author = {Yan, Jiexing and Zhang, Xi and Tan, Caiyan and Li, Dawen},
title = {SkelFormer: An adaptive hierarchical transformer-based approach on skeleton graphs for human action recognition in video sequences},
journal = {PLOS One},
year = {2026},
volume = {21},
number = {1},
pages = {e0340390},
doi = {10.1371/journal.pone.0340390}
}
EUVIMED