EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

SkelFormer: An adaptive hierarchical transformer-based approach on skeleton graphs for human action recognition in video sequences

Jiexing Yan, Xi Zhang iD, Caiyan Tan, Dawen Li

PLOS One · 12.01.2026 · 21 (1) · e0340390

DOI: 10.1371/journal.pone.0340390 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS One, online erschienen am 12.01.2026. Verfasst von Jiexing Yan und 3 weiteren Autor:innen. Beteiligte Einrichtung: College of Military and Political Basic Education, National University of Defense Technology, Changsha, China. Hauptthemen laut MEDLINE: Video Recording, Pattern Recognition, Automated, Image Processing, Computer-Assisted. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Human skeleton-based action recognition represents a pivotal field of study, capturing the intricate interplay between physical dynamics and intentional actions. Current research primarily focuses on extracting structural and temporal information from static skeleton-based graphs, but it grapples with a myriad of challenges. These include 1) an absence of hierarchical structure in encoding the skeleton-based graphs. 2) A requirement for substantial prior knowledge to interpret the diverse spatial dynamics within singular action labels. 3) An intricate task of representing the multifaceted temporal dynamics of individual actions. To address these challenges, we propose SkelFormer, a novel framework that captures spatiotemporal variations in skeleton-based graphs extracted from video sequences. The proposed SkelFormer incorporates the SKT Block as a central element, effectively facilitating information exchange through node concentration and diffusion across both structural and temporal dimensions. This design enables the extraction of hierarchical representations without relying on handcrafted rules, thereby improving the understanding of complex action patterns. Our rigorous experimental evaluations further substantiate SkelFormer’s supremacy, outperforming several state-of-the-art benchmarks in skeleton-based action recognition and achieving accuracy rates of 92.8% on the NTU RGB+D 60, 89.4% on the NTU RGB+D 120 (cross-subject split), and 96.1% on the NW-UCLA dataset.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Video RecordingPattern Recognition, AutomatedImage Processing, Computer-AssistedHumansAlgorithms

Autor:innen und Institutionen

  • College of Military and Political Basic Education, National University of Defense Technology, Changsha, China.
  • School of Arts, Sun Yat-Sen University, Guangzhou, China.
  • School of Artificial Intelligence, Guangzhou University, Guangzhou, China.

ORCID-Profile: Xi Zhang

Zitieren

APA

Yan, J., Zhang, X., Tan, C., & Li, D. (2026). SkelFormer: An adaptive hierarchical transformer-based approach on skeleton graphs for human action recognition in video sequences. PLOS One, 21(1), e0340390. https://doi.org/10.1371/journal.pone.0340390

Vancouver

Yan J, Zhang X, Tan C, Li D. SkelFormer: An adaptive hierarchical transformer-based approach on skeleton graphs for human action recognition in video sequences. PLOS One. 2026;21(1):e0340390. doi:10.1371/journal.pone.0340390

BibTeX
@article{Yan2026,
  author = {Yan, Jiexing and Zhang, Xi and Tan, Caiyan and Li, Dawen},
  title = {SkelFormer: An adaptive hierarchical transformer-based approach on skeleton graphs for human action recognition in video sequences},
  journal = {PLOS One},
  year = {2026},
  volume = {21},
  number = {1},
  pages = {e0340390},
  doi = {10.1371/journal.pone.0340390}
}
Kostenlos starten →