EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Hybrid Invariant Latent Feature Graph Transformer for Skeleton-Based Human Action Recognition

Kabul Khudaybergenov, Avazjon Marakhimov

Information · 28.07.2026 · 17 (8) · 729

DOI: 10.3390/info17080729 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Information, online erschienen am 28.07.2026. Verfasst von Kabul Khudaybergenov und 1 weiteren Autor:innen. Die Arbeit nennt 72 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Skeleton-based human action recognition is an important problem in applied vision systems, yet many existing approaches depend on a single skeleton descriptor or a single feature-learning mechanism. This restriction can weaken the representation of local body kinematics, long-range joint relations, and temporal dependencies within an action sequence. To address these limitations, this paper proposes HILF-GT (Hybrid Invariant Latent Feature Graph Transformer), a hybrid Graph Convolutional Network (GCN)-Transformer framework based on multiple spatio-temporal invariant latent features. The representation module constructs complementary structured tensors from skeleton graphs, inter-joint distances, adjacent-frame joint displacements, and inter-limb angles. Instead of transforming these descriptors into image-like maps for separate Convolutional Neural Network (CNN)-based classification, HILF-GT keeps their graph and temporal organization during learning. A local GCN branch models skeleton-aware kinematic patterns, whereas a graph-aware Transformer branch uses biased self-attention and cross-attention to capture dependencies among distant joints, frames, and latent-feature streams. A Perceiver-style latent bottleneck is further introduced to reduce the memory cost of global attention over frame-joint tokens. Experiments were conducted on four standard benchmark datasets, including NTU-RGB+D 60, NTU-RGB+D 120, NW-UCLA, and UTD-MHAD. The proposed method achieved 93.1% and 97.20% accuracy on the NTU-RGB+D 60 Cross-Subject and Cross-View protocols, 88.15% and 90.20% on the NTU-RGB+D 120 Cross-Subject and Cross-Setup protocols, 98.50% on NW-UCLA, and 97.50% on UTD-MHAD.

Zitieren

APA

Khudaybergenov, K., & Marakhimov, A. (2026). Hybrid Invariant Latent Feature Graph Transformer for Skeleton-Based Human Action Recognition. Information, 17(8), 729. https://doi.org/10.3390/info17080729

Vancouver

Khudaybergenov K, Marakhimov A. Hybrid Invariant Latent Feature Graph Transformer for Skeleton-Based Human Action Recognition. Information. 2026;17(8):729. doi:10.3390/info17080729

BibTeX
@article{Khudaybergenov2026,
  author = {Khudaybergenov, Kabul and Marakhimov, Avazjon},
  title = {Hybrid Invariant Latent Feature Graph Transformer for Skeleton-Based Human Action Recognition},
  journal = {Information},
  year = {2026},
  volume = {17},
  number = {8},
  pages = {729},
  doi = {10.3390/info17080729}
}
Kostenlos starten →