Reconstruction of occluded Skeletons using Generative Adversarial Networks for Human Activity Recognition
International Journal of Innovations in Science and Technology · 28.04.2026 · 163
DOI: 10.33411/ijist/1833 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Innovations in Science and Technology, online erschienen am 28.04.2026. Verfasst von Hassan Nawaz und 1 weiteren Autor:innen. Die Arbeit nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Human Activity Recognition (HAR) using 3D skeleton motion data plays a vital role in surveillance, healthcare, and human–computer interaction; however, its performance degrades significantly under real-world occlusion conditions. This study proposes a comparative GAN-based framework using CRNN+BiLSTM and Transformer architectures as generator networks to reconstruct occluded 3D human skeletons, demonstrating superior reconstruction and activity recognition performance across multiple occlusion scenarios. The UTKinect-Action3D dataset was used, which is publicly available, and in this dataset, we have RGB images, grayscale images, and 3D skeleton points text data. Skeleton data were manually occluded to simulate eight occlusion scenarios, including left arm, right arm, left leg, right leg, left arm and leg, right arm and leg, both arms, and both legs occlusions. A Generative Adversarial Network (GAN) is employed, where the generator is implemented using (i) CRNN+ BiLSTM and (ii) Transformer models, while the discriminator is based on LSTM. Reconstructed skeletons are subsequently fed into an LSTM-based classifier for activity recognition. The proposed GAN-based reconstruction models significantly enhance skeleton recovery and human activity recognition under occlusion. Compared to the GAN-CRNN (Min) and GAN-CRNN (Max) benchmarks, the GAN-CRNN+ BiLSTM achieves average improvements of 32.7% ± 2.4 and 18.3% ± 1.9, respectively, while the GAN-Transformer attains higher average gains of 35.1% ± 2.1 and 20.5% ± 1.7, demonstrating statistically significant improvements (p < 0.05), particularly in complex occlusion scenarios. These results demonstrate the effectiveness and robustness of the proposed architectures for handling severe skeletal occlusions. The performance gains are attributed to bidirectional temporal modeling in BiLSTM and global spatio-temporal attention in Transformers. The proposed GAN-based reconstruction framework effectively mitigates occlusion effects and significantly enhances human activity recognition accuracy.
Zitieren
APA
Nawaz, H., & Anjum, N. (2026). Reconstruction of occluded Skeletons using Generative Adversarial Networks for Human Activity Recognition. International Journal of Innovations in Science and Technology, 163. https://doi.org/10.33411/ijist/1833
Vancouver
Nawaz H, Anjum N. Reconstruction of occluded Skeletons using Generative Adversarial Networks for Human Activity Recognition. International Journal of Innovations in Science and Technology. 2026:163. doi:10.33411/ijist/1833
BibTeX
@article{Nawaz2026,
author = {Nawaz, Hassan and Anjum, Nadeem},
title = {Reconstruction of occluded Skeletons using Generative Adversarial Networks for Human Activity Recognition},
journal = {International Journal of Innovations in Science and Technology},
year = {2026},
pages = {163},
doi = {10.33411/ijist/1833}
}
EUVIMED