EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitOpen Access · CC BY 4.0

Deep Learning for Human Activity Recognition on 3D Human Skeleton: Survey and Comparative Study

Hung-Cuong Nguyen iD, Thi-Hao Nguyen, Rafał Scherer iD, Van-Hung Le iD

Sensors · 27.05.2023 · 23 (11) · 5121

DOI: 10.3390/s23115121 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift Sensors, online erschienen am 27.05.2023. Verfasst von Hung-Cuong Nguyen und 3 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Engineering Technology, Hung Vuong University, Viet Tri City 35100, Vietnam. Hauptthemen laut MEDLINE: Deep Learning. Die Arbeit wurde bisher 52-mal zitiert (Crossref) und nennt 131 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Hung Vuong University, Polish Minister of Science and Higher Education, Tan Trao University.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Human activity recognition (HAR) is an important research problem in computer vision. This problem is widely applied to building applications in human–machine interactions, monitoring, etc. Especially, HAR based on the human skeleton creates intuitive applications. Therefore, determining the current results of these studies is very important in selecting solutions and developing commercial products. In this paper, we perform a full survey on using deep learning to recognize human activity based on three-dimensional (3D) human skeleton data as input. Our research is based on four types of deep learning networks for activity recognition based on extracted feature vectors: Recurrent Neural Network (RNN) using extracted activity sequence features; Convolutional Neural Network (CNN) uses feature vectors extracted based on the projection of the skeleton into the image space; Graph Convolution Network (GCN) uses features extracted from the skeleton graph and the temporal–spatial function of the skeleton; Hybrid Deep Neural Network (Hybrid–DNN) uses many other types of features in combination. Our survey research is fully implemented from models, databases, metrics, and results from 2019 to March 2023, and they are presented in ascending order of time. In particular, we also carried out a comparative study on HAR based on a 3D human skeleton on the KLHA3D 102 and KLYOGA3D datasets. At the same time, we performed analysis and discussed the obtained results when applying CNN-based, GCN-based, and Hybrid–DNN-based deep learning networks.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Deep LearningHumansNeural Networks, ComputerDatabases, FactualHuman ActivitiesSkeleton

Stichwörter der Autor:innen

3D human pose/skeletonKLHA3D 102 datasetKLYoga3D datasetconvolutional neural networks (CNN)deep neural networksgraph convolution networks (GCN)human activity recognitionrecurrent neural networks (RNN)

Autor:innen und Institutionen

  • Faculty of Engineering Technology, Hung Vuong University, Viet Tri City 35100, Vietnam.
  • Department of Intelligent Computer Systems, Czestochowa University of Technology, 42-218 Czestochowa, Poland.
  • Faculty of Basic Science, Tan Trao University, Tuyen Quang City 22000, Vietnam.

ORCID-Profile: Hung-Cuong Nguyen, Rafał Scherer, Van-Hung Le

Förderung

  • Hung Vuong University
  • Polish Minister of Science and Higher Education
  • Tan Trao University

Zitieren

APA

Nguyen, H. C., Nguyen, T. H., Scherer, R., & Le, V. H. (2023). Deep Learning for Human Activity Recognition on 3D Human Skeleton: Survey and Comparative Study. Sensors, 23(11), 5121. https://doi.org/10.3390/s23115121

Vancouver

Nguyen HC, Nguyen TH, Scherer R, Le VH. Deep Learning for Human Activity Recognition on 3D Human Skeleton: Survey and Comparative Study. Sensors. 2023;23(11):5121. doi:10.3390/s23115121

BibTeX
@article{Nguyen2023,
  author = {Nguyen, Hung-Cuong and Nguyen, Thi-Hao and Scherer, Rafał and Le, Van-Hung},
  title = {Deep Learning for Human Activity Recognition on 3D Human Skeleton: Survey and Comparative Study},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {11},
  pages = {5121},
  doi = {10.3390/s23115121}
}
Kostenlos starten →