Design and Hardware Implementation of CNN-GCN Model for Skeleton-Based Human Action Recognition
WSEAS TRANSACTIONS ON COMPUTER RESEARCH · 04.06.2024 · 12 · 318-327
DOI: 10.37394/232018.2024.12.31 ↗Kurz gefasst
Fachartikel in der Zeitschrift WSEAS TRANSACTIONS ON COMPUTER RESEARCH, online erschienen am 04.06.2024. Verfasst von Amine Mansouri und 3 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 31 Literaturangaben.
Abstract (Originalsprache)
Deep learning algorithms in general have shown outstanding performances on tasks involving Human Action Recognition and spatio-temporal modeling. In our ever-more interconnected world where mobile and edge devices take center stage, there is a growing need for algorithms to operate directly on embedded platforms. Field-Programmable Gate Arrays (FPGA), owing to their reprogrammable nature and low-power attributes, stand out as excellent choices for these edge computing applications. In this work, our aims are threefold. Firstly, we aim to design and develop a novel custom model that combines Convolutional Neural Networks (CNNs) and Graph Convolutional Networks (GCNs) to effectively capture spatial and temporal features from skeleton data to achieve Human Action Recognition. Secondly, we endeavor to implement this custom model onto FPGA hardware using Vitis-AI, thus exploring the potential for efficient hardware acceleration of deep learning models. Lastly, we seek to evaluate the real-time performance of the FPGA-accelerated model in comparison to CPU and GPU implementations, assessing its suitability for deployment in real-world applications requiring low-latency inference. Experimental results based on the NTU dataset demonstrate the efficiency and accuracy of our custom model compared to traditional CPU or GPU implementations.
Zitieren
APA
Mansouri, A., Elzaar, A., Madani, M., & Bakir, T. (2024). Design and Hardware Implementation of CNN-GCN Model for Skeleton-Based Human Action Recognition. WSEAS TRANSACTIONS ON COMPUTER RESEARCH, 12, 318-327. https://doi.org/10.37394/232018.2024.12.31
Vancouver
Mansouri A, Elzaar A, Madani M, Bakir T. Design and Hardware Implementation of CNN-GCN Model for Skeleton-Based Human Action Recognition. WSEAS TRANSACTIONS ON COMPUTER RESEARCH. 2024;12:318-327. doi:10.37394/232018.2024.12.31
BibTeX
@article{Mansouri2024,
author = {Mansouri, Amine and Elzaar, Abdellah and Madani, Mahdi and Bakir, Toufik},
title = {Design and Hardware Implementation of CNN-GCN Model for Skeleton-Based Human Action Recognition},
journal = {WSEAS TRANSACTIONS ON COMPUTER RESEARCH},
year = {2024},
volume = {12},
pages = {318--327},
doi = {10.37394/232018.2024.12.31}
}
EUVIMED