EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

RT-SCNNs: real-time spiking convolutional neural networks for a novel hand gesture recognition using time-domain mm-wave radar data

Ahmed Shaaban, Maximilian Strobel, Wolfgang Furtner, Robert Weigel, Fabian Lurz

International Journal of Microwave and Wireless Technologies · 2024-06 · 16 (5) · 783-795

DOI: 10.1017/s1759078723001575 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Microwave and Wireless Technologies, online erschienen am 09.01.2024. Verfasst von Ahmed Shaaban und 4 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study introduces a novel approach to radar-based hand gesture recognition (HGR), addressing the challenges of energy efficiency and reliability by employing real-time gesture recognition at the frame level. Our solution bypasses the computationally expensive preprocessing steps, such as 2D fast Fourier transforms (FFTs), traditionally employed for range-Doppler information generation. Instead, we capitalize on time-domain radar data and harness the energy-efficient capabilities of spiking neural networks (SNNs) models, recognized for their sparsity and spikes-based communication, thus optimizing the overall energy efficiency of our proposed solution. Experimental results affirm the effectiveness of our approach, showcasing significant classification accuracy on the test dataset, with peak performance achieving a mean accuracy of 99.75%. To further validate the reliability of our solution, individuals who have not participated in the dataset collection conduct real-time live testing, demonstrating the consistency of our theoretical findings. Real-time inference reveals a substantial degree of spikes sparsity, ranging from 75% to 97%, depending on the presence or absence of a performed gesture. By eliminating the computational burden of preprocessing steps and leveraging the power of (SNNs), our solution presents a promising alternative that enhances the performance and usability of radar-based (HGR) systems.

Zitieren

APA

Shaaban, A., Strobel, M., Furtner, W., Weigel, R., & Lurz, F. (2024). RT-SCNNs: real-time spiking convolutional neural networks for a novel hand gesture recognition using time-domain mm-wave radar data. International Journal of Microwave and Wireless Technologies, 16(5), 783-795. https://doi.org/10.1017/s1759078723001575

Vancouver

Shaaban A, Strobel M, Furtner W, Weigel R, Lurz F. RT-SCNNs: real-time spiking convolutional neural networks for a novel hand gesture recognition using time-domain mm-wave radar data. International Journal of Microwave and Wireless Technologies. 2024;16(5):783-795. doi:10.1017/s1759078723001575

BibTeX
@article{Shaaban2024,
  author = {Shaaban, Ahmed and Strobel, Maximilian and Furtner, Wolfgang and Weigel, Robert and Lurz, Fabian},
  title = {RT-SCNNs: real-time spiking convolutional neural networks for a novel hand gesture recognition using time-domain mm-wave radar data},
  journal = {International Journal of Microwave and Wireless Technologies},
  year = {2024},
  volume = {16},
  number = {5},
  pages = {783--795},
  doi = {10.1017/s1759078723001575}
}
Kostenlos starten →