EUVIMEDEUVIMED entdecken
Crossref

Tesla-Rapture: A Lightweight Gesture Recognition System From mmWave Radar Sparse Point Clouds

Dariush Salami, Ramin Hasibi, Sameera Palipana, Petar Popovski, Tom Michoel, Stephan Sigg

IEEE Transactions on Mobile Computing · 01.08.2023 · 22 (8) · 4946-4960

DOI: 10.1109/tmc.2022.3153717 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, erschienen am 01.08.2023. Verfasst von Dariush Salami und 5 weiteren Autor:innen. Die Arbeit wurde bisher 87-mal zitiert (Crossref) und nennt 68 Literaturangaben. Gefördert von: ITN WindMill.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We present Tesla-Rapture, a gesture recognition system for sparse point clouds generated by mmWave Radars. State of the art gesture recognition models are either too resource consuming or not sufficiently accurate for the integration into real-life scenarios using wearable or constrained equipment such as IoT devices (e.g., Raspberry PI), XR hardware (e.g., HoloLens), or smart-phones. To tackle this issue, we have developed Tesla, a Message Passing Neural Network (MPNN) graph convolution approach for mmWave radar point clouds. The model outperforms the state of the art on three datasets in terms of accuracy while reducing the computational complexity and, hence, the execution time. In particular, the approach, is able to predict a gesture almost 8 times faster than the most accurate competitor. Our performance evaluation in different scenarios (environments, angles, distances) shows that Tesla generalizes well and improves the accuracy up to 20% in challenging scenarios, such as a through-wall setting and sensing at extreme angles. Utilizing Tesla, we develop Tesla-Rapture, a real-time implementation using a mmWave Radar on a Raspberry PI 4 and evaluate its accuracy and time-complexity. We also publish the source code, the trained models, and the implementation of the model for embedded devices.

Förderung

  • ITN WindMill

Zitieren

APA

Salami, D., Hasibi, R., Palipana, S., Popovski, P., Michoel, T., & Sigg, S. (2023). Tesla-Rapture: A Lightweight Gesture Recognition System From mmWave Radar Sparse Point Clouds. IEEE Transactions on Mobile Computing, 22(8), 4946-4960. https://doi.org/10.1109/tmc.2022.3153717

Vancouver

Salami D, Hasibi R, Palipana S, Popovski P, Michoel T, Sigg S. Tesla-Rapture: A Lightweight Gesture Recognition System From mmWave Radar Sparse Point Clouds. IEEE Transactions on Mobile Computing. 2023;22(8):4946-4960. doi:10.1109/tmc.2022.3153717

BibTeX
@article{Salami2023,
  author = {Salami, Dariush and Hasibi, Ramin and Palipana, Sameera and Popovski, Petar and Michoel, Tom and Sigg, Stephan},
  title = {Tesla-Rapture: A Lightweight Gesture Recognition System From mmWave Radar Sparse Point Clouds},
  journal = {IEEE Transactions on Mobile Computing},
  year = {2023},
  volume = {22},
  number = {8},
  pages = {4946--4960},
  doi = {10.1109/tmc.2022.3153717}
}
Kostenlos starten →