EUVIMEDEUVIMED entdecken
Crossref

Early Detection of Gestures using Context-and-Gap-aware Predictive Pose Framework

Nishant Bhattacharya, Suresh Sundaram

World Scientific Annual Review of Artificial Intelligence · 2023

DOI: 10.1142/s2811032322500023 ↗

Kurz gefasst

Fachartikel in der Zeitschrift World Scientific Annual Review of Artificial Intelligence, 2023. Verfasst von Nishant Bhattacharya und 1 weiteren Autor:innen. Die Arbeit nennt 36 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With a growing interest in autonomous vehicles’ operation, there is an equally increasing need for efficient anticipatory gesture recognition systems for human-vehicle interaction. Existing gesture recognition algorithms have been primarily restricted to historical data. In this paper, we propose a novel Context-and-Gap-aware Pose Prediction Framework (CGAP2), which predicts the future pose data for anticipatory recognition of gestures in an online fashion. CGAP2 implements an encoder–decoder architecture paired with a pose prediction module to anticipate future frames followed by a shallow classifier. CGAP2’s pose prediction module uses 3D convolutional layers and is dependent on the number of pose frames supplied, the time difference between subsequent pose frames, and the number of predicted pose frames. The performance of CGAP2 is evaluated on the Human3.6M dataset with the MPJPE metric. For the pose prediction of 15 frames in advance, an error of 79 mm is achieved. The pose prediction module consists of only 26M parameters and can run at 50 FPS on the NVIDIA TITAN RTX. CGAP2 has a 1-s time advantage compared to other gesture recognition systems, which can be crucial for autonomous vehicles. Furthermore, this work formalizes the problem of anticipatory gesture recognition by introducing two hyper-parameters namely context and gap and a relationship is established between the two using carefully designed experiments in ablation testing. As per our knowledge, this work is the first to tackle all the challenges faced by anticipatory gesture recognition and also the first to post a performance benchmark on Human3.6M dataset.

Zitieren

APA

Bhattacharya, N., & Sundaram, S. (2023). Early Detection of Gestures using Context-and-Gap-aware Predictive Pose Framework. World Scientific Annual Review of Artificial Intelligence. https://doi.org/10.1142/s2811032322500023

Vancouver

Bhattacharya N, Sundaram S. Early Detection of Gestures using Context-and-Gap-aware Predictive Pose Framework. World Scientific Annual Review of Artificial Intelligence. 2023. doi:10.1142/s2811032322500023

BibTeX
@article{Bhattacharya2023,
  author = {Bhattacharya, Nishant and Sundaram, Suresh},
  title = {Early Detection of Gestures using Context-and-Gap-aware Predictive Pose Framework},
  journal = {World Scientific Annual Review of Artificial Intelligence},
  year = {2023},
  doi = {10.1142/s2811032322500023}
}
Kostenlos starten →