EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

PGR‐Net: A Pedestrian Gesture Recognition Model for Effective AV‐Human Interactions in Autonomous Vehicles

Alif Rizqullah Mahdi, Mahdi Rezaei, Natasha Merat

IET Intelligent Transport Systems · 2026-01 · 20 (1)

DOI: 10.1049/itr2.70197 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IET Intelligent Transport Systems, online erschienen am 16.03.2026. Verfasst von Alif Rizqullah Mahdi und 2 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Autonomous vehicles (AVs) and advanced driver assistance systems (ADAS) continue to advance, yet effective social coordination with human road users (HRUs) remains a key challenge. This study introduces the PGR‐Net model, a spatiotemporal deep learning (DL) approach for pedestrian gesture recognition (PGR) to bridge the gap in AV‐pedestrian communication. We created the PGR‐Net v1.0 dataset by remapping Jester gesture labels to AV‐relevant classes: Stop, Go, and Greeting/Thanking. Furthermore, a No Gesture class is defined via a sequential hand‐presence rule. The PGR‐Net fuses an R(2+1)D, a three‐dimensional convolutional neural network (3D‐CNN) architecture, and a spatiotemporal stream with hand‐pose landmarks, followed by recurrent neural network (RNN) encoders and self‐attention layers to emphasise gesture‐relevant frames. On the PGR‐Net v1.0 dataset, the PGR‐Netv2 achieves 88.29% accuracy and an absolute 12.56% improvement from the baseline R(2+1)D model. Qualitative tests on single images beyond the dataset indicate sensible generalisation and highlight the importance of short spatiotemporal context for PGR. These results suggest that hand‐augmented spatiotemporal modelling is a viable path toward a robust and AV‐relevant PGR for various traffic scenarios. We discuss current limitations due to the limited availability of PGR‐specific datasets and outline directions for broader in‐the‐wild data and context‐aware modelling to improve applicability.

Zitieren

APA

Mahdi, A. R., Rezaei, M., & Merat, N. (2026). PGR‐Net: A Pedestrian Gesture Recognition Model for Effective AV‐Human Interactions in Autonomous Vehicles. IET Intelligent Transport Systems, 20(1). https://doi.org/10.1049/itr2.70197

Vancouver

Mahdi AR, Rezaei M, Merat N. PGR‐Net: A Pedestrian Gesture Recognition Model for Effective AV‐Human Interactions in Autonomous Vehicles. IET Intelligent Transport Systems. 2026;20(1). doi:10.1049/itr2.70197

BibTeX
@article{Mahdi2026,
  author = {Mahdi, Alif Rizqullah and Rezaei, Mahdi and Merat, Natasha},
  title = {PGR‐Net: A Pedestrian Gesture Recognition Model for Effective AV‐Human Interactions in Autonomous Vehicles},
  journal = {IET Intelligent Transport Systems},
  year = {2026},
  volume = {20},
  number = {1},
  doi = {10.1049/itr2.70197}
}
Kostenlos starten →