EUVIMEDEUVIMED entdecken
Crossref

Safety-Aware Human-in-the-Loop Reinforcement Learning With Shared Control for Autonomous Driving

Wenhui Huang, Haochen Liu, Zhiyu Huang, Chen Lv

IEEE Transactions on Intelligent Transportation Systems · 2024-11 · 25 (11) · 16181-16192

DOI: 10.1109/tits.2024.3420959 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2024-11. Verfasst von Wenhui Huang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 57-mal zitiert (Crossref) und nennt 50 Literaturangaben. Gefördert von: Agency for Science, Technology and Research (A*STAR), Singapore, under the MTC Individual Research, ANR-NRF Joint, Ministry of Education (MOE), Singapore, under the Tier 2.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The learning from intervention (LfI) approach has been proven effective in improving the performance of RL algorithms; nevertheless, existing methodologies in this domain tend to operate under the assumption that human guidance is invariably devoid of risk, thereby possibly leading to oscillations or even divergence in RL training as a result of improper demonstrations. In this paper, we propose a safety-aware human-in-the-loop reinforcement learning (SafeHIL-RL) approach to bridge the abovementioned gap. We first present a safety assessment module based on the artificial potential field (APF) model that incorporates dynamic information of the environment under the Frenet coordinate system, which we call the Frenet-based dynamic potential field (FDPF), for evaluating the real-time safety throughout the intervention process. Subsequently, we propose a curriculum guidance mechanism inspired by the pedagogical principle of whole-to-part patterns in human education. The curriculum guidance facilitates the RL agent’s early acquisition of comprehensive global information through continual guidance while also allowing for fine-tuning local behavior through intermittent human guidance through a human-AI shared control strategy. Consequently, our approach enables a safe, robust, and efficient reinforcement learning process independent of the quality of guidance human participants provide. The proposed method is validated in two highway autonomous driving scenarios under highly dynamic traffic flows (https://github.com/OscarHuangWind/Safe-Human-in-the-Loop-RL). The experiments’ results confirm the superiority and generalization capability of our approach when compared to other state-of-the-art (SOTA) baselines, as well as the effectiveness of the curriculum guidance.

Förderung

  • Agency for Science, Technology and Research (A*STAR), Singapore, under the MTC Individual Research
  • ANR-NRF Joint
  • Ministry of Education (MOE), Singapore, under the Tier 2

Zitieren

APA

Huang, W., Liu, H., Huang, Z., & Lv, C. (2024). Safety-Aware Human-in-the-Loop Reinforcement Learning With Shared Control for Autonomous Driving. IEEE Transactions on Intelligent Transportation Systems, 25(11), 16181-16192. https://doi.org/10.1109/tits.2024.3420959

Vancouver

Huang W, Liu H, Huang Z, Lv C. Safety-Aware Human-in-the-Loop Reinforcement Learning With Shared Control for Autonomous Driving. IEEE Transactions on Intelligent Transportation Systems. 2024;25(11):16181-16192. doi:10.1109/tits.2024.3420959

BibTeX
@article{Huang2024,
  author = {Huang, Wenhui and Liu, Haochen and Huang, Zhiyu and Lv, Chen},
  title = {Safety-Aware Human-in-the-Loop Reinforcement Learning With Shared Control for Autonomous Driving},
  journal = {IEEE Transactions on Intelligent Transportation Systems},
  year = {2024},
  volume = {25},
  number = {11},
  pages = {16181--16192},
  doi = {10.1109/tits.2024.3420959}
}
Kostenlos starten →