Modeling Human Driving Behavior Through Generative Adversarial Imitation Learning
IEEE Transactions on Intelligent Transportation Systems · 2023-03 · 24 (3) · 2874-2887
DOI: 10.1109/tits.2022.3227738 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2023-03. Verfasst von Raunak Bhattacharyya und 6 weiteren Autor:innen. Die Arbeit wurde bisher 142-mal zitiert (Crossref) und nennt 70 Literaturangaben.
Abstract (Originalsprache)
An open problem in autonomous vehicle safety validation is building reliable models of human driving behavior in simulation. This work presents an approach to learn neural driving policies from real world driving demonstration data. We model human driving as a sequential decision making problem that is characterized by non-linearity and stochasticity, and unknown underlying cost functions. Imitation learning is an approach for generating intelligent behavior when the cost function is unknown or difficult to specify. Building upon work in inverse reinforcement learning (IRL), Generative Adversarial Imitation Learning (GAIL) aims to provide effective imitation even for problems with large or continuous state and action spaces, such as modeling human driving. This article describes the use of GAIL for learning-based driver modeling. Because driver modeling is inherently a multi-agent problem, where the interaction between agents needs to be modeled, this paper describes a parameter-sharing extension of GAIL called PS-GAIL to tackle multi-agent driver modeling. In addition, GAIL is domain agnostic, making it difficult to encode specific knowledge relevant to driving in the learning process. This paper describes Reward Augmented Imitation Learning (RAIL), which modifies the reward signal to provide domain-specific knowledge to the agent. Finally, human demonstrations are dependent upon latent factors that may not be captured by GAIL. This paper describes Burn-InfoGAIL, which allows for disentanglement of latent variability in demonstrations. Imitation learning experiments are performed using NGSIM, a real-world highway driving dataset. Experiments show that these modifications to GAIL can successfully model highway driving behavior, accurately replicating human demonstrations and generating realistic, emergent behavior in the traffic flow arising from the interaction between driving agents.
Zitieren
APA
Bhattacharyya, R., Wulfe, B., Phillips, D. J., Kuefler, A., Morton, J., Senanayake, R., & Kochenderfer, M. J. (2023). Modeling Human Driving Behavior Through Generative Adversarial Imitation Learning. IEEE Transactions on Intelligent Transportation Systems, 24(3), 2874-2887. https://doi.org/10.1109/tits.2022.3227738
Vancouver
Bhattacharyya R, Wulfe B, Phillips DJ, Kuefler A, Morton J, Senanayake R, et al. Modeling Human Driving Behavior Through Generative Adversarial Imitation Learning. IEEE Transactions on Intelligent Transportation Systems. 2023;24(3):2874-2887. doi:10.1109/tits.2022.3227738
BibTeX
@article{Bhattacharyya2023,
author = {Bhattacharyya, Raunak and Wulfe, Blake and Phillips, Derek J. and Kuefler, Alex and Morton, Jeremy and Senanayake, Ransalu and Kochenderfer, Mykel J.},
title = {Modeling Human Driving Behavior Through Generative Adversarial Imitation Learning},
journal = {IEEE Transactions on Intelligent Transportation Systems},
year = {2023},
volume = {24},
number = {3},
pages = {2874--2887},
doi = {10.1109/tits.2022.3227738}
}
EUVIMED