A hierarchical framework for improving ride comfort of autonomous vehicles via deep reinforcement learning with external knowledge
Computer-Aided Civil and Infrastructure Engineering · 2023-05 · 38 (8) · 1059-1078
DOI: 10.1111/mice.12934 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computer-Aided Civil and Infrastructure Engineering, 2023-05. Verfasst von Yuchuan Du und 4 weiteren Autor:innen. Die Arbeit wurde bisher 84-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Key Research and Development Program of China.
Abstract (Originalsprache)
Ride comfort plays an important role in determining the public acceptance of autonomous vehicles (AVs). Many factors, such as road profile, driving speed, and suspension system, influence the ride comfort of AVs. This study proposes a hierarchical framework for improving ride comfort by integrating speed planning and suspension control in a vehicle‐to‐everything environment. Based on safe, comfortable, and efficient speed planning via dynamic programming, a deep reinforcement learning‐based suspension control is proposed to adapt to the changing pavement conditions. Specifically, a deep deterministic policy gradient with external knowledge (EK‐DDPG) algorithm is designed for the efficient self‐adaptation of suspension control strategies. The external knowledge of action selection and value estimation from other AVs are combined into the loss functions of the DDPG algorithm. In numerical experiments, real‐world pavements detected in 11 districts of Shanghai, China, are applied to verify the proposed method. Experimental results demonstrate that the EK‐DDPG‐based suspension control improves ride comfort on untrained rough pavements by 27.95% and 3.32%, compared to a model predictive control (MPC) baseline and a DDPG baseline, respectively. Meanwhile, the EK‐DDPG‐based suspension control improves computational efficiency by 22.97%, compared to the MPC baseline, and performs at the same level as the DDPD baseline. This study provides a generalized and computationally efficient approach for improving the ride comfort of AVs.
Förderung
- National Key Research and Development Program of China
Zitieren
APA
Du, Y., Chen, J., Zhao, C., Liao, F., & Zhu, M. (2023). A hierarchical framework for improving ride comfort of autonomous vehicles via deep reinforcement learning with external knowledge. Computer-Aided Civil and Infrastructure Engineering, 38(8), 1059-1078. https://doi.org/10.1111/mice.12934
Vancouver
Du Y, Chen J, Zhao C, Liao F, Zhu M. A hierarchical framework for improving ride comfort of autonomous vehicles via deep reinforcement learning with external knowledge. Computer-Aided Civil and Infrastructure Engineering. 2023;38(8):1059-1078. doi:10.1111/mice.12934
BibTeX
@article{Du2023,
author = {Du, Yuchuan and Chen, Jing and Zhao, Cong and Liao, Feixiong and Zhu, Meixin},
title = {A hierarchical framework for improving ride comfort of autonomous vehicles via deep reinforcement learning with external knowledge},
journal = {Computer-Aided Civil and Infrastructure Engineering},
year = {2023},
volume = {38},
number = {8},
pages = {1059--1078},
doi = {10.1111/mice.12934}
}
EUVIMED