EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

A hierarchical framework for improving ride comfort of autonomous vehicles via deep reinforcement learning with external knowledge

Yuchuan Du, Jing Chen, Cong Zhao, Feixiong Liao, Meixin Zhu

Computer-Aided Civil and Infrastructure Engineering · 2023-05 · 38 (8) · 1059-1078

DOI: 10.1111/mice.12934 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computer-Aided Civil and Infrastructure Engineering, 2023-05. Verfasst von Yuchuan Du und 4 weiteren Autor:innen. Die Arbeit wurde bisher 84-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Key Research and Development Program of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Ride comfort plays an important role in determining the public acceptance of autonomous vehicles (AVs). Many factors, such as road profile, driving speed, and suspension system, influence the ride comfort of AVs. This study proposes a hierarchical framework for improving ride comfort by integrating speed planning and suspension control in a vehicle‐to‐everything environment. Based on safe, comfortable, and efficient speed planning via dynamic programming, a deep reinforcement learning‐based suspension control is proposed to adapt to the changing pavement conditions. Specifically, a deep deterministic policy gradient with external knowledge (EK‐DDPG) algorithm is designed for the efficient self‐adaptation of suspension control strategies. The external knowledge of action selection and value estimation from other AVs are combined into the loss functions of the DDPG algorithm. In numerical experiments, real‐world pavements detected in 11 districts of Shanghai, China, are applied to verify the proposed method. Experimental results demonstrate that the EK‐DDPG‐based suspension control improves ride comfort on untrained rough pavements by 27.95% and 3.32%, compared to a model predictive control (MPC) baseline and a DDPG baseline, respectively. Meanwhile, the EK‐DDPG‐based suspension control improves computational efficiency by 22.97%, compared to the MPC baseline, and performs at the same level as the DDPD baseline. This study provides a generalized and computationally efficient approach for improving the ride comfort of AVs.

Förderung

  • National Key Research and Development Program of China

Zitieren

APA

Du, Y., Chen, J., Zhao, C., Liao, F., & Zhu, M. (2023). A hierarchical framework for improving ride comfort of autonomous vehicles via deep reinforcement learning with external knowledge. Computer-Aided Civil and Infrastructure Engineering, 38(8), 1059-1078. https://doi.org/10.1111/mice.12934

Vancouver

Du Y, Chen J, Zhao C, Liao F, Zhu M. A hierarchical framework for improving ride comfort of autonomous vehicles via deep reinforcement learning with external knowledge. Computer-Aided Civil and Infrastructure Engineering. 2023;38(8):1059-1078. doi:10.1111/mice.12934

BibTeX
@article{Du2023,
  author = {Du, Yuchuan and Chen, Jing and Zhao, Cong and Liao, Feixiong and Zhu, Meixin},
  title = {A hierarchical framework for improving ride comfort of autonomous vehicles via deep reinforcement learning with external knowledge},
  journal = {Computer-Aided Civil and Infrastructure Engineering},
  year = {2023},
  volume = {38},
  number = {8},
  pages = {1059--1078},
  doi = {10.1111/mice.12934}
}
Kostenlos starten →