EUVIMEDEUVIMED entdecken
Crossref

Long- and Short-Term Constraint-Driven Safe Reinforcement Learning for Autonomous Driving

Xuemin Hu, Pan Chen, Yijun Wen, Bo Tang, Long Chen

IEEE Transactions on Systems, Man, and Cybernetics: Systems · 2026-03 · 56 (3) · 2076-2088

DOI: 10.1109/tsmc.2025.3648508 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2026-03. Verfasst von Xuemin Hu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 62 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Hubei Province in China, Original Exploration Seed Project of Hubei University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Safe reinforcement learning (RL) is developed to handle high-risk decision-making tasks, such as autonomous driving (AD), by constraining expected safety violation costs as a training objective. However, existing safe RL methods only consider the long-term objective but ignore the short-term state safety of exploration in the training process. In addition, it is difficult to achieve a balance between cost and return expectations, leading to deterioration of learning performance. Unlike these methods, we propose a novel algorithm named long- and short-term constraints (LSTCs) for safe RL. The short-term constraint is proposed to enhance the short-term state safety that the vehicle explores, while the long-term constraint enhances the overall safety of the vehicle throughout the decision-making process, both of which are jointly used to enhance vehicle safety in the training process. Furthermore, we develop a safe RL method with dual-constraint optimization based on the Lagrange multiplier to optimize the training process for end-to-end AD, balancing the cost and return expectations. Comprehensive experiments were conducted on the MetaDrive simulator. The experimental results demonstrate that the success rate increases by 13% and the episode cost decreases by 0.26 compared to the best results of the comparative methods, showing that the proposed method has better safety in continuous control tasks and exhibits a higher exploration performance in long-distance decision-making tasks compared to SOTA methods.

Förderung

  • National Natural Science Foundation of China
  • Natural Science Foundation of Hubei Province in China
  • Original Exploration Seed Project of Hubei University

Zitieren

APA

Hu, X., Chen, P., Wen, Y., Tang, B., & Chen, L. (2026). Long- and Short-Term Constraint-Driven Safe Reinforcement Learning for Autonomous Driving. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 56(3), 2076-2088. https://doi.org/10.1109/tsmc.2025.3648508

Vancouver

Hu X, Chen P, Wen Y, Tang B, Chen L. Long- and Short-Term Constraint-Driven Safe Reinforcement Learning for Autonomous Driving. IEEE Transactions on Systems, Man, and Cybernetics: Systems. 2026;56(3):2076-2088. doi:10.1109/tsmc.2025.3648508

BibTeX
@article{Hu2026,
  author = {Hu, Xuemin and Chen, Pan and Wen, Yijun and Tang, Bo and Chen, Long},
  title = {Long- and Short-Term Constraint-Driven Safe Reinforcement Learning for Autonomous Driving},
  journal = {IEEE Transactions on Systems, Man, and Cybernetics: Systems},
  year = {2026},
  volume = {56},
  number = {3},
  pages = {2076--2088},
  doi = {10.1109/tsmc.2025.3648508}
}
Kostenlos starten →