EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Guiding Reinforcement Learning with LLM Knowledge Reasoning Toward Safe End-to-End Autonomous Driving

Shouguan Xiao, Yeqing Dou, Yueying Zhang

Electronics · 07.11.2026 · 15 (21) · 5179

DOI: 10.3390/electronics15215179 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 07.11.2026. Verfasst von Shouguan Xiao und 2 weiteren Autor:innen. Die Arbeit nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: 2025 Henan Provincial Soft Science Research Program Project.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Traditional decision-making methods based on reinforcement learning (RL) for autonomous vehicles rely heavily on environmental interaction samples. These models learn driving policies only implicitly from data and cannot explicitly utilize traffic regulations, driving ethics, or prior human driving experience, which may lead to unsafe control behaviors. A large language model (LLM) has powerful semantic understanding and knowledge reasoning capabilities; however, its high inference latency makes it difficult to directly achieve continuous closed-loop vehicle control. To address these issues, this paper proposes a reinforcement-learning-based autonomous driving decision-making framework with LLM-based knowledge reasoning. In the knowledge reasoning module, a vision-language model (VLM) interprets visual scenes and generates natural-language scene descriptions. Structured prompts that integrate traffic regulations, driving ethics, and prior human driving experience are first constructed and subsequently fed into the LLM, which performs high-level knowledge reasoning and generates actions constrained by human-like rules. The reinforcement learning component combines expert policies with knowledge reasoning policies to iteratively update the policy and value networks. Experimental results demonstrate that the proposed framework incorporates commonsense knowledge, traffic regulations, and risk assessment into the closed-loop training process of reinforcement learning. Compared with conventional deep reinforcement learning (DRL) algorithms, the proposed framework achieves a lower collision rate and significantly fewer traffic violations, while improving decision-making safety and the task completion rate. This study provides a feasible technical pathway for empowering autonomous driving decision-making with large models.

Förderung

  • 2025 Henan Provincial Soft Science Research Program Project

Zitieren

APA

Xiao, S., Dou, Y., & Zhang, Y. (2026). Guiding Reinforcement Learning with LLM Knowledge Reasoning Toward Safe End-to-End Autonomous Driving. Electronics, 15(21), 5179. https://doi.org/10.3390/electronics15215179

Vancouver

Xiao S, Dou Y, Zhang Y. Guiding Reinforcement Learning with LLM Knowledge Reasoning Toward Safe End-to-End Autonomous Driving. Electronics. 2026;15(21):5179. doi:10.3390/electronics15215179

BibTeX
@article{Xiao2026,
  author = {Xiao, Shouguan and Dou, Yeqing and Zhang, Yueying},
  title = {Guiding Reinforcement Learning with LLM Knowledge Reasoning Toward Safe End-to-End Autonomous Driving},
  journal = {Electronics},
  year = {2026},
  volume = {15},
  number = {21},
  pages = {5179},
  doi = {10.3390/electronics15215179}
}
Kostenlos starten →