EUVIMEDEUVIMED entdecken
Crossref

Online prediction-assisted safe reinforcement learning for electric vehicle charging station recommendation in dynamically coupled transportation-power systems

Qionghua Liao, Guilong Li, Jiajie Yu, Ziyuan Gu, Wei Ma

Transportation Research Part C: Emerging Technologies · 2025-07 · 176 · 105155

DOI: 10.1016/j.trc.2025.105155 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Transportation Research Part C: Emerging Technologies, 2025-07. Verfasst von Qionghua Liao und 4 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 97 Literaturangaben. Gefördert von: Hong Kong Polytechnic University, Natural Science Foundation of Jiangsu Province, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the proliferation of electric vehicles (EVs), the transportation network and power grid become increasingly interdependent and coupled via charging stations. The concomitant growth in charging demand has posed challenges for both networks, highlighting the importance of charging coordination. Existing literature largely overlooks the interactions between power grid security and traffic efficiency. In view of this, we study the en-route charging station (CS) recommendation problem for EVs in dynamically coupled transportation-power systems. The system-level objective is to maximize the overall traffic efficiency while ensuring the safety of the power grid. This problem is for the first time formulated as a constrained Markov decision process (CMDP), and an online prediction-assisted safe reinforcement learning (OP-SRL) method is proposed to learn the optimal and secure policy by extending the PPO method. To be specific, we mainly address two challenges. First, the constrained optimization problem is converted into an equivalent unconstrained optimization problem by applying the Lagrangian method. Second, to account for the uncertain long-time delay between performing CS recommendation and commencing charging, we put forward an online sequence-to-sequence (Seq2Seq) predictor for state augmentation to guide the agent in making forward-thinking decisions. Finally, we conduct comprehensive experimental studies based on the Nguyen-Dupuis network and a large-scale real-world road network, coupled with IEEE 33-bus and IEEE 69-bus distribution systems, respectively. Results demonstrate that the proposed method outperforms baselines in terms of road network efficiency, power grid safety, and EV user satisfaction. The case study on the real-world network also illustrates the applicability in the practical context.

Förderung

  • Hong Kong Polytechnic University
  • Natural Science Foundation of Jiangsu Province
  • National Natural Science Foundation of China
  • Research Grants Council, University Grants Committee

Zitieren

APA

Liao, Q., Li, G., Yu, J., Gu, Z., & Ma, W. (2025). Online prediction-assisted safe reinforcement learning for electric vehicle charging station recommendation in dynamically coupled transportation-power systems. Transportation Research Part C: Emerging Technologies, 176, 105155. https://doi.org/10.1016/j.trc.2025.105155

Vancouver

Liao Q, Li G, Yu J, Gu Z, Ma W. Online prediction-assisted safe reinforcement learning for electric vehicle charging station recommendation in dynamically coupled transportation-power systems. Transportation Research Part C: Emerging Technologies. 2025;176:105155. doi:10.1016/j.trc.2025.105155

BibTeX
@article{Liao2025,
  author = {Liao, Qionghua and Li, Guilong and Yu, Jiajie and Gu, Ziyuan and Ma, Wei},
  title = {Online prediction-assisted safe reinforcement learning for electric vehicle charging station recommendation in dynamically coupled transportation-power systems},
  journal = {Transportation Research Part C: Emerging Technologies},
  year = {2025},
  volume = {176},
  pages = {105155},
  doi = {10.1016/j.trc.2025.105155}
}
Kostenlos starten →