EUVIMEDEUVIMED entdecken
Crossref

Battery Health-Informed and Policy-Aware Deep Reinforcement Learning for EV-Facilitated Distribution Grid Optimal Policy

Jiahang Xie, Petr Vorobev, Rufan Yang, Hung Dinh Nguyen

IEEE Transactions on Smart Grid · 2025-01 · 16 (1) · 704-717

DOI: 10.1109/tsg.2024.3460486 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Smart Grid, 2025-01. Verfasst von Jiahang Xie und 3 weiteren Autor:innen. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 44 Literaturangaben. Gefördert von: Agency for Science, Technology and Research (A*STAR), Singapore, Toyota North America.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Electric vehicles play a crucial role in modern active distribution system operation, owing to their flexibility and mobility. The joint optimization of power grid operation and EV scheduling is expected to achieve better decision-making for both power and transportation systems. However, such joint optimization can suffer from high computational complexity and a lack of information about the other system. One possible approach for the power system operator is to assume the charging/discharging pattern of the EV population and make dispatch decisions based on such estimated EV profiles. This practice results in grid-level policies. The problem arises as whether the EV population complies with and fulfills the grid-level policies is not easy to monitor. To address this issue, we further investigate and expand upon the innovative concept of grid facilitation for electric vehicles (EVs). A newly designed probabilistic incentive signal is introduced to assist in implementing grid policies. Correspondingly, we develop a deep reinforcement learning (DRL) framework for EV prosumer scheduling that effectively balances EV autonomy with the execution of grid policies. Cast as a demand response signal, the grid-level policy is capable of managing overall grid operation with the facilitation of individuals and decoupling the co-optimization of the operator and EV owner. For the DRL of the EV, the training reward considers both the EV operation cost and the grid facilitation incentive, featuring a dynamically shrinking EV battery’s feasible operation range in terms of voltages and currents, and the health-informed reward. The policy-aware reward utilizes the Jensen-Shannon divergence to quantify the gap between the actual EV power injection pattern and the system operator’s assumption. Invalid action mask tricks are integrated to prevent infeasible actions for EVs. The simulation results demonstrate the effectiveness of the proposed framework and the facilitation effect of EV on system operation planning.

Förderung

  • Agency for Science, Technology and Research (A*STAR), Singapore
  • Toyota North America

Zitieren

APA

Xie, J., Vorobev, P., Yang, R., & Nguyen, H. D. (2025). Battery Health-Informed and Policy-Aware Deep Reinforcement Learning for EV-Facilitated Distribution Grid Optimal Policy. IEEE Transactions on Smart Grid, 16(1), 704-717. https://doi.org/10.1109/tsg.2024.3460486

Vancouver

Xie J, Vorobev P, Yang R, Nguyen HD. Battery Health-Informed and Policy-Aware Deep Reinforcement Learning for EV-Facilitated Distribution Grid Optimal Policy. IEEE Transactions on Smart Grid. 2025;16(1):704-717. doi:10.1109/tsg.2024.3460486

BibTeX
@article{Xie2025,
  author = {Xie, Jiahang and Vorobev, Petr and Yang, Rufan and Nguyen, Hung Dinh},
  title = {Battery Health-Informed and Policy-Aware Deep Reinforcement Learning for EV-Facilitated Distribution Grid Optimal Policy},
  journal = {IEEE Transactions on Smart Grid},
  year = {2025},
  volume = {16},
  number = {1},
  pages = {704--717},
  doi = {10.1109/tsg.2024.3460486}
}
Kostenlos starten →