Safe Reinforcement Learning for Energy Management of Electrified Vehicle With Novel Physics-Informed Exploration Strategy
IEEE Transactions on Transportation Electrification · 2024-12 · 10 (4) · 9814-9828
DOI: 10.1109/tte.2024.3361462 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Transportation Electrification, 2024-12. Verfasst von Atriya Biswas und 5 weiteren Autor:innen. Die Arbeit wurde bisher 26-mal zitiert (Crossref) und nennt 52 Literaturangaben. Gefördert von: Natural Sciences and Engineering Research Council of Canada, NSERC Industrial Research Chair in Electrified Powertrains, Canada Research Chair in Transportation Electrification and Smart Mobility.
Abstract (Originalsprache)
This article introduces a novel physics-informed exploration (PIE) strategy for a deep reinforcement learning (DRL)-based energy management system (EMS), specifically targeting the challenge of dealing with constrained action sets. RL-based controllers for electrified vehicle EMS have faced obstacles stemming from the selection of infeasible actions, obstructing their practical deployment. The absence of a mechanism for assessing control action feasibility prior to application has compounded this issue, primarily due to the model-free nature of RL-based controllers. Adding a safety layer to the RL-based controller addresses the abovementioned issue, but this often results in suboptimal policies and necessitates an in-depth understanding of the powertrain. Alternatively, theoretical remedies incorporate penalty terms into the immediate reward function to manage infeasible conditions. However, this approach can slow down the training process as the agent learns to avoid infeasible actions. To surmount these challenges, this article introduces a novel PIE strategy, coupled with prioritized experience replay (PER), enabling the agent to swiftly learn to avoid selecting infeasible control actions without the need for a separate safety layer. Real-time simulation results highlight the superior performance of the proposed DRL-based controller over the baseline DRL-based controller with a safety layer, particularly in terms of overall fuel consumption (FC).
Förderung
- Natural Sciences and Engineering Research Council of Canada
- NSERC Industrial Research Chair in Electrified Powertrains
- Canada Research Chair in Transportation Electrification and Smart Mobility
Zitieren
APA
Biswas, A., Acquarone, M., Wang, H., Miretti, F., Misul, D. A., & Emadi, A. (2024). Safe Reinforcement Learning for Energy Management of Electrified Vehicle With Novel Physics-Informed Exploration Strategy. IEEE Transactions on Transportation Electrification, 10(4), 9814-9828. https://doi.org/10.1109/tte.2024.3361462
Vancouver
Biswas A, Acquarone M, Wang H, Miretti F, Misul DA, Emadi A. Safe Reinforcement Learning for Energy Management of Electrified Vehicle With Novel Physics-Informed Exploration Strategy. IEEE Transactions on Transportation Electrification. 2024;10(4):9814-9828. doi:10.1109/tte.2024.3361462
BibTeX
@article{Biswas2024,
author = {Biswas, Atriya and Acquarone, Matteo and Wang, Hao and Miretti, Federico and Misul, Daniela Anna and Emadi, Ali},
title = {Safe Reinforcement Learning for Energy Management of Electrified Vehicle With Novel Physics-Informed Exploration Strategy},
journal = {IEEE Transactions on Transportation Electrification},
year = {2024},
volume = {10},
number = {4},
pages = {9814--9828},
doi = {10.1109/tte.2024.3361462}
}
EUVIMED