A Deep Reinforcement Learning Approach to DC-DC Power Electronic Converter Control with Practical Considerations
Energies · 21.07.2024 · 17 (14) · 3578
DOI: 10.3390/en17143578 ↗Kurz gefasst
Fachartikel in der Zeitschrift Energies, online erschienen am 21.07.2024. Verfasst von Nafiseh Mazaheri und 4 weiteren Autor:innen. Die Arbeit wurde bisher 35-mal zitiert (Crossref) und nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Spanish Ministry of Science, Innovation and Universities, Junta de Comunidades de Castilla La Mancha and the European Union.
Abstract (Originalsprache)
In recent years, there has been a growing interest in using model-free deep reinforcement learning (DRL)-based controllers as an alternative approach to improve the dynamic behavior, efficiency, and other aspects of DC–DC power electronic converters, which are traditionally controlled based on small signal models. These conventional controllers often fail to self-adapt to various uncertainties and disturbances. This paper presents a design methodology using proximal policy optimization (PPO), a widely recognized and efficient DRL algorithm, to make near-optimal decisions for real buck converters operating in both continuous conduction mode (CCM) and discontinuous conduction mode (DCM) while handling resistive and inductive loads. Challenges associated with delays in real-time systems are identified. Key innovations include a chattering-reduction reward function, engineering of input features, and optimization of neural network architecture, which improve voltage regulation, ensure smoother operation, and optimize the computational cost of the neural network. The experimental and simulation results demonstrate the robustness and efficiency of the controller in real scenarios. The findings are believed to make significant contributions to the application of DRL controllers in real-time scenarios, providing guidelines and a starting point for designing controllers using the same method in this or other power electronic converter topologies.
Förderung
- Spanish Ministry of Science, Innovation and Universities
- Junta de Comunidades de Castilla La Mancha and the European Union
Zitieren
APA
Mazaheri, N., Santamargarita, D., Bueno, E., Pizarro, D., & Cobreces, S. (2024). A Deep Reinforcement Learning Approach to DC-DC Power Electronic Converter Control with Practical Considerations. Energies, 17(14), 3578. https://doi.org/10.3390/en17143578
Vancouver
Mazaheri N, Santamargarita D, Bueno E, Pizarro D, Cobreces S. A Deep Reinforcement Learning Approach to DC-DC Power Electronic Converter Control with Practical Considerations. Energies. 2024;17(14):3578. doi:10.3390/en17143578
BibTeX
@article{Mazaheri2024,
author = {Mazaheri, Nafiseh and Santamargarita, Daniel and Bueno, Emilio and Pizarro, Daniel and Cobreces, Santiago},
title = {A Deep Reinforcement Learning Approach to DC-DC Power Electronic Converter Control with Practical Considerations},
journal = {Energies},
year = {2024},
volume = {17},
number = {14},
pages = {3578},
doi = {10.3390/en17143578}
}
EUVIMED