EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Reinforcement-Learning-Based Hierarchical Resilience-Oriented Microgrid Energy Management

Shushan Qiu, Kaushik Rajashekara

Energies · 27.10.2026 · 19 (21) · 5108

DOI: 10.3390/en19215108 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Energies, online erschienen am 27.10.2026. Verfasst von Shushan Qiu und 1 weiteren Autor:innen. Die Arbeit nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Sandia National Laboratories.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Microgrid energy management must reconcile economic operation with operational resilience under supply-loss contingencies and power fluctuations. Economically efficient schedules may leave insufficient dynamic capability to contain severe frequency excursions following emergency islanding or generator trips. This paper proposes a reinforcement-learning-based hierarchical energy-management framework that couples resilience-oriented day-ahead scheduling with forecast-informed real-time dynamic support. The day-ahead layer jointly optimizes generation, battery energy storage, utility exchange, and baseline dynamic-support capability subject to post-contingency frequency-security constraints. Building upon this baseline, the real-time layer adaptively coordinates the virtual inertia and damping of grid-forming battery converters using local measurements, short-horizon load forecasts, and available device capability. Soft actor–critic (SAC) serves as the common continuous-action learning algorithm across both hierarchical layers. Case studies show that the proposed framework maintains the prescribed frequency-security requirements across the evaluated supply-loss contingencies, battery-health conditions, and fast and sustained load variations. The day-ahead SAC costs differ from the optimization reference by less than 0.4% in both operating modes, while the maximum measured software-side supervisory computation remains below 0.3 s over the tested real-time cases. These results demonstrate that dynamic frequency-support capability can be preventively allocated through scheduling and adaptively deployed as operating conditions evolve.

Förderung

  • Sandia National Laboratories

Zitieren

APA

Qiu, S., & Rajashekara, K. (2026). Reinforcement-Learning-Based Hierarchical Resilience-Oriented Microgrid Energy Management. Energies, 19(21), 5108. https://doi.org/10.3390/en19215108

Vancouver

Qiu S, Rajashekara K. Reinforcement-Learning-Based Hierarchical Resilience-Oriented Microgrid Energy Management. Energies. 2026;19(21):5108. doi:10.3390/en19215108

BibTeX
@article{Qiu2026,
  author = {Qiu, Shushan and Rajashekara, Kaushik},
  title = {Reinforcement-Learning-Based Hierarchical Resilience-Oriented Microgrid Energy Management},
  journal = {Energies},
  year = {2026},
  volume = {19},
  number = {21},
  pages = {5108},
  doi = {10.3390/en19215108}
}
Kostenlos starten →