EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhancing Virtual Inertia Control in Microgrid Clusters: A Novel Frequency Response Model Based on Deep Reinforcement Learning

Adrián Criollo, Dario Benavides, Paul Arévalo-Cordero, Danny Ochoa-Correa, Luis I. Minchala-Avila, Marcos Tostado-Véliz

Applied Sciences · 03.07.2026 · 16 (13) · 6685

DOI: 10.3390/app16136685 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 03.07.2026. Verfasst von Adrián Criollo und 5 weiteren Autor:innen. Die Arbeit nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministerio de Ciencia, Innovación y Universidades.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Traditional control strategies, such as droop-frequency and PI controllers, often show limited adaptability when the system operates under highly variable renewable generation and load conditions. In order to overcome this limitation, this study proposes the design and simulation of a clustered microgrid supported by reinforcement learning (RL)-based virtual inertia control. Three continuous-control RL algorithms were evaluated: Deep Deterministic Policy Gradient (DDPG), Twin-Delayed Deep Deterministic Policy Gradient (TD3), and Soft Actor-Critic (SAC). The SAC agent provided the most robust training performance, reaching stable convergence after approximately 400 episodes and a final reward close to 86 units after 600 episodes. DDPG presented the second-best behavior, whereas TD3 achieved the lowest final reward, approximately 43 units. The proposed Agent SAC-Reinforcement Learning control was tested on a two-area microgrid cluster, which demonstrated greater frequency stability. Results indicate a frequency nadir of 59.82 Hz and ROCOF of 0.1484 Hz/s, with 6.78% nadir deviation improvement and 37.23% ROCOF reduction compared to PID-based strategies.

Förderung

  • Ministerio de Ciencia, Innovación y Universidades

Zitieren

APA

Criollo, A., Benavides, D., Arévalo-Cordero, P., Ochoa-Correa, D., Minchala-Avila, L. I., & Tostado-Véliz, M. (2026). Enhancing Virtual Inertia Control in Microgrid Clusters: A Novel Frequency Response Model Based on Deep Reinforcement Learning. Applied Sciences, 16(13), 6685. https://doi.org/10.3390/app16136685

Vancouver

Criollo A, Benavides D, Arévalo-Cordero P, Ochoa-Correa D, Minchala-Avila LI, Tostado-Véliz M. Enhancing Virtual Inertia Control in Microgrid Clusters: A Novel Frequency Response Model Based on Deep Reinforcement Learning. Applied Sciences. 2026;16(13):6685. doi:10.3390/app16136685

BibTeX
@article{Criollo2026,
  author = {Criollo, Adrián and Benavides, Dario and Arévalo-Cordero, Paul and Ochoa-Correa, Danny and Minchala-Avila, Luis I. and Tostado-Véliz, Marcos},
  title = {Enhancing Virtual Inertia Control in Microgrid Clusters: A Novel Frequency Response Model Based on Deep Reinforcement Learning},
  journal = {Applied Sciences},
  year = {2026},
  volume = {16},
  number = {13},
  pages = {6685},
  doi = {10.3390/app16136685}
}
Kostenlos starten →