Enhancing Virtual Inertia Control in Microgrid Clusters: A Novel Frequency Response Model Based on Deep Reinforcement Learning
Applied Sciences · 03.07.2026 · 16 (13) · 6685
DOI: 10.3390/app16136685 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 03.07.2026. Verfasst von Adrián Criollo und 5 weiteren Autor:innen. Die Arbeit nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministerio de Ciencia, Innovación y Universidades.
Abstract (Originalsprache)
Traditional control strategies, such as droop-frequency and PI controllers, often show limited adaptability when the system operates under highly variable renewable generation and load conditions. In order to overcome this limitation, this study proposes the design and simulation of a clustered microgrid supported by reinforcement learning (RL)-based virtual inertia control. Three continuous-control RL algorithms were evaluated: Deep Deterministic Policy Gradient (DDPG), Twin-Delayed Deep Deterministic Policy Gradient (TD3), and Soft Actor-Critic (SAC). The SAC agent provided the most robust training performance, reaching stable convergence after approximately 400 episodes and a final reward close to 86 units after 600 episodes. DDPG presented the second-best behavior, whereas TD3 achieved the lowest final reward, approximately 43 units. The proposed Agent SAC-Reinforcement Learning control was tested on a two-area microgrid cluster, which demonstrated greater frequency stability. Results indicate a frequency nadir of 59.82 Hz and ROCOF of 0.1484 Hz/s, with 6.78% nadir deviation improvement and 37.23% ROCOF reduction compared to PID-based strategies.
Förderung
- Ministerio de Ciencia, Innovación y Universidades
Zitieren
APA
Criollo, A., Benavides, D., Arévalo-Cordero, P., Ochoa-Correa, D., Minchala-Avila, L. I., & Tostado-Véliz, M. (2026). Enhancing Virtual Inertia Control in Microgrid Clusters: A Novel Frequency Response Model Based on Deep Reinforcement Learning. Applied Sciences, 16(13), 6685. https://doi.org/10.3390/app16136685
Vancouver
Criollo A, Benavides D, Arévalo-Cordero P, Ochoa-Correa D, Minchala-Avila LI, Tostado-Véliz M. Enhancing Virtual Inertia Control in Microgrid Clusters: A Novel Frequency Response Model Based on Deep Reinforcement Learning. Applied Sciences. 2026;16(13):6685. doi:10.3390/app16136685
BibTeX
@article{Criollo2026,
author = {Criollo, Adrián and Benavides, Dario and Arévalo-Cordero, Paul and Ochoa-Correa, Danny and Minchala-Avila, Luis I. and Tostado-Véliz, Marcos},
title = {Enhancing Virtual Inertia Control in Microgrid Clusters: A Novel Frequency Response Model Based on Deep Reinforcement Learning},
journal = {Applied Sciences},
year = {2026},
volume = {16},
number = {13},
pages = {6685},
doi = {10.3390/app16136685}
}
EUVIMED