Physics-Aware Reinforcement Learning for Flexibility Management in PV-Based Multi-Energy Microgrids Under Integrated Operational Constraints
Energies · 16.10.2025 · 18 (20) · 5465
DOI: 10.3390/en18205465 ↗Kurz gefasst
Fachartikel in der Zeitschrift Energies, online erschienen am 16.10.2025. Verfasst von Shimeng Dong und 5 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Science and Technology Project of State Grid Corporation of China.
Abstract (Originalsprache)
The growing penetration of photovoltaic (PV) generation in multi-energy microgrids has amplified the challenges of maintaining real-time operational efficiency, reliability, and safety under conditions of renewable variability and forecast uncertainty. Conventional rule-based or optimization-based strategies often suffer from limited adaptability, while purely data-driven reinforcement learning approaches risk violating physical feasibility constraints, leading to unsafe or economically inefficient operation. To address this challenge, this paper develops a Physics-Informed Reinforcement Learning (PIRL) framework that embeds first-order physical models and a structured feasibility projection mechanism directly into the training process of a Soft Actor–Critic (SAC) algorithm. Unlike traditional deep reinforcement learning, which explores the state–action space without physical safeguards, PIRL restricts learning trajectories to a physically admissible manifold, thereby preventing battery over-discharge, thermal discomfort, and infeasible hydrogen operation. Furthermore, differentiable penalty functions are employed to capture equipment degradation, user comfort, and cross-domain coupling, ensuring that the learned policy remains interpretable, safe, and aligned with engineering practice. The proposed approach is validated on a modified IEEE 33-bus distribution system coupled with 14 thermal zones and hydrogen facilities, representing a realistic and complex multi-energy microgrid environment. Simulation results demonstrate that PIRL reduces constraint violations by 75–90% and lowers operating costs by 25–30% compared with rule-based and DRL baselines while also achieving faster convergence and higher sample efficiency. Importantly, the trained policy generalizes effectively to out-of-distribution weather conditions without requiring retraining, highlighting the value of incorporating physical inductive biases for resilient control. Overall, this work establishes a transparent and reproducible reinforcement learning paradigm that bridges the gap between physical feasibility and data-driven adaptability, providing a scalable solution for safe, efficient, and cost-effective operation of renewable-rich multi-energy microgrids.
Förderung
- Science and Technology Project of State Grid Corporation of China
Zitieren
APA
Dong, S., Yao, W., Li, Z., Zhao, H., Zhang, Y., & Tan, Z. (2025). Physics-Aware Reinforcement Learning for Flexibility Management in PV-Based Multi-Energy Microgrids Under Integrated Operational Constraints. Energies, 18(20), 5465. https://doi.org/10.3390/en18205465
Vancouver
Dong S, Yao W, Li Z, Zhao H, Zhang Y, Tan Z. Physics-Aware Reinforcement Learning for Flexibility Management in PV-Based Multi-Energy Microgrids Under Integrated Operational Constraints. Energies. 2025;18(20):5465. doi:10.3390/en18205465
BibTeX
@article{Dong2025,
author = {Dong, Shimeng and Yao, Weifeng and Li, Zenghui and Zhao, Haiji and Zhang, Yan and Tan, Zhongfu},
title = {Physics-Aware Reinforcement Learning for Flexibility Management in PV-Based Multi-Energy Microgrids Under Integrated Operational Constraints},
journal = {Energies},
year = {2025},
volume = {18},
number = {20},
pages = {5465},
doi = {10.3390/en18205465}
}
EUVIMED