A Bilevel Reinforcement Learning Framework for Coordinated EV Charging and Dynamic Pricing
Energies · 17.07.2026 · 19 (14) · 3393
DOI: 10.3390/en19143393 ↗Kurz gefasst
Fachartikel in der Zeitschrift Energies, online erschienen am 17.07.2026. Verfasst von Dimitrios G. Vamvakas und 2 weiteren Autor:innen. Die Arbeit nennt 63 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Commission.
Abstract (Originalsprache)
This paper presents a bilevel Reinforcement Learning (RL) framework for optimizing Electric Vehicle (EV) charging through price-mediated coordination between grid operators and charging stations. Unlike prior work relying on direct control or manual subgoal engineering, the proposed approach uses dynamic pricing as an implicit coordination signal to address a complex multi-objective optimization problem involving grid stability, user satisfaction, and economic efficiency. To manage this complexity, the problem is decomposed into two levels comprised of an upper-level Distribution System Operator (DSO) that determines dynamic pricing strategies, and multiple lower-level Load Aggregators (LAs) responsible for EV charging decisions at individual stations in response to these prices. This bilevel structure captures the leader–follower interaction between DSOs and LAs, with each level operating at different temporal scales. Deep Deterministic Policy Gradient (DDPG) agents are deployed at both levels, enabling adaptive decision-making under operational constraints. Extensive simulations compare the framework against multiple Rule-Based Control (RBC) baselines. Results demonstrate that the DDPG-based DSO achieves a 42.4% higher mean reward and 19.1% higher profit compared to the best-performing RBC baseline, while preserving grid stability and user satisfaction. These results validate the effectiveness of bilevel RL for complex energy optimization problems, highlighting its potential as a scalable control paradigm for smart management systems.
Förderung
- European Commission
Zitieren
APA
Vamvakas, D. G., Korkas, C. D., & Kosmatopoulos, E. B. (2026). A Bilevel Reinforcement Learning Framework for Coordinated EV Charging and Dynamic Pricing. Energies, 19(14), 3393. https://doi.org/10.3390/en19143393
Vancouver
Vamvakas DG, Korkas CD, Kosmatopoulos EB. A Bilevel Reinforcement Learning Framework for Coordinated EV Charging and Dynamic Pricing. Energies. 2026;19(14):3393. doi:10.3390/en19143393
BibTeX
@article{Vamvakas2026,
author = {Vamvakas, Dimitrios G. and Korkas, Christos D. and Kosmatopoulos, Elias B.},
title = {A Bilevel Reinforcement Learning Framework for Coordinated EV Charging and Dynamic Pricing},
journal = {Energies},
year = {2026},
volume = {19},
number = {14},
pages = {3393},
doi = {10.3390/en19143393}
}
EUVIMED