EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

Flexibility Resource Services and Electricity Cost Optimization Oriented Control Strategy of Data Centers Based on Hierarchical Reinforcement Learning

Pengfei He, Rongfu Sun, Antun Pfeifer, Ge Wang, Qinzhe Liu, Neven Duić, Zhao Zhen, Fei Wang, Yunpeng Xiao

Electronics · 2026-04-30 · 15 (9) · 1901

DOI: 10.3390/electronics15091901 ↗

At a glance

Journal article in Electronics, published online on 2026-04-30. Written by Pengfei He and 8 co-authors. 45 references. The full text is freely available (open access, CC BY 4.0). Funded by: S&T Program of Hebei.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

As the core of digital infrastructure, the exceptionally rapid development of data centers (DCs) faces serious challenges due to their high electricity costs. Traditional approaches treat computational task scheduling separately from different physical control mechanisms, such as server group management, overlooking the synergistic potential between the two aspects. To address this problem, this paper proposes a computational–physical collaborative optimization model that realizes spatiotemporal task migration on the computational side and adaptive parameter regulation of IT equipment and cooling devices on the physical side. In response to the lack of global coordination in conventional distributed optimization, a two-layer partially observable Markov game (POMG) is constructed to unify global cooperative decision-making and local autonomous control. On this basis, the hierarchical multi-agent deep deterministic policy gradient (H-MADDPG) algorithm is designed by introducing task priority ranking and a variable-dimension action mask mechanism, which effectively handles the discrete–continuous hybrid action space and adapts to the dynamic variation in action dimensions caused by uncertain task arrivals. Comparative experiments with various benchmark schemes are conducted to verify the effectiveness and superiority of the proposed strategy in total cost, power usage effectiveness (PUE), resource utilization, and load balancing.

Funding

  • S&T Program of Hebei

Cite

APA

He, P., Sun, R., Pfeifer, A., Wang, G., Liu, Q., Duić, N., Zhen, Z., Wang, F., & Xiao, Y. (2026). Flexibility Resource Services and Electricity Cost Optimization Oriented Control Strategy of Data Centers Based on Hierarchical Reinforcement Learning. Electronics, 15(9), 1901. https://doi.org/10.3390/electronics15091901

Vancouver

He P, Sun R, Pfeifer A, Wang G, Liu Q, Duić N, et al. Flexibility Resource Services and Electricity Cost Optimization Oriented Control Strategy of Data Centers Based on Hierarchical Reinforcement Learning. Electronics. 2026;15(9):1901. doi:10.3390/electronics15091901

BibTeX
@article{He2026,
  author = {He, Pengfei and Sun, Rongfu and Pfeifer, Antun and Wang, Ge and Liu, Qinzhe and Duić, Neven and Zhen, Zhao and Wang, Fei and Xiao, Yunpeng},
  title = {Flexibility Resource Services and Electricity Cost Optimization Oriented Control Strategy of Data Centers Based on Hierarchical Reinforcement Learning},
  journal = {Electronics},
  year = {2026},
  volume = {15},
  number = {9},
  pages = {1901},
  doi = {10.3390/electronics15091901}
}
Start for free →