EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Flexibility Resource Services and Electricity Cost Optimization Oriented Control Strategy of Data Centers Based on Hierarchical Reinforcement Learning

Pengfei He, Rongfu Sun, Antun Pfeifer, Ge Wang, Qinzhe Liu, Neven Duić, Zhao Zhen, Fei Wang, Yunpeng Xiao

Electronics · 30.04.2026 · 15 (9) · 1901

DOI: 10.3390/electronics15091901 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 30.04.2026. Verfasst von Pengfei He und 8 weiteren Autor:innen. Die Arbeit nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: S&T Program of Hebei.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As the core of digital infrastructure, the exceptionally rapid development of data centers (DCs) faces serious challenges due to their high electricity costs. Traditional approaches treat computational task scheduling separately from different physical control mechanisms, such as server group management, overlooking the synergistic potential between the two aspects. To address this problem, this paper proposes a computational–physical collaborative optimization model that realizes spatiotemporal task migration on the computational side and adaptive parameter regulation of IT equipment and cooling devices on the physical side. In response to the lack of global coordination in conventional distributed optimization, a two-layer partially observable Markov game (POMG) is constructed to unify global cooperative decision-making and local autonomous control. On this basis, the hierarchical multi-agent deep deterministic policy gradient (H-MADDPG) algorithm is designed by introducing task priority ranking and a variable-dimension action mask mechanism, which effectively handles the discrete–continuous hybrid action space and adapts to the dynamic variation in action dimensions caused by uncertain task arrivals. Comparative experiments with various benchmark schemes are conducted to verify the effectiveness and superiority of the proposed strategy in total cost, power usage effectiveness (PUE), resource utilization, and load balancing.

Förderung

  • S&T Program of Hebei

Zitieren

APA

He, P., Sun, R., Pfeifer, A., Wang, G., Liu, Q., Duić, N., Zhen, Z., Wang, F., & Xiao, Y. (2026). Flexibility Resource Services and Electricity Cost Optimization Oriented Control Strategy of Data Centers Based on Hierarchical Reinforcement Learning. Electronics, 15(9), 1901. https://doi.org/10.3390/electronics15091901

Vancouver

He P, Sun R, Pfeifer A, Wang G, Liu Q, Duić N, et al. Flexibility Resource Services and Electricity Cost Optimization Oriented Control Strategy of Data Centers Based on Hierarchical Reinforcement Learning. Electronics. 2026;15(9):1901. doi:10.3390/electronics15091901

BibTeX
@article{He2026,
  author = {He, Pengfei and Sun, Rongfu and Pfeifer, Antun and Wang, Ge and Liu, Qinzhe and Duić, Neven and Zhen, Zhao and Wang, Fei and Xiao, Yunpeng},
  title = {Flexibility Resource Services and Electricity Cost Optimization Oriented Control Strategy of Data Centers Based on Hierarchical Reinforcement Learning},
  journal = {Electronics},
  year = {2026},
  volume = {15},
  number = {9},
  pages = {1901},
  doi = {10.3390/electronics15091901}
}
Kostenlos starten →