EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Energy and carbon-aware distributed machine learning tasks scheduling scheme for the multi-renewable energy-based edge-cloud continuum

Zicong Miao, Lei Liu, Haijing Nan, Weize Li, Xiaodong Pan, Xin Yang, Mi Yu, Hui Chen, Yiming Zhao

Science and Technology for Energy Transition · 2024 · 79 · 82

DOI: 10.2516/stet/2024076 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Science and Technology for Energy Transition, online erschienen am 15.10.2024. Verfasst von Zicong Miao und 8 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As an increasing number of Distributed Machine Learning (DML) tasks are hosted on cloud platforms in the edge-cloud continuum, Data Centers (DCs) with massive data and computational requirements have become one of the world’s largest energy consumers, leading to significant carbon emissions. Reducing energy consumption and carbon emissions is an extremely crucial and challenging issue for the sustainable development of cloud service providers. While utilizing renewable energy can help reduce the carbon emissions of DCs, the intermittent and unstable nature still causes DCs to rely heavily on high-carbon brown energy. For the resource-intensive and delay-tolerant DML tasks, this paper introduces multi-renewable energy in the geo-distributed continuum to address this issue, the spatiotemporal complementarity maximizes the renewable energy utilization and compensates for time-dependent energy differences with geographic advantages. Additionally, considering the dynamic differences in carbon intensity and electricity prices across distributed DCs in the continuum, we propose an energy and carbon-aware algorithm called ECMR for scheduling heterogeneous virtual machine creation tasks of DML among multi-clouds in different time zones. It is demonstrated that compared with the baseline methods, the ECMR significantly reduces the total power consumption, energy cost, and carbon emission of data centers while maintaining an acceptable service quality. The utilization of renewable energy in data centers has been significantly improved to 90.8% by flexibly leveraging the spatiotemporal complementarity of multi-renewable energy. Compared with existing competing algorithms, the proposed method exhibits significant improvements with an achieved average response time of 12.6 ms, and a task failure rate of 1.25%.

Zitieren

APA

Miao, Z., Liu, L., Nan, H., Li, W., Pan, X., Yang, X., Yu, M., Chen, H., & Zhao, Y. (2024). Energy and carbon-aware distributed machine learning tasks scheduling scheme for the multi-renewable energy-based edge-cloud continuum. Science and Technology for Energy Transition, 79, 82. https://doi.org/10.2516/stet/2024076

Vancouver

Miao Z, Liu L, Nan H, Li W, Pan X, Yang X, et al. Energy and carbon-aware distributed machine learning tasks scheduling scheme for the multi-renewable energy-based edge-cloud continuum. Science and Technology for Energy Transition. 2024;79:82. doi:10.2516/stet/2024076

BibTeX
@article{Miao2024,
  author = {Miao, Zicong and Liu, Lei and Nan, Haijing and Li, Weize and Pan, Xiaodong and Yang, Xin and Yu, Mi and Chen, Hui and Zhao, Yiming},
  title = {Energy and carbon-aware distributed machine learning tasks scheduling scheme for the multi-renewable energy-based edge-cloud continuum},
  journal = {Science and Technology for Energy Transition},
  year = {2024},
  volume = {79},
  pages = {82},
  doi = {10.2516/stet/2024076}
}
Kostenlos starten →