Reinforcement Learning vs. Computational Intelligence: Comparing Service Management Approaches for the Cloud Continuum
Future Internet · 31.10.2023 · 15 (11) · 359
DOI: 10.3390/fi15110359 ↗Kurz gefasst
Fachartikel in der Zeitschrift Future Internet, online erschienen am 31.10.2023. Verfasst von Filippo Poltronieri und 3 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 75 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Italian Research Center on High-Performance Computing, Big Data and Quantum Computing (ICSC).
Abstract (Originalsprache)
Modern computing environments, thanks to the advent of enabling technologies such as Multi-access Edge Computing (MEC), effectively represent a Cloud Continuum, a capillary network of computing resources that extend from the Edge of the network to the Cloud, which enables a dynamic and adaptive service fabric. Efficiently coordinating resource allocation, exploitation, and management in the Cloud Continuum represents quite a challenge, which has stimulated researchers to investigate innovative solutions based on smart techniques such as Reinforcement Learning and Computational Intelligence. In this paper, we make a comparison of different optimization algorithms and a first investigation of how they can perform in this kind of scenario. Specifically, this comparison included the Deep Q-Network, Proximal Policy Optimization, Genetic Algorithms, Particle Swarm Optimization, Quantum-inspired Particle Swarm Optimization, Multi-Swarm Particle Optimization, and the Grey-Wolf Optimizer. We demonstrate how all approaches can solve the service management problem with similar performance—with a different sample efficiency—if a high number of samples can be evaluated for training and optimization. Finally, we show that, if the scenario conditions change, Deep-Reinforcement-Learning-based approaches can exploit the experience built during training to adapt service allocation according to the modified conditions.
Förderung
- Italian Research Center on High-Performance Computing, Big Data and Quantum Computing (ICSC)
Zitieren
APA
Poltronieri, F., Stefanelli, C., Tortonesi, M., & Zaccarini, M. (2023). Reinforcement Learning vs. Computational Intelligence: Comparing Service Management Approaches for the Cloud Continuum. Future Internet, 15(11), 359. https://doi.org/10.3390/fi15110359
Vancouver
Poltronieri F, Stefanelli C, Tortonesi M, Zaccarini M. Reinforcement Learning vs. Computational Intelligence: Comparing Service Management Approaches for the Cloud Continuum. Future Internet. 2023;15(11):359. doi:10.3390/fi15110359
BibTeX
@article{Poltronieri2023,
author = {Poltronieri, Filippo and Stefanelli, Cesare and Tortonesi, Mauro and Zaccarini, Mattia},
title = {Reinforcement Learning vs. Computational Intelligence: Comparing Service Management Approaches for the Cloud Continuum},
journal = {Future Internet},
year = {2023},
volume = {15},
number = {11},
pages = {359},
doi = {10.3390/fi15110359}
}
EUVIMED