Morpheus: Lightweight RTT prediction for performance-aware load balancing
Future Generation Computer Systems · 2026-09 · 182 · 108452
DOI: 10.1016/j.future.2026.108452 ↗Kurz gefasst
Fachartikel in der Zeitschrift Future Generation Computer Systems, 2026-09. Verfasst von Panagiotis Giannakopoulos und 4 weiteren Autor:innen. Die Arbeit nennt 65 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Dutch Research Council.
Abstract (Originalsprache)
Distributed applications increasingly demand low end-to-end latency, especially in edge and cloud environments where co-located workloads contend for limited resources. Traditional load-balancing strategies are typically reactive and rely on outdated or coarse-grained metrics, often leading to suboptimal routing decisions and increased tail latencies. This paper investigates the use of round-trip time (RTT) predictors to enhance request routing by anticipating application latency. We develop lightweight and accurate RTT predictors that are trained on time-series monitoring data collected from a Kubernetes-managed GPU cluster. By leveraging a reduced set of highly correlated monitoring metrics, our approach maintains low overhead while remaining adaptable to diverse co-location scenarios and heterogeneous hardware. The predictors achieve up to 95% accuracy while keeping the prediction delay within 10% of the application RTT. In addition, we identify the minimum prediction accuracy threshold and key system-level factors required to ensure effective predictor deployment in resource-constrained clusters. Simulation-based evaluation demonstrates that performance-aware load balancing can significantly reduce application RTT and minimize resource waste. These results highlight the feasibility of integrating predictive load balancing into future production systems.
Förderung
- Dutch Research Council
Zitieren
APA
Giannakopoulos, P., Knippenberg, B. V., Joshi, K. C., Calabretta, N., & Exarchakos, G. (2026). Morpheus: Lightweight RTT prediction for performance-aware load balancing. Future Generation Computer Systems, 182, 108452. https://doi.org/10.1016/j.future.2026.108452
Vancouver
Giannakopoulos P, Knippenberg BV, Joshi KC, Calabretta N, Exarchakos G. Morpheus: Lightweight RTT prediction for performance-aware load balancing. Future Generation Computer Systems. 2026;182:108452. doi:10.1016/j.future.2026.108452
BibTeX
@article{Giannakopoulos2026,
author = {Giannakopoulos, Panagiotis and Knippenberg, Bart van and Joshi, Kishor Chandra and Calabretta, Nicola and Exarchakos, George},
title = {Morpheus: Lightweight RTT prediction for performance-aware load balancing},
journal = {Future Generation Computer Systems},
year = {2026},
volume = {182},
pages = {108452},
doi = {10.1016/j.future.2026.108452}
}
EUVIMED