LEAF: Navigating Concept Drift in Cellular Networks
Proceedings of the ACM on Networking · 28.09.2023 · 1 (CoNEXT2) · 1-24
DOI: 10.1145/3609422 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Networking, online erschienen am 28.09.2023. Verfasst von Shinan Liu und 7 weiteren Autor:innen. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 65 Literaturangaben. Gefördert von: NSF, ANR, France and Chicago Collaborating in the Sciences program.
Abstract (Originalsprache)
Operational networks commonly rely on machine learning models for many tasks, including detecting anomalies, inferring application performance, and forecasting demand. Yet, model accuracy can degrade due to concept drift, whereby the relationship between the features and the target to be predicted changes. Mitigating concept drift is an essential part of operationalizing machine learning models in general, but is of particular importance in networking's highly dynamic deployment environments. In this paper, we first characterize concept drift in a large cellular network for a major metropolitan area in the United States. We find that concept drift occurs across many important key performance indicators (KPIs), independently of the model, training set size, and time interval---thus necessitating practical approaches to detect, explain, and mitigate it. We then show that frequent model retraining with newly available data is not sufficient to mitigate concept drift, and can even degrade model accuracy further. Finally, we develop a new methodology for concept drift mitigation, Local Error Approximation of Features (LEAF). LEAF works by detecting drift; explaining the features and time intervals that contribute the most to drift; and mitigates it using forgetting and over-sampling. We evaluate LEAF against industry-standard mitigation approaches (notably, periodic retraining) with more than four years of cellular KPI data. Our initial tests with a major cellular provider in the US show that LEAF consistently outperforms periodic and triggered retraining on complex, real-world data while reducing costly retraining operations.
Förderung
- NSF
- ANR
- France and Chicago Collaborating in the Sciences program
Zitieren
APA
Liu, S., Bronzino, F., Schmitt, P., Bhagoji, A. N., Feamster, N., Crespo, H. G., Coyle, T., & Ward, B. (2023). LEAF: Navigating Concept Drift in Cellular Networks. Proceedings of the ACM on Networking, 1(CoNEXT2), 1-24. https://doi.org/10.1145/3609422
Vancouver
Liu S, Bronzino F, Schmitt P, Bhagoji AN, Feamster N, Crespo HG, et al. LEAF: Navigating Concept Drift in Cellular Networks. Proceedings of the ACM on Networking. 2023;1(CoNEXT2):1-24. doi:10.1145/3609422
BibTeX
@article{Liu2023,
author = {Liu, Shinan and Bronzino, Francesco and Schmitt, Paul and Bhagoji, Arjun Nitin and Feamster, Nick and Crespo, Hector Garcia and Coyle, Timothy and Ward, Brian},
title = {LEAF: Navigating Concept Drift in Cellular Networks},
journal = {Proceedings of the ACM on Networking},
year = {2023},
volume = {1},
number = {CoNEXT2},
pages = {1--24},
doi = {10.1145/3609422}
}
EUVIMED