m4: A Learned Flow-level Network Backend
Proceedings of the ACM on Networking · 19.11.2026 · 4 (CoNEXT4) · 1-24
DOI: 10.1145/3856966 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Networking, online erschienen am 19.11.2026. Verfasst von Chenning Li und 7 weiteren Autor:innen. Die Arbeit nennt 61 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation, University of Washington, Jane Street.
Abstract (Originalsprache)
Distributed-application simulators need to model the completion times of individual network transfers because later computation or communication may depend on the timing of earlier completions. Packet-level simulators can model detailed queue and protocol dynamics but are too slow for application modeling. Flow-level models are scalable but inaccurate; they ignore queue buildup and transient contention effects. Existing learned network models are fast but typically are limited to preset traces rather than acting in response to dynamic application behavior. We present m4, a learned flow-level network backend that maintains state across flow arrivals and completions and returns individual completion callbacks. m4 represents the network as a stateful flow-link bipartite graph and uses dense supervision from intermediate signals to improve accuracy. We first train m4 on packet-simulator labels and evaluate on standalone simulation, where it reduces mean error by up to 57.3% versus a flow-level simulator. We then integrate m4 into SimAI, where it achieves 10.9% mean error (vs. 23.3% for the flow-level backend) while delivering a median 40.1x speedup over the packet-level backend. On an RDMA testbed, we fine-tune the checkpoint on 4-host traces and evaluate on 12-host hardware, with median application completion-time error of 15.1% vs. 31.0% for a calibrated packet-level backend and 88.4% for the flow-level backend.
Förderung
- National Science Foundation
- University of Washington
- Jane Street
Zitieren
APA
Li, C., Zabreyko, A. A., Chabra, O., Nasr-Esfahany, A., Zhao, K., Goyal, P., Alizadeh, M., & Anderson, T. (2026). m4: A Learned Flow-level Network Backend. Proceedings of the ACM on Networking, 4(CoNEXT4), 1-24. https://doi.org/10.1145/3856966
Vancouver
Li C, Zabreyko AA, Chabra O, Nasr-Esfahany A, Zhao K, Goyal P, et al. m4: A Learned Flow-level Network Backend. Proceedings of the ACM on Networking. 2026;4(CoNEXT4):1-24. doi:10.1145/3856966
BibTeX
@article{Li2026,
author = {Li, Chenning and Zabreyko, Anton A. and Chabra, Om and Nasr-Esfahany, Arash and Zhao, Kevin and Goyal, Prateesh and Alizadeh, Mohammad and Anderson, Thomas},
title = {m4: A Learned Flow-level Network Backend},
journal = {Proceedings of the ACM on Networking},
year = {2026},
volume = {4},
number = {CoNEXT4},
pages = {1--24},
doi = {10.1145/3856966}
}
EUVIMED