Operator Rebinding for Stream Processing on NUMA Machines
Software: Practice and Experience · 2026-06 · 56 (6) · 687-708
DOI: 10.1002/spe.70064 ↗Kurz gefasst
Fachartikel in der Zeitschrift Software: Practice and Experience, online erschienen am 01.04.2026. Verfasst von Xiaorui Du und 5 weiteren Autor:innen. Die Arbeit nennt 56 Literaturangaben.
Abstract (Originalsprache)
Introduction
Modern stream processing engines are increasingly deployed on high‐core‐count servers with Non‐Uniform Memory Access (NUMA) architectures, where the cost of inter‐socket memory access poses a significant challenge to achieving low latency and high throughput. Existing approaches to operator placement either rely on static assignments that degrade under workload variations or employ dynamic migrations that incur excessive overhead due to blocking synchronization or global barriers.
Methods
This paper introduces a lock‐free, NUMA‐aware operator rebinding mechanism that dynamically reallocates operator tasks across threads with minimal disruption. The mechanism uses an autonomic controller to detect imbalance in per‐thread queues and enacts rebinding via control messages and atomic updates, ensuring correctness without stalling execution. A two‐level policy is proposed, combining NUMA‐level partitioning with intra‐node thread‐level refinements, triggered by latency thresholds.
Results
Extensive experiments using a 300‐query urban traffic analytics workload demonstrate that the proposed method achieves non‐negligible throughput improvement and reduces latency compared to state‐of‐the‐art static and METIS‐based approaches. Furthermore, it reduces latency variance by an order of magnitude, illustrating the importance of fine‐grained NUMA‐aware scheduling in memory‐bound stream processing.
Zitieren
APA
Du, X., Piccione, A., Pimpini, A., Bortoli, S., Pellegrini, A., & Knoll, A. (2026). Operator Rebinding for Stream Processing on NUMA Machines. Software: Practice and Experience, 56(6), 687-708. https://doi.org/10.1002/spe.70064
Vancouver
Du X, Piccione A, Pimpini A, Bortoli S, Pellegrini A, Knoll A. Operator Rebinding for Stream Processing on NUMA Machines. Software: Practice and Experience. 2026;56(6):687-708. doi:10.1002/spe.70064
BibTeX
@article{Du2026,
author = {Du, Xiaorui and Piccione, Andrea and Pimpini, Adriano and Bortoli, Stefano and Pellegrini, Alessandro and Knoll, Alois},
title = {Operator Rebinding for Stream Processing on NUMA Machines},
journal = {Software: Practice and Experience},
year = {2026},
volume = {56},
number = {6},
pages = {687--708},
doi = {10.1002/spe.70064}
}
EUVIMED