EUVIMEDEUVIMED entdecken
Crossref

Operator Rebinding for Stream Processing on NUMA Machines

Xiaorui Du, Andrea Piccione, Adriano Pimpini, Stefano Bortoli, Alessandro Pellegrini, Alois Knoll

Software: Practice and Experience · 2026-06 · 56 (6) · 687-708

DOI: 10.1002/spe.70064 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Software: Practice and Experience, online erschienen am 01.04.2026. Verfasst von Xiaorui Du und 5 weiteren Autor:innen. Die Arbeit nennt 56 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

Modern stream processing engines are increasingly deployed on high‐core‐count servers with Non‐Uniform Memory Access (NUMA) architectures, where the cost of inter‐socket memory access poses a significant challenge to achieving low latency and high throughput. Existing approaches to operator placement either rely on static assignments that degrade under workload variations or employ dynamic migrations that incur excessive overhead due to blocking synchronization or global barriers.

Methods

This paper introduces a lock‐free, NUMA‐aware operator rebinding mechanism that dynamically reallocates operator tasks across threads with minimal disruption. The mechanism uses an autonomic controller to detect imbalance in per‐thread queues and enacts rebinding via control messages and atomic updates, ensuring correctness without stalling execution. A two‐level policy is proposed, combining NUMA‐level partitioning with intra‐node thread‐level refinements, triggered by latency thresholds.

Results

Extensive experiments using a 300‐query urban traffic analytics workload demonstrate that the proposed method achieves non‐negligible throughput improvement and reduces latency compared to state‐of‐the‐art static and METIS‐based approaches. Furthermore, it reduces latency variance by an order of magnitude, illustrating the importance of fine‐grained NUMA‐aware scheduling in memory‐bound stream processing.

Zitieren

APA

Du, X., Piccione, A., Pimpini, A., Bortoli, S., Pellegrini, A., & Knoll, A. (2026). Operator Rebinding for Stream Processing on NUMA Machines. Software: Practice and Experience, 56(6), 687-708. https://doi.org/10.1002/spe.70064

Vancouver

Du X, Piccione A, Pimpini A, Bortoli S, Pellegrini A, Knoll A. Operator Rebinding for Stream Processing on NUMA Machines. Software: Practice and Experience. 2026;56(6):687-708. doi:10.1002/spe.70064

BibTeX
@article{Du2026,
  author = {Du, Xiaorui and Piccione, Andrea and Pimpini, Adriano and Bortoli, Stefano and Pellegrini, Alessandro and Knoll, Alois},
  title = {Operator Rebinding for Stream Processing on NUMA Machines},
  journal = {Software: Practice and Experience},
  year = {2026},
  volume = {56},
  number = {6},
  pages = {687--708},
  doi = {10.1002/spe.70064}
}
Kostenlos starten →