EUVIMEDEUVIMED entdecken
Crossref

Toward Cross-IP Request Coalescing: Relocating the Fan-Out Point in Virtualized I/O

Kiseok Kim, Hyeontae Joo, Hwangnam Kim

IEEE Computer Architecture Letters · 2026-07 · 25 (2) · 444-447

DOI: 10.1109/lca.2026.3745316 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Computer Architecture Letters, 2026-07. Verfasst von Kiseok Kim und 2 weiteren Autor:innen. Die Arbeit nennt 7 Literaturangaben. Gefördert von: Korea Institute of Energy Technology Evaluation and Planning, Ministry of Climate, Energy & Environment of the Republic of Korea, National Research Foundation of Korea.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Cloud data centers rely on virtualization technologies to serve AI workloads in multi-tenant environments. With the growing scale of data-intensive AI workloads, the performance of storage I/O paths at the virtualization layer has become a critical factor. A single user request often crosses multiple IP blocks; functional units such as storage, GPU, and accelerator devices, under virtualization, fanning out into separate stack traversals between the guest and the backend. As a result, round-trip and context-switching overheads accumulate with the number of devices. In this letter, we identify that a dominant factor in this overhead lies not in the kernel-mediated I/O path alone, but in the per-device submission structure itself, which persists even in user-space, kernel-bypass storage frameworks such as SPDK. To address this, we explore a step towards cross-IP request coalescing by relocating the fan-out point from the guest to the backend. As a first instantiation, we apply this principle to block storage I/O. The guest submits a single coalesced request, and an SPDK acceleration block device (bdev) decomposes it and dispatches per-device I/O locally, so that $N$ N device requests share a single stack traversal instead of $N$ N . Evaluation in an SPDK-based virtualized environment shows that the proposed approach achieves up to 1.78× lower latency than the per-device baseline, with the benefit growing as concurrency increases.

Förderung

  • Korea Institute of Energy Technology Evaluation and Planning
  • Ministry of Climate, Energy & Environment of the Republic of Korea
  • National Research Foundation of Korea
  • Korea Government

Zitieren

APA

Kim, K., Joo, H., & Kim, H. (2026). Toward Cross-IP Request Coalescing: Relocating the Fan-Out Point in Virtualized I/O. IEEE Computer Architecture Letters, 25(2), 444-447. https://doi.org/10.1109/lca.2026.3745316

Vancouver

Kim K, Joo H, Kim H. Toward Cross-IP Request Coalescing: Relocating the Fan-Out Point in Virtualized I/O. IEEE Computer Architecture Letters. 2026;25(2):444-447. doi:10.1109/lca.2026.3745316

BibTeX
@article{Kim2026,
  author = {Kim, Kiseok and Joo, Hyeontae and Kim, Hwangnam},
  title = {Toward Cross-IP Request Coalescing: Relocating the Fan-Out Point in Virtualized I/O},
  journal = {IEEE Computer Architecture Letters},
  year = {2026},
  volume = {25},
  number = {2},
  pages = {444--447},
  doi = {10.1109/lca.2026.3745316}
}
Kostenlos starten →