MGI: A Communication Framework for Data Processing in Massive GPU Infrastructures
Proceedings of the VLDB Endowment · 01.05.2026 · 19 (9) · 2262-2275
DOI: 10.14778/3819518.3819549 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the VLDB Endowment, online erschienen am 19.08.2026. Verfasst von Di Wu und 4 weiteren Autor:innen. Die Arbeit nennt 72 Literaturangaben.
Abstract (Originalsprache)
This paper presents MGI, a general communication framework for performing data processing tasks in massive GPU infrastructures. Inter-GPU data transfer performance is crucial to multi-GPU data processing, and existing solutions repeatedly implement the same set of communication optimizations. MGI identifies these techniques and applies them judiciously behind a simple interface. Enabling MGI are (1) a central controller that models relevant hardware resources as an annotated graph and automates infrastructure-level optimizations to construct transfer plans and (2) a scalable data plane where buffers and executors are carefully designed to incorporate device- and link-level optimizations to execute data transfers efficiently. Our experiments on a variety of GPU infrastructures and workloads show that MGI significantly improves multi-GPU data processing performance compared to existing frameworks.
Zitieren
APA
Wu, D., Tan, H., Yang, H., He, B., & Zhang, Q. (2026). MGI: A Communication Framework for Data Processing in Massive GPU Infrastructures. Proceedings of the VLDB Endowment, 19(9), 2262-2275. https://doi.org/10.14778/3819518.3819549
Vancouver
Wu D, Tan H, Yang H, He B, Zhang Q. MGI: A Communication Framework for Data Processing in Massive GPU Infrastructures. Proceedings of the VLDB Endowment. 2026;19(9):2262-2275. doi:10.14778/3819518.3819549
BibTeX
@article{Wu2026,
author = {Wu, Di and Tan, Hongshi and Yang, Hanzhang and He, Bingsheng and Zhang, Qizhen},
title = {MGI: A Communication Framework for Data Processing in Massive GPU Infrastructures},
journal = {Proceedings of the VLDB Endowment},
year = {2026},
volume = {19},
number = {9},
pages = {2262--2275},
doi = {10.14778/3819518.3819549}
}
EUVIMED