EUVIMEDEUVIMED entdecken
Crossref

MGI: A Communication Framework for Data Processing in Massive GPU Infrastructures

Di Wu, Hongshi Tan, Hanzhang Yang, Bingsheng He, Qizhen Zhang

Proceedings of the VLDB Endowment · 01.05.2026 · 19 (9) · 2262-2275

DOI: 10.14778/3819518.3819549 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the VLDB Endowment, online erschienen am 19.08.2026. Verfasst von Di Wu und 4 weiteren Autor:innen. Die Arbeit nennt 72 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper presents MGI, a general communication framework for performing data processing tasks in massive GPU infrastructures. Inter-GPU data transfer performance is crucial to multi-GPU data processing, and existing solutions repeatedly implement the same set of communication optimizations. MGI identifies these techniques and applies them judiciously behind a simple interface. Enabling MGI are (1) a central controller that models relevant hardware resources as an annotated graph and automates infrastructure-level optimizations to construct transfer plans and (2) a scalable data plane where buffers and executors are carefully designed to incorporate device- and link-level optimizations to execute data transfers efficiently. Our experiments on a variety of GPU infrastructures and workloads show that MGI significantly improves multi-GPU data processing performance compared to existing frameworks.

Zitieren

APA

Wu, D., Tan, H., Yang, H., He, B., & Zhang, Q. (2026). MGI: A Communication Framework for Data Processing in Massive GPU Infrastructures. Proceedings of the VLDB Endowment, 19(9), 2262-2275. https://doi.org/10.14778/3819518.3819549

Vancouver

Wu D, Tan H, Yang H, He B, Zhang Q. MGI: A Communication Framework for Data Processing in Massive GPU Infrastructures. Proceedings of the VLDB Endowment. 2026;19(9):2262-2275. doi:10.14778/3819518.3819549

BibTeX
@article{Wu2026,
  author = {Wu, Di and Tan, Hongshi and Yang, Hanzhang and He, Bingsheng and Zhang, Qizhen},
  title = {MGI: A Communication Framework for Data Processing in Massive GPU Infrastructures},
  journal = {Proceedings of the VLDB Endowment},
  year = {2026},
  volume = {19},
  number = {9},
  pages = {2262--2275},
  doi = {10.14778/3819518.3819549}
}
Kostenlos starten →