EUVIMEDEUVIMED entdecken
Crossref

ARGO+: Achieving Multi-Level Scalable GNN Training on Distributed Multi-Core Platform

Yi-Chien Lin, Yuyang Chen, Sameh Gobriel, Nilesh Jain, Viktor Prasanna

IEEE Transactions on Parallel and Distributed Systems · 2026-08 · 37 (8) · 1808-1821

DOI: 10.1109/tpds.2026.3698481 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Parallel and Distributed Systems, 2026-08. Verfasst von Yi-Chien Lin und 4 weiteren Autor:innen. Die Arbeit nennt 49 Literaturangaben. Gefördert von: National Science Foundation, DEVCOM Army Research Lab, Semiconductor Research Corporation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Graph Neural Networks (GNNs) have emerged as powerful tools for learning from graph-structured data and are widely used in various applications such as traffic prediction, and Electronic Design Automation, among others. However, training GNNs on large-scale graphs with hundreds of millions of nodes and billions of edges is time-consuming, often requiring days or weeks on a single machine. While distributed GNN training across multiple machines has been explored to leverage greater computation and memory resources, existing approaches primarily focus on inter-machine scalability while overlooking intra-machine scalability across multiple cores. As a result, state-of-the-art distributed GNN training frameworks lead to severe resource underutilization and limited training performance in terms of epoch time. This work introduces ARGO+, a novel GNN system designed to achieve multi-level scalability for distributed GNN training by efficiently scaling across both inter- and intra-machine levels. ARGO+ features a two-level graph partitioning strategy, exploiting parallelisms across both graph topology and feature dimensions while minimizing communication overhead and ensuring balanced workloads. In addition, ARGO+ integrates NUMA-aware optimizations to enhance intra-node scalability, addressing inefficiencies in remote-socket data accessing. During runtime, ARGO+ adopts a two-stage parallel training scheme to further reduce communication overheads and instantiates multiple training processes to exploit computation-communication overlapping. We evaluate ARGO+ on a distributed multi-core CPU cluster consisting of 8 machines, each with a dual-socket 80-core Intel Xeon processor. Our results demonstrate that ARGO+ achieves up to 1.89× speedup compared with DistDGL, and 1.53-1.56× speedup compared with state-of-the-art distributed GNN training systems. In addition, ARGO+ is compatible with the Deep Graph Library (DGL), a widely used GNN framework, enabling seamless integration with existing GNN programs. Finally, while ARGO+ adopts various optimizations to improve scalability and training performance, these optimizations do not alter the semantics of the training algorithm; thus, the model accuracy and convergence remain consistent with the original implementation of the algorithm.

Förderung

  • National Science Foundation
  • DEVCOM Army Research Lab
  • Semiconductor Research Corporation

Zitieren

APA

Lin, Y., Chen, Y., Gobriel, S., Jain, N., & Prasanna, V. (2026). ARGO+: Achieving Multi-Level Scalable GNN Training on Distributed Multi-Core Platform. IEEE Transactions on Parallel and Distributed Systems, 37(8), 1808-1821. https://doi.org/10.1109/tpds.2026.3698481

Vancouver

Lin Y, Chen Y, Gobriel S, Jain N, Prasanna V. ARGO+: Achieving Multi-Level Scalable GNN Training on Distributed Multi-Core Platform. IEEE Transactions on Parallel and Distributed Systems. 2026;37(8):1808-1821. doi:10.1109/tpds.2026.3698481

BibTeX
@article{Lin2026,
  author = {Lin, Yi-Chien and Chen, Yuyang and Gobriel, Sameh and Jain, Nilesh and Prasanna, Viktor},
  title = {ARGO+: Achieving Multi-Level Scalable GNN Training on Distributed Multi-Core Platform},
  journal = {IEEE Transactions on Parallel and Distributed Systems},
  year = {2026},
  volume = {37},
  number = {8},
  pages = {1808--1821},
  doi = {10.1109/tpds.2026.3698481}
}
Kostenlos starten →