DiskGNN: Bridging I/O Efficiency and Model Accuracy for Out-of-Core GNN Training
Proceedings of the ACM on Management of Data · 10.02.2025 · 3 (1) · 1-27
DOI: 10.1145/3709738 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Management of Data, online erschienen am 11.02.2025. Verfasst von Renjie Liu und 7 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 73 Literaturangaben.
Abstract (Originalsprache)
Graph neural networks (GNNs) are models specialized for graph data and widely used in applications. To train GNNs on large graphs that exceed CPU memory, several systems have been designed to store data on disk and conduct out-of-core processing. However, these systems suffer from either read amplification when conducting random reads for node features that are smaller than a disk page, or degraded model accuracy by treating the graph as disconnected partitions. To close this gap, we build DiskGNN for high I/O efficiency and fast training without model accuracy degradation. The key technique is offline sampling , which decouples graph sampling from model computation . In particular, by conducting graph sampling beforehand for multiple mini-batches, DiskGNN acquires the node features that will be accessed during model computation and conducts pre-processing to pack the node features of each mini-batch contiguously on disk to avoid read amplification for computation. Given the feature access information acquired by offline sampling, DiskGNN also adopts designs including four-level feature store to fully utilize the memory hierarchy of GPU and CPU to cache hot node features and reduce disk access, batched packing to accelerate feature packing during pre-processing, and pipelined training to overlap disk access with other operations. We compare DiskGNN with state-of-the-art out-of-core GNN training systems. The results show that DiskGNN has more than 8x speedup over existing systems while matching their best model accuracy. DiskGNN is open-source at https://github.com/Liu-rj/DiskGNN.
Zitieren
APA
Liu, R., Wang, Y., Yan, X., Jiang, H., Cai, Z., Wang, M., Tang, B., & Li, J. (2025). DiskGNN: Bridging I/O Efficiency and Model Accuracy for Out-of-Core GNN Training. Proceedings of the ACM on Management of Data, 3(1), 1-27. https://doi.org/10.1145/3709738
Vancouver
Liu R, Wang Y, Yan X, Jiang H, Cai Z, Wang M, et al. DiskGNN: Bridging I/O Efficiency and Model Accuracy for Out-of-Core GNN Training. Proceedings of the ACM on Management of Data. 2025;3(1):1-27. doi:10.1145/3709738
BibTeX
@article{Liu2025,
author = {Liu, Renjie and Wang, Yichuan and Yan, Xiao and Jiang, Haitian and Cai, Zhenkun and Wang, Minjie and Tang, Bo and Li, Jinyang},
title = {DiskGNN: Bridging I/O Efficiency and Model Accuracy for Out-of-Core GNN Training},
journal = {Proceedings of the ACM on Management of Data},
year = {2025},
volume = {3},
number = {1},
pages = {1--27},
doi = {10.1145/3709738}
}
EUVIMED