Knowledge Distillation on Graphs: A Survey
ACM Computing Surveys · 31.08.2025 · 57 (8) · 1-16
DOI: 10.1145/3711121 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 05.03.2025. Verfasst von Yijun Tian und 4 weiteren Autor:innen. Die Arbeit wurde bisher 68-mal zitiert (Crossref) und nennt 89 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Graph Neural Networks (GNNs) have received significant attention for demonstrating their capability to handle graph data. However, they are difficult to be deployed in resource-limited devices because of model sizes and scalability constraints imposed by the multi-hop data dependency. In addition, real-world graphs usually possess complex structural information and features. Therefore, to improve the applicability of GNNs and fully encode the complicated topological information, Knowledge Distillation on Graphs (KDG) has been introduced to build a smaller but effective model, leading to model compression and performance improvement. Recently, KDG has achieved considerable progress, with many studies proposed. In this survey, we systematically review these works. Specifically, we first introduce the challenges and bases of KDG, then categorize and summarize the existing work of KDG by answering the following three questions: (1) what to distillate, (2) who to whom, and (3) how to distillate. We offer in-depth comparisons and elucidate the strengths and weaknesses of each design. Finally, we share our thoughts on future research directions.
Zitieren
APA
Tian, Y., Pei, S., Zhang, X., Zhang, C., & Chawla, N. V. (2025). Knowledge Distillation on Graphs: A Survey. ACM Computing Surveys, 57(8), 1-16. https://doi.org/10.1145/3711121
Vancouver
Tian Y, Pei S, Zhang X, Zhang C, Chawla NV. Knowledge Distillation on Graphs: A Survey. ACM Computing Surveys. 2025;57(8):1-16. doi:10.1145/3711121
BibTeX
@article{Tian2025,
author = {Tian, Yijun and Pei, Shichao and Zhang, Xiangliang and Zhang, Chuxu and Chawla, Nitesh V.},
title = {Knowledge Distillation on Graphs: A Survey},
journal = {ACM Computing Surveys},
year = {2025},
volume = {57},
number = {8},
pages = {1--16},
doi = {10.1145/3711121}
}
EUVIMED