EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Knowledge Distillation on Graphs: A Survey

Yijun Tian, Shichao Pei, Xiangliang Zhang, Chuxu Zhang, Nitesh V. Chawla

ACM Computing Surveys · 31.08.2025 · 57 (8) · 1-16

DOI: 10.1145/3711121 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 05.03.2025. Verfasst von Yijun Tian und 4 weiteren Autor:innen. Die Arbeit wurde bisher 68-mal zitiert (Crossref) und nennt 89 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Graph Neural Networks (GNNs) have received significant attention for demonstrating their capability to handle graph data. However, they are difficult to be deployed in resource-limited devices because of model sizes and scalability constraints imposed by the multi-hop data dependency. In addition, real-world graphs usually possess complex structural information and features. Therefore, to improve the applicability of GNNs and fully encode the complicated topological information, Knowledge Distillation on Graphs (KDG) has been introduced to build a smaller but effective model, leading to model compression and performance improvement. Recently, KDG has achieved considerable progress, with many studies proposed. In this survey, we systematically review these works. Specifically, we first introduce the challenges and bases of KDG, then categorize and summarize the existing work of KDG by answering the following three questions: (1) what to distillate, (2) who to whom, and (3) how to distillate. We offer in-depth comparisons and elucidate the strengths and weaknesses of each design. Finally, we share our thoughts on future research directions.

Zitieren

APA

Tian, Y., Pei, S., Zhang, X., Zhang, C., & Chawla, N. V. (2025). Knowledge Distillation on Graphs: A Survey. ACM Computing Surveys, 57(8), 1-16. https://doi.org/10.1145/3711121

Vancouver

Tian Y, Pei S, Zhang X, Zhang C, Chawla NV. Knowledge Distillation on Graphs: A Survey. ACM Computing Surveys. 2025;57(8):1-16. doi:10.1145/3711121

BibTeX
@article{Tian2025,
  author = {Tian, Yijun and Pei, Shichao and Zhang, Xiangliang and Zhang, Chuxu and Chawla, Nitesh V.},
  title = {Knowledge Distillation on Graphs: A Survey},
  journal = {ACM Computing Surveys},
  year = {2025},
  volume = {57},
  number = {8},
  pages = {1--16},
  doi = {10.1145/3711121}
}
Kostenlos starten →