NAGphormer+: A Tokenized Graph Transformer With Neighborhood Augmentation for Node Classification in Large Graphs
IEEE Transactions on Big Data · 2025-08 · 11 (4) · 2085-2098
DOI: 10.1109/tbdata.2024.3524081 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Big Data, 2025-08. Verfasst von Jinsong Chen und 4 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 74 Literaturangaben. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Graph Transformers, emerging as a new architecture for graph representation learning, suffer from the quadratic complexity and can only handle graphs with at most thousands of nodes. To this end, we propose a Neighborhood Aggregation Graph Transformer (NAGphormer) that treats each node as a sequence containing a series of tokens constructed by our proposed Hop2Token module. For each node, Hop2Token aggregates the neighborhood features from different hops into different representations, producing a sequence of token vectors as one input. In this way, NAGphormer could be trained in a mini-batch manner and thus could scale to large graphs with millions of nodes. To further enhance the model's generalization, we propose NAGphormer+, an extended model of NAGphormer with a novel data augmentation method called Neighborhood Augmentation (NrAug). Based on the output of Hop2Token, NrAug simultaneously augments the features of neighborhoods from global as well as local views. In this way, NAGphormer+ can fully utilize the neighborhood information of multiple nodes, thereby undergoing more comprehensive training and improving the model's generalization capability. Extensive experiments on benchmark datasets from small to large demonstrate the superiority of NAGphormer+ against existing graph Transformers and mainstream GNNs, as well as the original NAGphormer.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Chen, J., Liu, C., Gao, K., Li, G., & He, K. (2025). NAGphormer+: A Tokenized Graph Transformer With Neighborhood Augmentation for Node Classification in Large Graphs. IEEE Transactions on Big Data, 11(4), 2085-2098. https://doi.org/10.1109/tbdata.2024.3524081
Vancouver
Chen J, Liu C, Gao K, Li G, He K. NAGphormer+: A Tokenized Graph Transformer With Neighborhood Augmentation for Node Classification in Large Graphs. IEEE Transactions on Big Data. 2025;11(4):2085-2098. doi:10.1109/tbdata.2024.3524081
BibTeX
@article{Chen2025,
author = {Chen, Jinsong and Liu, Chang and Gao, Kaiyuan and Li, Gaichao and He, Kun},
title = {NAGphormer+: A Tokenized Graph Transformer With Neighborhood Augmentation for Node Classification in Large Graphs},
journal = {IEEE Transactions on Big Data},
year = {2025},
volume = {11},
number = {4},
pages = {2085--2098},
doi = {10.1109/tbdata.2024.3524081}
}
EUVIMED