Generative Transformer with Knowledge-Guided Decoding for Academic Knowledge Graph Completion
Mathematics · 21.02.2023 · 11 (5) · 1073
DOI: 10.3390/math11051073 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematics, online erschienen am 21.02.2023. Verfasst von Xiangwen Liu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 55 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Academic knowledge graphs are essential resources and can be beneficial in widespread real-world applications. Most of the existing academic knowledge graphs are far from completion; thus, knowledge graph completion—the task of extending a knowledge graph with missing entities and relations—attracts many researchers. Most existing methods utilize low-dimensional embeddings to represent entities and relations and follow the discrimination paradigm for link prediction. However, discrimination approaches may suffer from the scaling issue during inference with large-scale academic knowledge graphs. In this paper, we propose a novel approach of a generative transformer with knowledge-guided decoding for academic knowledge graph completion. Specifically, we introduce generative academic knowledge graph pre-training with a transformer. Then, we propose knowledge-guided decoding, which leverages relevant knowledge in the training corpus as guidance for help. We conducted experiments on benchmark datasets for knowledge graph completion. The experimental results show that the proposed approach can achieve performance gains of 30 units of the MRR score over the baselines on the academic knowledge graph AIDA.
Zitieren
APA
Liu, X., Mao, S., Wang, X., & Bu, J. (2023). Generative Transformer with Knowledge-Guided Decoding for Academic Knowledge Graph Completion. Mathematics, 11(5), 1073. https://doi.org/10.3390/math11051073
Vancouver
Liu X, Mao S, Wang X, Bu J. Generative Transformer with Knowledge-Guided Decoding for Academic Knowledge Graph Completion. Mathematics. 2023;11(5):1073. doi:10.3390/math11051073
BibTeX
@article{Liu2023,
author = {Liu, Xiangwen and Mao, Shengyu and Wang, Xiaohan and Bu, Jiajun},
title = {Generative Transformer with Knowledge-Guided Decoding for Academic Knowledge Graph Completion},
journal = {Mathematics},
year = {2023},
volume = {11},
number = {5},
pages = {1073},
doi = {10.3390/math11051073}
}
EUVIMED