Adaptive knowledge distillation based structure-text embedding integrating for knowledge graph completion
PLOS One · 2026
DOI: 10.1371/journal.pone.0344363 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS One, 2026. Verfasst von Qingsong Li und 6 weiteren Autor:innen. Beteiligte Einrichtung: School of Artificial Intelligence, Beihang University, Beijing, China. Hauptthemen laut MEDLINE: Knowledge. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Zhongguancun Laboratory, National Natural Science Foundation of China, Beijing Natural Science Foundation.
Abstract (Originalsprache)
Knowledge graph completion (KGC) is a fundamental task for improving downstream applications like semantic search and question answering. Effective KGC requires integrating structural and description information, allowing them to complement each other’s weaknesses (e.g., long-tail issues or overlooked structural knowledge). Existing work typically integrates structural and description information at the embedding level by feeding structure embeddings into pre-trained language models (PLMs) and coupling them via attention mechanisms, which ensures the complementarity. However, as many KG entities are multi-semantic, exhibiting semantics beyond descriptions in certain triplets and making PLMs struggle to learn them, and current embedding level coupling approaches fail to transfer the entity multi-semantic knowledge learned from the structure model to PLM, the integration effect can be further improved. To alleviate above issue, we propose AKD-KGC , which aims at realizing this knowledge transfer then enhancing the integration effect by adding a teaching-learning procedure based on A daptive K nowledge D istillation during feature integration for KGC task in this work. The AKD-KGC framework integrates two features at the embedding level and use structural models to guide prediction behavior of integration model at the same time, adjusting the weight of PLM through additional supervision and enhancing its learning of entity additional semantics beyond descriptions. AKD-KGC can be applied to both transductive and inductive settings, and has achieved state-of-the-art results on a large number of datasets in both settings, demonstrating the effectiveness of our method. Our code and datasets are available at https://github.com/liqingsong1227/AKD-KGC .
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- School of Artificial Intelligence, Beihang University, Beijing, China.
- Zhongguancun Laboratory, Beijing, China.
- Key Laboratory of Mathematics Informatics Behavioral Semantics, Ministry of Education, Beijing, China.
- Advanced Innovation Center for Future Blockchain and Privacy Computing, Beihang University, Beijing, China.
- School of Mathematical Science, Beihang University, Beijing, China.
- Department of Mathematics and Computer Science, Hengshui University, Hengshui, China.
ORCID-Profile: Qingsong Li, Wei Wei
Förderung
- Zhongguancun Laboratory
- National Natural Science Foundation of China
- Beijing Natural Science Foundation
- Hebei Provincial Natural Science Foundation
- Fundamental Research Funds for the Central Universities
Zitieren
APA
Li, Q., Lv, Y., Wei, X., Li, C., Wei, L., Zhang, J., & Wei, W. (2026). Adaptive knowledge distillation based structure-text embedding integrating for knowledge graph completion. PLOS One. https://doi.org/10.1371/journal.pone.0344363
Vancouver
Li Q, Lv Y, Wei X, Li C, Wei L, Zhang J, et al. Adaptive knowledge distillation based structure-text embedding integrating for knowledge graph completion. PLOS One. 2026. doi:10.1371/journal.pone.0344363
BibTeX
@article{Li2026,
author = {Li, Qingsong and Lv, You and Wei, Xiaolong and Li, Chao and Wei, Lianqiu and Zhang, Jianguang and Wei, Wei},
title = {Adaptive knowledge distillation based structure-text embedding integrating for knowledge graph completion},
journal = {PLOS One},
year = {2026},
doi = {10.1371/journal.pone.0344363}
}
EUVIMED