Structure-enhanced pre-trained language model for requirement-cyber threat intelligence knowledge graph completion
PeerJ Computer Science · 20.05.2026 · 12 · e3879
DOI: 10.7717/peerj-cs.3879 ↗Kurz gefasst
Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 20.05.2026. Verfasst von Yiqin Lu und 4 weiteren Autor:innen. Die Arbeit nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China, Research and Development Program in Key Areas of Guangdong Province, China.
Abstract (Originalsprache)
Critical Information Infrastructures (CIIs) underpin a nation’s socio-economic systems and are increasingly targeted by sophisticated cyberattacks. Current models often fail to capture the dynamic interplay between CII management strategies and evolving cyber threats, resulting in defensive measures that lag behind attack developments. To bridge this gap, we propose Requirement–Cyber Threat Intelligence Knowledge Graph Plus (RCTI+), an enhanced knowledge graph that integrates cyber threat intelligence (CTI) with cybersecurity management requirements into a heterogeneous attributed graph, which explicitly characterizes the relationships between management strategies and CTI. To conduct reasoning over RCTI+, we introduce Structure-Enhanced BERT (SeBert), a structure-enhanced pre-trained language model (PLM) with a dual-stage framework: (1) Graph Neural Networks (GNNs) extract structural representations, and (2) a PLM encodes textual attributes while capturing the mutual information between semantic and structural features. This hybrid approach produces rich contextual embeddings that capture both semantic content and topological structure. Extensive experiments on RCTI+, FB15k-237, and WN18RR demonstrate that SeBert achieves state-of-the-art performance and exhibits strong generalization across datasets. The RCTI+ is publicly available at: https://github.com/weiyongyy/RCTI-plus .
Förderung
- National Key Research and Development Program of China
- Research and Development Program in Key Areas of Guangdong Province, China
Zitieren
APA
Lu, Y., Zhang, Y., Qin, J., Chen, J., & Mao, Z. (2026). Structure-enhanced pre-trained language model for requirement-cyber threat intelligence knowledge graph completion. PeerJ Computer Science, 12, e3879. https://doi.org/10.7717/peerj-cs.3879
Vancouver
Lu Y, Zhang Y, Qin J, Chen J, Mao Z. Structure-enhanced pre-trained language model for requirement-cyber threat intelligence knowledge graph completion. PeerJ Computer Science. 2026;12:e3879. doi:10.7717/peerj-cs.3879
BibTeX
@article{Lu2026,
author = {Lu, Yiqin and Zhang, Yang and Qin, Jiancheng and Chen, Jiarui and Mao, Zhongshu},
title = {Structure-enhanced pre-trained language model for requirement-cyber threat intelligence knowledge graph completion},
journal = {PeerJ Computer Science},
year = {2026},
volume = {12},
pages = {e3879},
doi = {10.7717/peerj-cs.3879}
}
EUVIMED