EUVIMEDEUVIMED entdecken
Crossref

Contrastive Multi-Modal Knowledge Graph Representation Learning

Quan Fang, Xiaowei Zhang, Jun Hu, Xian Wu, Changsheng Xu

IEEE Transactions on Knowledge and Data Engineering · 01.09.2023 · 35 (9) · 8983-8996

DOI: 10.1109/tkde.2022.3220625 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Knowledge and Data Engineering, erschienen am 01.09.2023. Verfasst von Quan Fang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 46-mal zitiert (Crossref) und nennt 75 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Open Research Projects of Zhejiang Lab.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Representation learning of knowledge graphs (KGs) aims to embed both entities and relations as vectors in a continuous low-dimensional space, which has facilitated various applications such as link prediction and entity retrieval. Most existing KG embedding methods focus on modeling the structured fact triples independently and ignore the multi-type relations among triples as well as the variety of data types (e.g., texts and images) associated with entities in KGs, and thus fail to capture the complex and multi-modal information that is inherently inside the entity-relation triples. In this paper, we propose a novel approach for knowledge graph embedding named Contrastive Multi-modal Graph Neural Network (CMGNN), which can encapsulate comprehensive features from multi-modal content descriptions of entities and high-order connectivity structures. Specifically, CMGNN first learns entity embeddings from multi-modal content and then contrasts encodings from multi-relational local neighbors and high-order connectivities to obtain latent representations of entities and relations simultaneously. Experimental results demonstrate that CMGNN can effectively model the multi-modalities and multi-type structures in KGs, and significantly outperforms existing state-of-the-art methods on benchmark datasets for the tasks of link prediction and entity classification.

Förderung

  • National Natural Science Foundation of China
  • Open Research Projects of Zhejiang Lab

Zitieren

APA

Fang, Q., Zhang, X., Hu, J., Wu, X., & Xu, C. (2023). Contrastive Multi-Modal Knowledge Graph Representation Learning. IEEE Transactions on Knowledge and Data Engineering, 35(9), 8983-8996. https://doi.org/10.1109/tkde.2022.3220625

Vancouver

Fang Q, Zhang X, Hu J, Wu X, Xu C. Contrastive Multi-Modal Knowledge Graph Representation Learning. IEEE Transactions on Knowledge and Data Engineering. 2023;35(9):8983-8996. doi:10.1109/tkde.2022.3220625

BibTeX
@article{Fang2023,
  author = {Fang, Quan and Zhang, Xiaowei and Hu, Jun and Wu, Xian and Xu, Changsheng},
  title = {Contrastive Multi-Modal Knowledge Graph Representation Learning},
  journal = {IEEE Transactions on Knowledge and Data Engineering},
  year = {2023},
  volume = {35},
  number = {9},
  pages = {8983--8996},
  doi = {10.1109/tkde.2022.3220625}
}
Kostenlos starten →