EUVIMEDEUVIMED entdecken
Crossref

MMFusion: Query-Guided Cross-Fusion for Robust Multimodal Knowledge Graph Completion

Mingze Han, Shuang Liu, Jiana Meng

IEEE Signal Processing Letters · 2026 · 33 · 2355-2359

DOI: 10.1109/lsp.2026.3683330 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Signal Processing Letters, 2026. Verfasst von Mingze Han und 2 weiteren Autor:innen. Die Arbeit nennt 23 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal knowledge graph completion enriches link prediction by combining structured triples with auxiliary modalities such as text and images, but existing solutions often rely on relation-insensitive fusion and are brittle under instance-level modality noise, leading to weak alignment between entity evidence and relational semantics. We propose MMFusion, a unified reasoning framework with three key designs. First, Relation-Guided Entity Transformation (RGET) constructs relation-conditioned entity views within each modality to enhance entity–relation compatibility. Second, Adaptive Modality Gating (AMG) performs instance-level gating across structural, visual, and textual signals to suppress noisy modalities and improve fusion robustness. Finally, Query-Guided Cross-modal Fusion (QCF) builds a unified relation-conditioned query via dual-stream attention between entity and relation modalities, enabling deep cross-modal alignment for link prediction. Extensive experiments on four public multimodal knowledge graph datasets show that MMFusion consistently outperforms strong baselines, especially in sparse and noisy settings.

Zitieren

APA

Han, M., Liu, S., & Meng, J. (2026). MMFusion: Query-Guided Cross-Fusion for Robust Multimodal Knowledge Graph Completion. IEEE Signal Processing Letters, 33, 2355-2359. https://doi.org/10.1109/lsp.2026.3683330

Vancouver

Han M, Liu S, Meng J. MMFusion: Query-Guided Cross-Fusion for Robust Multimodal Knowledge Graph Completion. IEEE Signal Processing Letters. 2026;33:2355-2359. doi:10.1109/lsp.2026.3683330

BibTeX
@article{Han2026,
  author = {Han, Mingze and Liu, Shuang and Meng, Jiana},
  title = {MMFusion: Query-Guided Cross-Fusion for Robust Multimodal Knowledge Graph Completion},
  journal = {IEEE Signal Processing Letters},
  year = {2026},
  volume = {33},
  pages = {2355--2359},
  doi = {10.1109/lsp.2026.3683330}
}
Kostenlos starten →