A Literature Review on Multimodal Misinformation Detection with External Knowledge Augmentation
Frontiers in Computing and Intelligent Systems · 30.07.2026 · 17 (2) · 54-62
DOI: 10.54097/84s03s91 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Computing and Intelligent Systems, online erschienen am 30.07.2026. Verfasst von Ding Zhang und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Social media misinformation is increasingly presented through combinations of headlines, body text, images, comments, interaction traces, and source metadata. This shift complicates detection because a misleading post may arise not from an explicitly false sentence, but from an authentic image reused in another event, a weakly related headline, a satirical publishing context, or missing background information. Recent multimodal and vision-language models improve the joint representation of textual and visual signals, yet most of them still operate mainly on evidence contained in the sample. They therefore have limited access to factual context, entity relations, or information about the platform and source. External knowledge augmentation offers one way to address this gap by adding knowledge-graph facts, retrieved evidence, event descriptions, entity links, or source-context information. This review examines how such knowledge is represented and combined with multimodal features, with attention to commonly used datasets, fusion strategies, and evaluation practices. Particular emphasis is placed on three unresolved issues: noisy or irrelevant knowledge, leakage caused by label-bearing descriptions, and the gap between semantic alignment and genuine fact verification. The discussion is intended to clarify when external knowledge is useful and what controls are required for reliable and interpretable multimodal misinformation detection.
Zitieren
APA
Zhang, D., & Zhang, Y. (2026). A Literature Review on Multimodal Misinformation Detection with External Knowledge Augmentation. Frontiers in Computing and Intelligent Systems, 17(2), 54-62. https://doi.org/10.54097/84s03s91
Vancouver
Zhang D, Zhang Y. A Literature Review on Multimodal Misinformation Detection with External Knowledge Augmentation. Frontiers in Computing and Intelligent Systems. 2026;17(2):54-62. doi:10.54097/84s03s91
BibTeX
@article{Zhang2026,
author = {Zhang, Ding and Zhang, Yuejin},
title = {A Literature Review on Multimodal Misinformation Detection with External Knowledge Augmentation},
journal = {Frontiers in Computing and Intelligent Systems},
year = {2026},
volume = {17},
number = {2},
pages = {54--62},
doi = {10.54097/84s03s91}
}
EUVIMED