EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

A Literature Review on Multimodal Misinformation Detection with External Knowledge Augmentation

Ding Zhang, Yuejin Zhang

Frontiers in Computing and Intelligent Systems · 30.07.2026 · 17 (2) · 54-62

DOI: 10.54097/84s03s91 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Computing and Intelligent Systems, online erschienen am 30.07.2026. Verfasst von Ding Zhang und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Social media misinformation is increasingly presented through combinations of headlines, body text, images, comments, interaction traces, and source metadata. This shift complicates detection because a misleading post may arise not from an explicitly false sentence, but from an authentic image reused in another event, a weakly related headline, a satirical publishing context, or missing background information. Recent multimodal and vision-language models improve the joint representation of textual and visual signals, yet most of them still operate mainly on evidence contained in the sample. They therefore have limited access to factual context, entity relations, or information about the platform and source. External knowledge augmentation offers one way to address this gap by adding knowledge-graph facts, retrieved evidence, event descriptions, entity links, or source-context information. This review examines how such knowledge is represented and combined with multimodal features, with attention to commonly used datasets, fusion strategies, and evaluation practices. Particular emphasis is placed on three unresolved issues: noisy or irrelevant knowledge, leakage caused by label-bearing descriptions, and the gap between semantic alignment and genuine fact verification. The discussion is intended to clarify when external knowledge is useful and what controls are required for reliable and interpretable multimodal misinformation detection.

Zitieren

APA

Zhang, D., & Zhang, Y. (2026). A Literature Review on Multimodal Misinformation Detection with External Knowledge Augmentation. Frontiers in Computing and Intelligent Systems, 17(2), 54-62. https://doi.org/10.54097/84s03s91

Vancouver

Zhang D, Zhang Y. A Literature Review on Multimodal Misinformation Detection with External Knowledge Augmentation. Frontiers in Computing and Intelligent Systems. 2026;17(2):54-62. doi:10.54097/84s03s91

BibTeX
@article{Zhang2026,
  author = {Zhang, Ding and Zhang, Yuejin},
  title = {A Literature Review on Multimodal Misinformation Detection with External Knowledge Augmentation},
  journal = {Frontiers in Computing and Intelligent Systems},
  year = {2026},
  volume = {17},
  number = {2},
  pages = {54--62},
  doi = {10.54097/84s03s91}
}
Kostenlos starten →