MMFN: MLLMs-guided Multi-source Information Fusion Network for Multimodal Fake News Detection
ACM Transactions on Multimedia Computing, Communications, and Applications · 31.08.2026 · 22 (8) · 1-23
DOI: 10.1145/3820376 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 21.07.2026. Verfasst von Ruihao Zhang und 4 weiteren Autor:innen. Die Arbeit nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Shandong Province of China, Anhui Province Engineering Laboratory for Big Data Analysis and Early Warning Technology of Coal Mine Safety.
Abstract (Originalsprache)
Nowadays, the widespread of false information has brought great harm to society, thus the demand for Multimodal Fake News Detection (MFND) is becoming increasingly urgent. Currently, traditional isolated trained detectors face challenges in directly acquiring open-world facts. The advent of Multi-modal Large Language Models (MLLMs) offers one potential solution to this challenge. In this article, we first investigate the potential of MLLMs in MFND and find that: (1) their accuracy in detecting Fake News is significantly lower than traditional detectors; (2) although MLLMs can generate reasoning grounds that are highly related to human cognition, there are still some problems in their analysis process, such as missing key information and logical faults. Based on these findings, we propose that current MLLMs cannot directly replace conventional detectors but can provide them with evidence and knowledge from multiple perspectives. Based on this proposal, we design an MLLMs-guided Multi-source Information Fusion Network (MMFN) for MFND. In MLLMs, a layer-by-layer human cognitive path is simulated to provide reasoning analysis and relevant background knowledge for MFND. Simultaneously, a Fine-grained Clues Extraction (FCE) module that combines attention and uncertainty reasoning is designed to capture both similar clues and ambiguous clues. Finally, an Uncertainty-driven Adaptive Fusion Network (UAFN) is designed to adaptively mine key information and perform weighting of information at different levels. The experimental results verified on four popular fake news datasets demonstrate the superiority of our method.
Förderung
- National Natural Science Foundation of China
- Natural Science Foundation of Shandong Province of China
- Anhui Province Engineering Laboratory for Big Data Analysis and Early Warning Technology of Coal Mine Safety
- Taishan Scholar Program of Shandong Province
- SDUST Research Fund
Zitieren
APA
Zhang, R., Ji, S., Lv, J., Li, N., & Li, H. (2026). MMFN: MLLMs-guided Multi-source Information Fusion Network for Multimodal Fake News Detection. ACM Transactions on Multimedia Computing, Communications, and Applications, 22(8), 1-23. https://doi.org/10.1145/3820376
Vancouver
Zhang R, Ji S, Lv J, Li N, Li H. MMFN: MLLMs-guided Multi-source Information Fusion Network for Multimodal Fake News Detection. ACM Transactions on Multimedia Computing, Communications, and Applications. 2026;22(8):1-23. doi:10.1145/3820376
BibTeX
@article{Zhang2026,
author = {Zhang, Ruihao and Ji, Shujuan and Lv, Jiandong and Li, Ning and Li, Haojie},
title = {MMFN: MLLMs-guided Multi-source Information Fusion Network for Multimodal Fake News Detection},
journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
year = {2026},
volume = {22},
number = {8},
pages = {1--23},
doi = {10.1145/3820376}
}
EUVIMED