Text–image multimodal fusion model for enhanced fake news detection
Science Progress · 2024-10 · 107 (4)
DOI: 10.1177/00368504241292685 ↗Kurz gefasst
Fachartikel in der Zeitschrift Science Progress, online erschienen am 23.10.2024. Verfasst von Szu-Yin Lin und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Management Science, National Yang Ming Chiao Tung University, Hsinchu. Die Arbeit wurde bisher 26-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: National Science and Technology Council.
Abstract (Originalsprache)
In the era of rapid internet expansion and technological progress, discerning real from fake news poses a growing challenge, exposing users to potential misinformation. The existing literature primarily focuses on analyzing individual features in fake news, overlooking multimodal feature fusion recognition. Compared to single-modal approaches, multimodal fusion allows for a more comprehensive and enriched capture of information from different data modalities (such as text and images), thereby improving the performance and effectiveness of the model. This study proposes a model using multimodal fusion to identify fake news, aiming to curb misinformation. The framework integrates textual and visual information, using early fusion, joint fusion and late fusion strategies to combine them. The proposed framework processes textual and visual information through data cleaning and feature extraction before classification. Fake news classification is accomplished through a model, achieving accuracy of 85% and 90% in the Gossipcop and Fakeddit datasets, with F1-scores of 90% and 88%, showcasing its performance. The study presents outcomes across different training periods, demonstrating the effectiveness of multimodal fusion in combining text and image recognition for combating fake news. This research contributes significantly to addressing the critical issue of misinformation, emphasizing a comprehensive approach for detection accuracy enhancement.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Management Science, National Yang Ming Chiao Tung University, Hsinchu.
- Department of Information Management, Chung Hua University, Hsinchu.
- Department of Computer Science and Information Engineering, National Ilan University, Yilan.
- University of Roehampton, London, UK.
ORCID-Profile: Yen-Chiu Chen
Förderung
- National Science and Technology Council
Zitieren
APA
Lin, S. Y., Chen, Y. C., Chang, Y. H., Lo, S. H., & Chao, K. M. (2024). Text–image multimodal fusion model for enhanced fake news detection. Science Progress, 107(4). https://doi.org/10.1177/00368504241292685
Vancouver
Lin SY, Chen YC, Chang YH, Lo SH, Chao KM. Text–image multimodal fusion model for enhanced fake news detection. Science Progress. 2024;107(4). doi:10.1177/00368504241292685
BibTeX
@article{Lin2024,
author = {Lin, Szu-Yin and Chen, Yen-Chiu and Chang, Yu-Han and Lo, Shih-Hsin and Chao, Kuo-Ming},
title = {Text–image multimodal fusion model for enhanced fake news detection},
journal = {Science Progress},
year = {2024},
volume = {107},
number = {4},
doi = {10.1177/00368504241292685}
}
EUVIMED