A Unified Training Process for Fake News Detection Based on Finetuned Bidirectional Encoder Representation from Transformers Model
Big Data · 2024
DOI: 10.1089/big.2022.0050 ↗Kurz gefasst
Fachartikel in der Zeitschrift Big Data, 2024. Verfasst von Vijay Srinivas Tida und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Computing and Informatics, University of Louisiana at Lafayette, Lafayette, Louisiana, USA. Hauptthemen laut MEDLINE: Social Media, Deception. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 54 Literaturangaben.
Abstract (Originalsprache)
An efficient fake news detector becomes essential as the accessibility of social media platforms increases rapidly. Previous studies mainly focused on designing the models solely based on individual data sets and might suffer from degradable performance. Therefore, developing a robust model for a combined data set with diverse knowledge becomes crucial. However, designing the model with a combined data set requires extensive training time and sequential workload to obtain optimal performance without having some prior knowledge about the model's parameters. The presented study here will help solve these issues by introducing the unified training strategy to have a base structure for the classifier and all hyperparameters from individual models using a pretrained transformer model. The performance of the proposed model is noted using three publicly available data sets, namely ISOT and others from the Kaggle website. The results indicate that the proposed unified training strategy surpassed the existing models such as Random Forests, convolutional neural networks, and long short-term memory, with 97% accuracy and achieved the F1 score of 0.97. Furthermore, there was a significant reduction in training time by almost 1.5 to 1.8 × by removing words lower than three letters from the input samples. We also did extensive performance analysis by varying the number of encoder blocks to build compact models and trained on the combined data set. We justify that reducing encoder blocks resulted in lower performance from the obtained results.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Computing and Informatics, University of Louisiana at Lafayette, Lafayette, Louisiana, USA.
ORCID-Profile: Vijay Srinivas Tida
Zitieren
APA
Tida, V. S., Hsu, S., & Hei, X. (2024). A Unified Training Process for Fake News Detection Based on Finetuned Bidirectional Encoder Representation from Transformers Model. Big Data. https://doi.org/10.1089/big.2022.0050
Vancouver
Tida VS, Hsu S, Hei X. A Unified Training Process for Fake News Detection Based on Finetuned Bidirectional Encoder Representation from Transformers Model. Big Data. 2024. doi:10.1089/big.2022.0050
BibTeX
@article{Tida2024,
author = {Tida, Vijay Srinivas and Hsu, Sonya and Hei, Xiali},
title = {A Unified Training Process for Fake News Detection Based on Finetuned Bidirectional Encoder Representation from Transformers Model},
journal = {Big Data},
year = {2024},
doi = {10.1089/big.2022.0050}
}
EUVIMED