Enhancing Misinformation Detection in Spanish Language with Deep Learning: BERT and RoBERTa Transformer Models
Applied Sciences · 24.10.2024 · 14 (21) · 9729
DOI: 10.3390/app14219729 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 24.10.2024. Verfasst von Yolanda Blanco-Fernández und 3 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 79 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Science and Innovation of the Government of Spain, Consellería de Educación, Ciencia, Universidades y Formación Profesional of the Xunta de Galicia.
Abstract (Originalsprache)
This paper presents an approach to identifying political fake news in Spanish using Transformer architectures. Current methodologies often overlook political news due to the lack of quality datasets, especially in Spanish. To address this, we created a synthetic dataset of 57,231 Spanish political news articles, gathered via automated web scraping and enhanced with generative large language models. This dataset is used for fine-tuning and benchmarking Transformer models like BERT and RoBERTa for fake news detection. Our fine-tuned models showed outstanding performance on this dataset, with accuracy ranging from 97.4% to 98.6%. However, testing with a smaller, independent hand-curated dataset, including statements from political leaders during Spain’s July 2023 electoral debates, revealed a performance drop to 71%. Although this suggests that the model needs additional refinements to handle the complexity and variability of real-world political discourse, achieving over 70% accuracy seems a promising result in the under-explored domain of Spanish political fake news detection.
Förderung
- Ministry of Science and Innovation of the Government of Spain
- Consellería de Educación, Ciencia, Universidades y Formación Profesional of the Xunta de Galicia
Zitieren
APA
Blanco-Fernández, Y., Otero-Vizoso, J., Gil-Solla, A., & García-Duque, J. (2024). Enhancing Misinformation Detection in Spanish Language with Deep Learning: BERT and RoBERTa Transformer Models. Applied Sciences, 14(21), 9729. https://doi.org/10.3390/app14219729
Vancouver
Blanco-Fernández Y, Otero-Vizoso J, Gil-Solla A, García-Duque J. Enhancing Misinformation Detection in Spanish Language with Deep Learning: BERT and RoBERTa Transformer Models. Applied Sciences. 2024;14(21):9729. doi:10.3390/app14219729
BibTeX
@article{BlancoFernndez2024,
author = {Blanco-Fernández, Yolanda and Otero-Vizoso, Javier and Gil-Solla, Alberto and García-Duque, Jorge},
title = {Enhancing Misinformation Detection in Spanish Language with Deep Learning: BERT and RoBERTa Transformer Models},
journal = {Applied Sciences},
year = {2024},
volume = {14},
number = {21},
pages = {9729},
doi = {10.3390/app14219729}
}
EUVIMED