EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Comparative Study of Fine tuned BERT-based Models and RNN-Based Models. Case Study: Arabic Fake News Detection

A. Aljamel, Khalil H., Y. Aburawi

The International Journal of Engineering & Information Technology (IJEIT) · 11.08.2024 · 12 (1) · 56-64

DOI: 10.36602/ijeit.v12i1.477 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The International Journal of Engineering & Information Technology (IJEIT), online erschienen am 11.08.2024. Verfasst von A. Aljamel und 2 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large Language Models (LLMs) are advanced language models with exceptional learning capabilities. Pre‑trained LLMs have achieved the most significant performances in multiple NLP tasks. BERT is one of LLMs that can be easily fine-tuned with one or more additional output layer to create a state‑of‑the‑art model for a wide range of downstream NLP tasks. There are several BERT models which are pre-trained specifically for Arabic Language. They showed high performance results. To investigate the performance of fine-tuned Arabic BERT‑based on downstream Arabic NLP tasks, four Arabic BERT-based Models have been selected to be fine-tuned for Arabic Fake News Detection. These Arabic BERT-based models have been compared with five RNN-based architecture models that have been trained for the same downstream Arabic NLP tasks. Then, the DNNL hyper‑parameters of those models have been tuned to fit the Arabic Fake News Detection dataset and improve their performance results. For RNN-based models, two embeddings’ techniques have been applied, local dataset embeddings generator and pre-trained Arabic Word2Vec embeddings generator.

Zitieren

APA

Aljamel, A., H., K., & Aburawi, Y. (2024). Comparative Study of Fine tuned BERT-based Models and RNN-Based Models. Case Study: Arabic Fake News Detection. The International Journal of Engineering & Information Technology (IJEIT), 12(1), 56-64. https://doi.org/10.36602/ijeit.v12i1.477

Vancouver

Aljamel A, H. K, Aburawi Y. Comparative Study of Fine tuned BERT-based Models and RNN-Based Models. Case Study: Arabic Fake News Detection. The International Journal of Engineering & Information Technology (IJEIT). 2024;12(1):56-64. doi:10.36602/ijeit.v12i1.477

BibTeX
@article{Aljamel2024,
  author = {Aljamel, A. and H., Khalil and Aburawi, Y.},
  title = {Comparative Study of Fine tuned BERT-based Models and RNN-Based Models. Case Study: Arabic Fake News Detection},
  journal = {The International Journal of Engineering & Information Technology (IJEIT)},
  year = {2024},
  volume = {12},
  number = {1},
  pages = {56--64},
  doi = {10.36602/ijeit.v12i1.477}
}
Kostenlos starten →