EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Fine-Tuning BERT for Automated News Classification

Mohammed I. Salih, Salim M. Mohammed, Asaad Kh. Ibrahim, Omar M. Ahmed, Lailan M. Haji

Engineering, Technology & Applied Science Research · 04.06.2025 · 15 (3) · 22953-22959

DOI: 10.48084/etasr.10625 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Engineering, Technology & Applied Science Research, online erschienen am 04.06.2025. Verfasst von Mohammed I. Salih und 4 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Text classification is a fundamental task in Natural Language Processing (NLP) with a wide range of applications such as sentiment analysis, document classification and content recommendation. Traditional approaches like Naive Bayes (NB), Support Vector Machine (SVM) and Random Forest (RF) relied on feature engineering but lacked contextual understanding. Deep learning came into the picture for text classification with transformer models such as Bidirectional Encoder Representations from Transformers (BERT), which could understand contextual words bidirectionally. In this article, we utilize a pre-trained BERT model fine-tuned on the Reuters-21578 dataset to classify news articles. We aim to measure the performance of transfer learning against common machine learning models and non-fine-tuned BERT. The fine-tuned model achieves 91.77% accuracy, which significantly outperforms the non-fine-tuned BERT, and performs better than classical classifiers such as NB, SVM and RF. The results show that fine-tuning allows BERT to contextualize domain-specific intricacies, resulting in improved classification performance. We also address the computational trade-offs associated with transformer models, highlighting the need for optimal methods for deployment. Thus, this study further enables the use of fine-tuned BERT in automatic news classification and is of significant value for information retrieval and content personalization.

Zitieren

APA

Salih, M. I., Mohammed, S. M., Ibrahim, A. K., Ahmed, O. M., & Haji, L. M. (2025). Fine-Tuning BERT for Automated News Classification. Engineering, Technology & Applied Science Research, 15(3), 22953-22959. https://doi.org/10.48084/etasr.10625

Vancouver

Salih MI, Mohammed SM, Ibrahim AK, Ahmed OM, Haji LM. Fine-Tuning BERT for Automated News Classification. Engineering, Technology & Applied Science Research. 2025;15(3):22953-22959. doi:10.48084/etasr.10625

BibTeX
@article{Salih2025,
  author = {Salih, Mohammed I. and Mohammed, Salim M. and Ibrahim, Asaad Kh. and Ahmed, Omar M. and Haji, Lailan M.},
  title = {Fine-Tuning BERT for Automated News Classification},
  journal = {Engineering, Technology & Applied Science Research},
  year = {2025},
  volume = {15},
  number = {3},
  pages = {22953--22959},
  doi = {10.48084/etasr.10625}
}
Kostenlos starten →