Fine-Tuning BERT for Automated News Classification
Engineering, Technology & Applied Science Research · 04.06.2025 · 15 (3) · 22953-22959
DOI: 10.48084/etasr.10625 ↗Kurz gefasst
Fachartikel in der Zeitschrift Engineering, Technology & Applied Science Research, online erschienen am 04.06.2025. Verfasst von Mohammed I. Salih und 4 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Text classification is a fundamental task in Natural Language Processing (NLP) with a wide range of applications such as sentiment analysis, document classification and content recommendation. Traditional approaches like Naive Bayes (NB), Support Vector Machine (SVM) and Random Forest (RF) relied on feature engineering but lacked contextual understanding. Deep learning came into the picture for text classification with transformer models such as Bidirectional Encoder Representations from Transformers (BERT), which could understand contextual words bidirectionally. In this article, we utilize a pre-trained BERT model fine-tuned on the Reuters-21578 dataset to classify news articles. We aim to measure the performance of transfer learning against common machine learning models and non-fine-tuned BERT. The fine-tuned model achieves 91.77% accuracy, which significantly outperforms the non-fine-tuned BERT, and performs better than classical classifiers such as NB, SVM and RF. The results show that fine-tuning allows BERT to contextualize domain-specific intricacies, resulting in improved classification performance. We also address the computational trade-offs associated with transformer models, highlighting the need for optimal methods for deployment. Thus, this study further enables the use of fine-tuned BERT in automatic news classification and is of significant value for information retrieval and content personalization.
Zitieren
APA
Salih, M. I., Mohammed, S. M., Ibrahim, A. K., Ahmed, O. M., & Haji, L. M. (2025). Fine-Tuning BERT for Automated News Classification. Engineering, Technology & Applied Science Research, 15(3), 22953-22959. https://doi.org/10.48084/etasr.10625
Vancouver
Salih MI, Mohammed SM, Ibrahim AK, Ahmed OM, Haji LM. Fine-Tuning BERT for Automated News Classification. Engineering, Technology & Applied Science Research. 2025;15(3):22953-22959. doi:10.48084/etasr.10625
BibTeX
@article{Salih2025,
author = {Salih, Mohammed I. and Mohammed, Salim M. and Ibrahim, Asaad Kh. and Ahmed, Omar M. and Haji, Lailan M.},
title = {Fine-Tuning BERT for Automated News Classification},
journal = {Engineering, Technology & Applied Science Research},
year = {2025},
volume = {15},
number = {3},
pages = {22953--22959},
doi = {10.48084/etasr.10625}
}
EUVIMED