EUVIMEDEUVIMED entdecken
Crossref

FINE-TUNING INDOBERT USING FOCAL LOSS FOR IMBALANCED NEWS HEADLINE CLASSIFICATION

Nazla Dzaalika Ainaya, Netti Herawati, Misgiyati Subian Saidi

International Journal of Applied Science and Engineering Review · 2026 · 07 (04) · 71-84

DOI: 10.52267/ijaser.2026.7407 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Applied Science and Engineering Review, 2026. Verfasst von Nazla Dzaalika Ainaya und 2 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

News headline classification plays an important role in identifying event-related information from large volumes of online news. However, performance often declines when datasets are imbalanced, as nonevent news dominates and causes models to favor the majority class, reducing minority detection accuracy. This study applied the IndoBERT model with two fine-tuning approaches, cross entropy loss and focal loss to classify Indonesian news headlines into event and non-event categories, aiming to evaluate the effectiveness of focal loss on imbalanced data. Using a supervised learning framework, the dataset was split into training, validation, and testing sets, and both models were trained with identical hyperparameters: learning rate 2×10⁻⁵, batch size 16, and 3 epochs. Evaluation employed accuracy, precision, recall, F1-score, confusion matrix, and ROC analysis. Results showed that cross entropy achieved 84% accuracy but lower minority-class recall, while focal loss improved performance to 95% accuracy with more balanced precision and recall. The findings indicate that focal loss helps the model focus on difficult samples, enhancing robustness and minority-class detection in imbalanced Indonesian news headline classification.

Zitieren

APA

Ainaya, N. D., Herawati, N., & Saidi, M. S. (2026). FINE-TUNING INDOBERT USING FOCAL LOSS FOR IMBALANCED NEWS HEADLINE CLASSIFICATION. International Journal of Applied Science and Engineering Review, 07(04), 71-84. https://doi.org/10.52267/ijaser.2026.7407

Vancouver

Ainaya ND, Herawati N, Saidi MS. FINE-TUNING INDOBERT USING FOCAL LOSS FOR IMBALANCED NEWS HEADLINE CLASSIFICATION. International Journal of Applied Science and Engineering Review. 2026;07(04):71-84. doi:10.52267/ijaser.2026.7407

BibTeX
@article{Ainaya2026,
  author = {Ainaya, Nazla Dzaalika and Herawati, Netti and Saidi, Misgiyati Subian},
  title = {FINE-TUNING INDOBERT USING FOCAL LOSS FOR IMBALANCED NEWS HEADLINE CLASSIFICATION},
  journal = {International Journal of Applied Science and Engineering Review},
  year = {2026},
  volume = {07},
  number = {04},
  pages = {71--84},
  doi = {10.52267/ijaser.2026.7407}
}
Kostenlos starten →