EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

SMOTE and BERT Approaches for Handling Class Imbalance in Sentiment Analysis of the CoreTax Application on Big Data

Meiliyani Br Ginting, Asprina Br Surbakti, Safarul Ilham, Dito Putro Utomo, Raheliya Br Ginting

Building of Informatics, Technology and Science (BITS) · 30.09.2025 · 7 (2) · 1467-1476

DOI: 10.47065/bits.v7i2.8310 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Building of Informatics, Technology and Science (BITS), online erschienen am 30.09.2025. Verfasst von Meiliyani Br Ginting und 4 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Coretax is a tax information system developed by the Directorate General of Taxes (DJP) to support digital and integrated tax administration processes, covering everything from taxpayer registration to reporting and auditing. Although it was designed to improve efficiency, transparency, and accuracy in tax management, its implementation has sparked mixed reactions among the public due to various technical challenges and the complexity of the annual tax reporting process. This situation highlights the need for a sentiment analysis that can objectively capture public perceptions of the system’s performance. In this study, Natural Language Processing (NLP) and Machine Learning techniques were applied to analyze 3,000 tweets from Twitter (X) related to Coretax. One of the main issues identified in the dataset is class imbalance, where positive sentiments significantly outnumber negative and neutral ones, leading to biased classification results. To address this issue, the Synthetic Minority Over-sampling Technique (SMOTE) was used to balance the dataset by generating synthetic samples for the minority classes. The BERT model was then employed for sentiment classification because of its strong ability to understand contextual meaning through its transformer-based architecture. Experimental results show that before applying SMOTE, the BERT model achieved an accuracy of 77%, which increased to 80% after SMOTE was implemented, along with improvements in precision, recall, and F1-score, particularly for the minority classes. These findings demonstrate that the combination of SMOTE and BERT significantly enhances the performance of sentiment analysis in understanding public responses to Coretax. This approach can serve as a valuable reference for evaluating and improving tax digitalization policies, ensuring they are more effective, inclusive, and responsive to public needs.

Zitieren

APA

Ginting, M. B., Surbakti, A. B., Ilham, S., Utomo, D. P., & Ginting, R. B. (2025). SMOTE and BERT Approaches for Handling Class Imbalance in Sentiment Analysis of the CoreTax Application on Big Data. Building of Informatics, Technology and Science (BITS), 7(2), 1467-1476. https://doi.org/10.47065/bits.v7i2.8310

Vancouver

Ginting MB, Surbakti AB, Ilham S, Utomo DP, Ginting RB. SMOTE and BERT Approaches for Handling Class Imbalance in Sentiment Analysis of the CoreTax Application on Big Data. Building of Informatics, Technology and Science (BITS). 2025;7(2):1467-1476. doi:10.47065/bits.v7i2.8310

BibTeX
@article{Ginting2025,
  author = {Ginting, Meiliyani Br and Surbakti, Asprina Br and Ilham, Safarul and Utomo, Dito Putro and Ginting, Raheliya Br},
  title = {SMOTE and BERT Approaches for Handling Class Imbalance in Sentiment Analysis of the CoreTax Application on Big Data},
  journal = {Building of Informatics, Technology and Science (BITS)},
  year = {2025},
  volume = {7},
  number = {2},
  pages = {1467--1476},
  doi = {10.47065/bits.v7i2.8310}
}
Kostenlos starten →