EUVIMEDEUVIMED entdecken
Open Access · CC BY-ND 4.0

Study of the Application of Text Augmentation with Paraphrasing to Overcome Imbalanced Data in Indonesian Text Classification

Mutiara Indryan Sari, Lya Hulliyyatus Suadaa

Jurnal Online Informatika · 2025

DOI: 10.15575/join.v10i1.1472 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Jurnal Online Informatika, 2025. Verfasst von Mutiara Indryan Sari und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Data imbalance in text classification often leads to poor recognition of minority classes, as classifiers tend to favor majority categories. This study addresses the data imbalance issue in Indonesian text classification by proposing a novel text augmentation approach using fine-tuned pre-trained models: IndoGPT2, IndoBART-v2, and mBART50. Unlike back-translation, which struggles with informal text, text augmentation using pre-trained models significantly improves the F1 score of minority labels, with fine-tuned mBART50 outperforming back translation and other models by balancing semantic preservation and lexical diversity. However, the approach faces limitations, including the risk of overfitting due to synthetic text's lack of natural variations, restricted generalizability from reliance on datasets such as ParaCotta, and the high computational costs associated with fine-tuning large models like mBART50. Future research should explore hybrid methods that integrate synthetic and real-world data to enhance text quality and diversity, as well as develop smaller, more efficient models to reduce computational demands. The findings underscore the potential of pre-trained models for text augmentation while emphasizing the importance of considering dataset characteristics, language style, and augmentation volume to achieve optimal results.

Zitieren

APA

Sari, M. I., & Suadaa, L. H. (2025). Study of the Application of Text Augmentation with Paraphrasing to Overcome Imbalanced Data in Indonesian Text Classification. Jurnal Online Informatika. https://doi.org/10.15575/join.v10i1.1472

Vancouver

Sari MI, Suadaa LH. Study of the Application of Text Augmentation with Paraphrasing to Overcome Imbalanced Data in Indonesian Text Classification. Jurnal Online Informatika. 2025. doi:10.15575/join.v10i1.1472

BibTeX
@article{Sari2025,
  author = {Sari, Mutiara Indryan and Suadaa, Lya Hulliyyatus},
  title = {Study of the Application of Text Augmentation with Paraphrasing to Overcome Imbalanced Data in Indonesian Text Classification},
  journal = {Jurnal Online Informatika},
  year = {2025},
  doi = {10.15575/join.v10i1.1472}
}
Kostenlos starten →