ABSA of Indonesian customer reviews using IndoBERT: single- sentence and sentence-pair classification approaches
Bulletin of Electrical Engineering and Informatics · 01.10.2024 · 13 (5) · 3579-3589
DOI: 10.11591/eei.v13i5.8032 ↗Kurz gefasst
Fachartikel in der Zeitschrift Bulletin of Electrical Engineering and Informatics, online erschienen am 01.10.2024. Verfasst von Evi Yulianti und 1 weiteren Autor:innen. Die Arbeit wurde bisher 31-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).
Abstract (Originalsprache)
Aspect-based sentiment analysis (ABSA) task is important to identify user satisfaction from customer reviews by recognizing the sentiments of all aspects discussed in the reviews. This work investigates a novel study on the effectiveness and efficiency of three IndoBERT-based models for solving the ABSA task in Indonesian language. IndoBERT is a state-of-the-art transformer-based model, i.e., bidirectional encoder representations from transformers (BERT), that was pre-trained on Indonesian language. Our first model utilizes IndoBERT in a feature-based mode, paired with the convolutional neural network (CNN) and machine learning models, for single-sentence classification. Next, our second model is obtained by fine- tuning the IndoBERT model for a typical single-sentence classification to build an end-to-end model. At last, our third model also adopts a fine-tuning approach to use IndoBERT, but for sentence-pair classification by utilizing auxiliary sentences. Our results demonstrate that the third model, the fine- tuned IndoBERT for sentence-pair classification, gains the highest effectiveness. It demonstrates significant improvement over deep learning baselines (Word2Vec-CNN-XGBoost) by 23.6% and transformer-based baselines (mBERT-aux-NLIB) by 2.2% in terms of F-1 score. When considering both effectiveness and efficiency, the results show that the best- performing model is our second model, the fine-tuned IndoBERT for single- sentence classification.
Zitieren
APA
Yulianti, E., & Nissa, N. K. (2024). ABSA of Indonesian customer reviews using IndoBERT: single- sentence and sentence-pair classification approaches. Bulletin of Electrical Engineering and Informatics, 13(5), 3579-3589. https://doi.org/10.11591/eei.v13i5.8032
Vancouver
Yulianti E, Nissa NK. ABSA of Indonesian customer reviews using IndoBERT: single- sentence and sentence-pair classification approaches. Bulletin of Electrical Engineering and Informatics. 2024;13(5):3579-3589. doi:10.11591/eei.v13i5.8032
BibTeX
@article{Yulianti2024,
author = {Yulianti, Evi and Nissa, Nuzulul Khairu},
title = {ABSA of Indonesian customer reviews using IndoBERT: single- sentence and sentence-pair classification approaches},
journal = {Bulletin of Electrical Engineering and Informatics},
year = {2024},
volume = {13},
number = {5},
pages = {3579--3589},
doi = {10.11591/eei.v13i5.8032}
}
EUVIMED