Ben-Sarc: A self-annotated corpus for sarcasm detection from Bengali social media comments and its baseline evaluation
Natural Language Processing · 2025
DOI: 10.1017/nlp.2024.11 ↗Kurz gefasst
Fachartikel in der Zeitschrift Natural Language Processing, 2025. Verfasst von Sanzana Karim Lora und 6 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 57 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-SA 4.0).
Abstract (Originalsprache)
Sarcasm detection research in the Bengali language so far can be considered to be narrow due to the unavailability of resources. In this paper, we introduce a large-scale self-annotated Bengali corpus for sarcasm detection research problem in the Bengali language named ‘Ben-Sarc’ containing 25,636 comments, manually collected from different public Facebook pages and evaluated by external evaluators. Then we present a complete strategy to utilize different models of traditional machine learning, deep learning, and transfer learning to detect sarcasm from text using the Ben-Sarc corpus. Finally, we demonstrate a comparison between the performance of traditional machine learning, deep learning, and transfer learning models on our Ben-Sarc corpus. Transfer learning using Indic-Transformers Bengali Bidirectional Encoder Representations from Transformers as a pre-trained source model has achieved the highest accuracy of 75.05%. The second-highest accuracy is obtained by the long short-term memory model with 72.48% and Multinomial Naive Bayes is acquired the third highest with 72.36% accuracy for deep learning and machine learning, respectively. The Ben-Sarc corpus is made publicly available in the hope of advancing the Bengali Natural Language Processing Community. The Ben-Sarc is available at https://github.com/sanzanalora/Ben-Sarc .
Zitieren
APA
Lora, S. K., Shahariar, G. M., Nazmin, T., Rahman, N. N., Rahman, R., Bhuiyan, M., & Shah, F. M. (2025). Ben-Sarc: A self-annotated corpus for sarcasm detection from Bengali social media comments and its baseline evaluation. Natural Language Processing. https://doi.org/10.1017/nlp.2024.11
Vancouver
Lora SK, Shahariar GM, Nazmin T, Rahman NN, Rahman R, Bhuiyan M, et al. Ben-Sarc: A self-annotated corpus for sarcasm detection from Bengali social media comments and its baseline evaluation. Natural Language Processing. 2025. doi:10.1017/nlp.2024.11
BibTeX
@article{Lora2025,
author = {Lora, Sanzana Karim and Shahariar, G. M. and Nazmin, Tamanna and Rahman, Noor Nafeur and Rahman, Rafsan and Bhuiyan, Miyad and Shah, Faisal Muhammad},
title = {Ben-Sarc: A self-annotated corpus for sarcasm detection from Bengali social media comments and its baseline evaluation},
journal = {Natural Language Processing},
year = {2025},
doi = {10.1017/nlp.2024.11}
}
EUVIMED