Gender bias detection on hate speech classification: an analysis at feature-level
Neural Computing and Applications · 2025-02 · 37 (5) · 3887-3905
DOI: 10.1007/s00521-024-10841-8 ↗Kurz gefasst
Fachartikel in der Zeitschrift Neural Computing and Applications, online erschienen am 17.12.2024. Verfasst von Francimaria R. S. Nascimento und 2 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 67 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Coordenação de Aperfeiçoamento de Pessoal de Nível Superior, Coordenação de Aperfeiçoamento de Pessoal de Nîvel Superior.
Abstract (Originalsprache)
Hate speech is a growing problem on social media due to the larger volume of content being shared. Recent works demonstrated the usefulness of distinct machine learning algorithms combined with natural language processing techniques to detect hateful content. However, when not constructed with the necessary care, learning models can magnify discriminatory behaviour and lead the model to incorrectly associate comments with specific identity terms (e.g., woman, black, and gay) with a particular class, such as hate speech. Moreover, some specific characteristics should be considered in the test set when evaluating the presence of bias, considering that the test set can follow the same biased distribution of the training set and compromise the results obtained by the bias metrics. This work argues that considering the potential bias in hate speech detection is needed and focuses on developing an intelligent system to address these limitations. Firstly, we proposed a comprehensive, unbiased dataset to unintended gender bias evaluation. Secondly, we propose a framework to help analyse bias from feature extraction techniques. Then, we evaluate several state-of-the-art feature extraction techniques, specifically focusing on the bias towards identity terms. We consider six feature extraction techniques, including TF, TF-IDF, FastText, GloVe, BERT, and RoBERTa, and six classifiers, LR, DT, SVM, XGB, MLP, and RF. The experimental study across hate speech datasets and a range of classification and unintended bias metrics demonstrates that the choice of the feature extraction technique can impact the bias on predictions, and its effectiveness can depend on the dataset analysed. For instance, combining TF and TF-IDF with DT and MLP resulted in higher bias, while BERT and RoBERTa showed lower bias with the same classifier for the HE and WH datasets. The proposed dataset and source code will be publicly available when the paper is published.
Förderung
- Coordenação de Aperfeiçoamento de Pessoal de Nível Superior
- Coordenação de Aperfeiçoamento de Pessoal de Nîvel Superior
Zitieren
APA
Nascimento, F. R. S., Cavalcanti, G. D. C., & Costa-Abreu, M. D. (2025). Gender bias detection on hate speech classification: an analysis at feature-level. Neural Computing and Applications, 37(5), 3887-3905. https://doi.org/10.1007/s00521-024-10841-8
Vancouver
Nascimento FRS, Cavalcanti GDC, Costa-Abreu MD. Gender bias detection on hate speech classification: an analysis at feature-level. Neural Computing and Applications. 2025;37(5):3887-3905. doi:10.1007/s00521-024-10841-8
BibTeX
@article{Nascimento2025,
author = {Nascimento, Francimaria R. S. and Cavalcanti, George D. C. and Costa-Abreu, Marjory Da},
title = {Gender bias detection on hate speech classification: an analysis at feature-level},
journal = {Neural Computing and Applications},
year = {2025},
volume = {37},
number = {5},
pages = {3887--3905},
doi = {10.1007/s00521-024-10841-8}
}
EUVIMED