Understanding hate speech: the HateInsights dataset and model interpretability
PeerJ Computer Science · 02.10.2024 · 10 · e2372
DOI: 10.7717/peerj-cs.2372 ↗Kurz gefasst
Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 02.10.2024. Verfasst von Muhammad Umair Arshad und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Artificial Intelligence and Data Science, National University of Computer and Emerging Sciences, Islamabad, Pakistan. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
The persistence of hate speech continues to pose an obstacle in the realm of online social media. Despite the continuous evolution of advanced models for identifying hate speech, the critical dimensions of interpretability and explainability have not received proportional scholarly attention. In this article, we introduce the HateInsights dataset, a groundbreaking benchmark in the field of hate speech datasets, encompassing diverse aspects of this widespread issue. Within our dataset, each individual post undergoes thorough annotation from dual perspectives: firstly, conforming to the established 3-class classification paradigm that includes hate speech, offensive language, and normal discourse; secondly, incorporating rationales that outline specific segments of a post supporting the assigned label (categorized as hate speech, offensive language, or normal discourse). Our exploration yields a significant finding by harnessing cutting-edge state-of-the-art models: even models demonstrating exceptional proficiency in classification tasks yield suboptimal outcomes in crucial explainability metrics, such as model plausibility and faithfulness. Furthermore, our analysis underscores a promising revelation concerning models trained using human-annotated rationales. To facilitate scholarly progress in this realm, we have made both our dataset and codebase accessible to fellow researchers. This initiative aims to encourage collaborative involvement and inspire the advancement of the hate speech detection approach characterized by increased transparency, clarity, and fairness.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Artificial Intelligence and Data Science, National University of Computer and Emerging Sciences, Islamabad, Pakistan.
Zitieren
APA
Arshad, M. U., & Shahzad, W. (2024). Understanding hate speech: the HateInsights dataset and model interpretability. PeerJ Computer Science, 10, e2372. https://doi.org/10.7717/peerj-cs.2372
Vancouver
Arshad MU, Shahzad W. Understanding hate speech: the HateInsights dataset and model interpretability. PeerJ Computer Science. 2024;10:e2372. doi:10.7717/peerj-cs.2372
BibTeX
@article{Arshad2024,
author = {Arshad, Muhammad Umair and Shahzad, Waseem},
title = {Understanding hate speech: the HateInsights dataset and model interpretability},
journal = {PeerJ Computer Science},
year = {2024},
volume = {10},
pages = {e2372},
doi = {10.7717/peerj-cs.2372}
}
EUVIMED