EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Understanding hate speech: the HateInsights dataset and model interpretability

Muhammad Umair Arshad, Waseem Shahzad

PeerJ Computer Science · 02.10.2024 · 10 · e2372

DOI: 10.7717/peerj-cs.2372 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 02.10.2024. Verfasst von Muhammad Umair Arshad und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Artificial Intelligence and Data Science, National University of Computer and Emerging Sciences, Islamabad, Pakistan. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The persistence of hate speech continues to pose an obstacle in the realm of online social media. Despite the continuous evolution of advanced models for identifying hate speech, the critical dimensions of interpretability and explainability have not received proportional scholarly attention. In this article, we introduce the HateInsights dataset, a groundbreaking benchmark in the field of hate speech datasets, encompassing diverse aspects of this widespread issue. Within our dataset, each individual post undergoes thorough annotation from dual perspectives: firstly, conforming to the established 3-class classification paradigm that includes hate speech, offensive language, and normal discourse; secondly, incorporating rationales that outline specific segments of a post supporting the assigned label (categorized as hate speech, offensive language, or normal discourse). Our exploration yields a significant finding by harnessing cutting-edge state-of-the-art models: even models demonstrating exceptional proficiency in classification tasks yield suboptimal outcomes in crucial explainability metrics, such as model plausibility and faithfulness. Furthermore, our analysis underscores a promising revelation concerning models trained using human-annotated rationales. To facilitate scholarly progress in this realm, we have made both our dataset and codebase accessible to fellow researchers. This initiative aims to encourage collaborative involvement and inspire the advancement of the hate speech detection approach characterized by increased transparency, clarity, and fairness.

Schlagwörter

Stichwörter der Autor:innen

AIExplainable AIHate speechLLMMachine learningNatural language processing

Autor:innen und Institutionen

  • Department of Artificial Intelligence and Data Science, National University of Computer and Emerging Sciences, Islamabad, Pakistan.

Zitieren

APA

Arshad, M. U., & Shahzad, W. (2024). Understanding hate speech: the HateInsights dataset and model interpretability. PeerJ Computer Science, 10, e2372. https://doi.org/10.7717/peerj-cs.2372

Vancouver

Arshad MU, Shahzad W. Understanding hate speech: the HateInsights dataset and model interpretability. PeerJ Computer Science. 2024;10:e2372. doi:10.7717/peerj-cs.2372

BibTeX
@article{Arshad2024,
  author = {Arshad, Muhammad Umair and Shahzad, Waseem},
  title = {Understanding hate speech: the HateInsights dataset and model interpretability},
  journal = {PeerJ Computer Science},
  year = {2024},
  volume = {10},
  pages = {e2372},
  doi = {10.7717/peerj-cs.2372}
}
Kostenlos starten →