Profiling Digital Hate: A Multidimensional Measurement Approach Based on the Perspective API
Social Science Computer Review · 11.07.2026
DOI: 10.1177/08944393261469403 ↗Kurz gefasst
Fachartikel in der Zeitschrift Social Science Computer Review, online erschienen am 11.07.2026. Verfasst von Thomas Kirchmair und 2 weiteren Autor:innen. Die Arbeit nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Horizon Europe European Research Council.
Abstract (Originalsprache)
The automatic classification of digital hate is a pressing challenge, yet many existing computational models remain opaque and insufficiently evaluated as measurement tools in social science contexts. This study examines the utility of Google’s Perspective API as a measurement instrument by modeling higher-order constructs of harmful discourse (i.e., incivility and intolerance) as outcomes of multiple lower-level behavioral indicators captured by distinct API scores rather than using a single aggregate score as a proxy for complex social behaviors while enabling the evaluation of state-of-the-art black-box classifiers beyond classification metrics. Drawing on 4,000 manually annotated English-language YouTube comments in the context of the Israel-Hamas war, we test whether multiple API scores predict incivility and intolerance using generalized linear and additive models, assess classification performance across non-hateful, uncivil, and intolerant content, and benchmark a recent deep learning model. Results show that Identity Attack is a strong predictor of intolerance, whereas Insult and Profanity are indicative of incivility. While classification performance is somewhat below state-of-the-art deep learning models, our approach offers important advantages: transparency, interpretability, accessibility for non-technical researchers, and potential cross-linguistic applicability. We argue that typology-driven, multi-indicator-based classification provides a practical and theoretically grounded complement to more aggregated black-box models, particularly in human-in-the-loop workflows that can help reduce annotator exposure through pre-filtering of content.
Förderung
- Horizon Europe European Research Council
Zitieren
APA
Kirchmair, T., Koban, K., & Matthes, J. (2026). Profiling Digital Hate: A Multidimensional Measurement Approach Based on the Perspective API. Social Science Computer Review. https://doi.org/10.1177/08944393261469403
Vancouver
Kirchmair T, Koban K, Matthes J. Profiling Digital Hate: A Multidimensional Measurement Approach Based on the Perspective API. Social Science Computer Review. 2026. doi:10.1177/08944393261469403
BibTeX
@article{Kirchmair2026,
author = {Kirchmair, Thomas and Koban, Kevin and Matthes, Jörg},
title = {Profiling Digital Hate: A Multidimensional Measurement Approach Based on the Perspective API},
journal = {Social Science Computer Review},
year = {2026},
doi = {10.1177/08944393261469403}
}
EUVIMED