Annotation in Action: Experimental Perspectives on Perceiving and Labeling Digital Hate Across Four European Countries
Human Behavior and Emerging Technologies · 2026-01 · 2026 (1)
DOI: 10.1155/hbe2/3332187 ↗Kurz gefasst
Fachartikel in der Zeitschrift Human Behavior and Emerging Technologies, online erschienen am 15.05.2026. Verfasst von Thomas Kirchmair und 2 weiteren Autor:innen. Die Arbeit nennt 57 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: HORIZON EUROPE European Research Council.
Abstract (Originalsprache)
Digital hate annotation constitutes an important task for training automatic classification algorithms that are robust across country contexts yet also sensitive to their unique conditions. However, perceptual heterogeneity in how hateful content is evaluated introduces a great challenge for consistent rating and labeling, as interpretations of norm violations are shaped by individual and contextual factors. In this study, we conduct a 2 (uncivil vs. intolerant content) × 2 (ingroup vs. outgroup targeting) × 2 (annotator vs. user role) mixed online experiment in Austria, France, Hungary, and Sweden ( N = 1,718), in which participants rate and label social media comments. Intolerance is consistently perceived as more severe and labeled more often as hateful compared to incivility across all countries. However, we find mixed support for differences between ingroup and outgroup targeting, only limited cross‐country evidence that explicitly assigning participants an annotator role influences their severity ratings, and no evidence that it affects their labeling decisions compared to when they act as regular users. While the influence of sociodemographics on perception is highly dependent on the country context, we find migration attitudes to be a country‐invariant predictor.
Förderung
- HORIZON EUROPE European Research Council
Zitieren
APA
Kirchmair, T., Koban, K., & Matthes, J. (2026). Annotation in Action: Experimental Perspectives on Perceiving and Labeling Digital Hate Across Four European Countries. Human Behavior and Emerging Technologies, 2026(1). https://doi.org/10.1155/hbe2/3332187
Vancouver
Kirchmair T, Koban K, Matthes J. Annotation in Action: Experimental Perspectives on Perceiving and Labeling Digital Hate Across Four European Countries. Human Behavior and Emerging Technologies. 2026;2026(1). doi:10.1155/hbe2/3332187
BibTeX
@article{Kirchmair2026,
author = {Kirchmair, Thomas and Koban, Kevin and Matthes, Jörg},
title = {Annotation in Action: Experimental Perspectives on Perceiving and Labeling Digital Hate Across Four European Countries},
journal = {Human Behavior and Emerging Technologies},
year = {2026},
volume = {2026},
number = {1},
doi = {10.1155/hbe2/3332187}
}
EUVIMED