Collective moderation of hate, toxicity, and extremity in online discussions
PNAS Nexus · 31.10.2025 · 4 (11)
DOI: 10.1093/pnasnexus/pgaf369 ↗Kurz gefasst
Fachartikel in der Zeitschrift PNAS Nexus, online erschienen am 17.11.2025. Verfasst von Jana Lasser und 5 weiteren Autor:innen. Beteiligte Einrichtung: IDea_Lab, University of Graz, 8010 Graz, Austria. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 73 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Marie Skłodowska-Curie, NSF, ASU’s Center on Narrative, Disinformation and Strategic Influence.
Abstract (Originalsprache)
In the digital age, hate speech poses a threat to the functioning of social media platforms as spaces for public discourse. Top-down approaches to moderate hate speech encounter difficulties due to conflicts with freedom of expression and issues of scalability. Counter speech, a form of collective moderation by citizens, has emerged as a potential remedy. Here, we aim to investigate which counter speech strategies are most effective in reducing the prevalence of hate, toxicity, and extremity on online platforms. We analyze more than 130,000 discussions on German Twitter starting at the peak of the migrant crisis in 2015 and extending over 4 years. We use human annotation and machine learning classifiers to identify argumentation strategies, ingroup and outgroup references, emotional tone, and different measures of discourse quality. Using matching and time-series analyses we discern the effectiveness of naturally observed counter speech strategies on the microlevel (individual tweet pairs), mesolevel (entire discussions) and macrolevel (over days). We find that expressing straightforward opinions, even if not factual but devoid of insults, results in the least subsequent hate, toxicity, and extremity over all levels of analyses. This strategy complements currently recommended counter speech strategies and is easy for citizens to engage in. Sarcasm can also be effective in improving discourse quality, especially in the presence of organized extreme groups. Going beyond one-shot analyses on smaller samples prevalent in most prior studies, our findings have implications for the successful management of public online spaces through collective civic moderation.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- IDea_Lab, University of Graz, 8010 Graz, Austria.
- Complexity Science Hub Vienna, 1030 Vienna, Austria.
- Department of Computer Science and Biomedical Engineering, Graz University of Technology, 8010 Graz, Austria.
- Center on Narrative, Disinformation, and Strategic Influence, Arizona State University, Tempe, AZ 85281, USA.
- Santa Fe Institute, Santa Fe, NM 87501, USA.
- Department of Politics and Public Administration, University of Konstanz, 78464 Konstanz, Germany.
ORCID-Profile: Jana Lasser, Alina Herderich, Joshua Garland, Segun Taofeek Aroyehun, Mirta Galesic
Förderung
- Marie Skłodowska-Curie
- NSF
- ASU’s Center on Narrative, Disinformation and Strategic Influence
- Santa Fe Institute’s Applied Complexity program
- ERC
- Austrian Research Promotion Agency
Zitieren
APA
Lasser, J., Herderich, A., Garland, J., Aroyehun, S. T., Garcia, D., & Galesic, M. (2025). Collective moderation of hate, toxicity, and extremity in online discussions. PNAS Nexus, 4(11). https://doi.org/10.1093/pnasnexus/pgaf369
Vancouver
Lasser J, Herderich A, Garland J, Aroyehun ST, Garcia D, Galesic M. Collective moderation of hate, toxicity, and extremity in online discussions. PNAS Nexus. 2025;4(11). doi:10.1093/pnasnexus/pgaf369
BibTeX
@article{Lasser2025,
author = {Lasser, Jana and Herderich, Alina and Garland, Joshua and Aroyehun, Segun Taofeek and Garcia, David and Galesic, Mirta},
title = {Collective moderation of hate, toxicity, and extremity in online discussions},
journal = {PNAS Nexus},
year = {2025},
volume = {4},
number = {11},
doi = {10.1093/pnasnexus/pgaf369}
}
EUVIMED