EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Collective moderation of hate, toxicity, and extremity in online discussions

Jana Lasser iD, Alina Herderich iD, Joshua Garland iD, Segun Taofeek Aroyehun iD, David Garcia, Mirta Galesic iD

PNAS Nexus · 31.10.2025 · 4 (11)

DOI: 10.1093/pnasnexus/pgaf369 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PNAS Nexus, online erschienen am 17.11.2025. Verfasst von Jana Lasser und 5 weiteren Autor:innen. Beteiligte Einrichtung: IDea_Lab, University of Graz, 8010 Graz, Austria. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 73 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Marie Skłodowska-Curie, NSF, ASU’s Center on Narrative, Disinformation and Strategic Influence.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In the digital age, hate speech poses a threat to the functioning of social media platforms as spaces for public discourse. Top-down approaches to moderate hate speech encounter difficulties due to conflicts with freedom of expression and issues of scalability. Counter speech, a form of collective moderation by citizens, has emerged as a potential remedy. Here, we aim to investigate which counter speech strategies are most effective in reducing the prevalence of hate, toxicity, and extremity on online platforms. We analyze more than 130,000 discussions on German Twitter starting at the peak of the migrant crisis in 2015 and extending over 4 years. We use human annotation and machine learning classifiers to identify argumentation strategies, ingroup and outgroup references, emotional tone, and different measures of discourse quality. Using matching and time-series analyses we discern the effectiveness of naturally observed counter speech strategies on the microlevel (individual tweet pairs), mesolevel (entire discussions) and macrolevel (over days). We find that expressing straightforward opinions, even if not factual but devoid of insults, results in the least subsequent hate, toxicity, and extremity over all levels of analyses. This strategy complements currently recommended counter speech strategies and is easy for citizens to engage in. Sarcasm can also be effective in improving discourse quality, especially in the presence of organized extreme groups. Going beyond one-shot analyses on smaller samples prevalent in most prior studies, our findings have implications for the successful management of public online spaces through collective civic moderation.

Schlagwörter

Stichwörter der Autor:innen

Psychological and Cognitive SciencesSocial SciencesSocial and Political Sciences > Political Sciencescollective moderationcounter speechemotionoutgroup thinkingpolitical discussions

Autor:innen und Institutionen

  • IDea_Lab, University of Graz, 8010 Graz, Austria.
  • Complexity Science Hub Vienna, 1030 Vienna, Austria.
  • Department of Computer Science and Biomedical Engineering, Graz University of Technology, 8010 Graz, Austria.
  • Center on Narrative, Disinformation, and Strategic Influence, Arizona State University, Tempe, AZ 85281, USA.
  • Santa Fe Institute, Santa Fe, NM 87501, USA.
  • Department of Politics and Public Administration, University of Konstanz, 78464 Konstanz, Germany.

ORCID-Profile: Jana Lasser, Alina Herderich, Joshua Garland, Segun Taofeek Aroyehun, Mirta Galesic

Förderung

  • Marie Skłodowska-Curie
  • NSF
  • ASU’s Center on Narrative, Disinformation and Strategic Influence
  • Santa Fe Institute’s Applied Complexity program
  • ERC
  • Austrian Research Promotion Agency

Zitieren

APA

Lasser, J., Herderich, A., Garland, J., Aroyehun, S. T., Garcia, D., & Galesic, M. (2025). Collective moderation of hate, toxicity, and extremity in online discussions. PNAS Nexus, 4(11). https://doi.org/10.1093/pnasnexus/pgaf369

Vancouver

Lasser J, Herderich A, Garland J, Aroyehun ST, Garcia D, Galesic M. Collective moderation of hate, toxicity, and extremity in online discussions. PNAS Nexus. 2025;4(11). doi:10.1093/pnasnexus/pgaf369

BibTeX
@article{Lasser2025,
  author = {Lasser, Jana and Herderich, Alina and Garland, Joshua and Aroyehun, Segun Taofeek and Garcia, David and Galesic, Mirta},
  title = {Collective moderation of hate, toxicity, and extremity in online discussions},
  journal = {PNAS Nexus},
  year = {2025},
  volume = {4},
  number = {11},
  doi = {10.1093/pnasnexus/pgaf369}
}
Kostenlos starten →