The Election Monitoring Trilemma: Measuring Rare Elite Threats on Social Media With Large Language Models
Political Research Quarterly · 11.11.2026
DOI: 10.1177/10659129261503387 ↗Kurz gefasst
Fachartikel in der Zeitschrift Political Research Quarterly, online erschienen am 11.11.2026. Verfasst von Sean T. Norton und 4 weiteren Autor:innen. Die Arbeit nennt 39 Literaturangaben. Gefördert von: Princeton University.
Abstract (Originalsprache)
In 2024, elections across more than 70 countries raised fears that social media would incite violence and erode democratic norms. We collected public posts from candidates, parties, journalists, and influencers in South Africa, India, and Germany, coding a random sample for five outcomes using human and LLM annotation. All five are rare on the public platforms we study: incitement to violence appeared in just 0.2% of posts, attacks on democratic norms in 1.9%, and civic duty appeals in 2.3%. While LLMs accurately identified true positives, their precision on rare categories was poor and for the two rarest and highest-stakes categories—incitement and ethnic appeals—the LLMs’ ability to catch true positives rests on a deliberately enriched sample. In addition to the limitations low precision poses to researchers, we further show that this precision shortfall confronts election monitors with a three-way tradeoff among coverage, throughput, and credibility that no single off-the-shelf configuration resolves.
Förderung
- Princeton University
Zitieren
APA
Norton, S. T., Greene, K. T., Leu, O., DeMattee, A. J., & Shapiro, J. N. (2026). The Election Monitoring Trilemma: Measuring Rare Elite Threats on Social Media With Large Language Models. Political Research Quarterly. https://doi.org/10.1177/10659129261503387
Vancouver
Norton ST, Greene KT, Leu O, DeMattee AJ, Shapiro JN. The Election Monitoring Trilemma: Measuring Rare Elite Threats on Social Media With Large Language Models. Political Research Quarterly. 2026. doi:10.1177/10659129261503387
BibTeX
@article{Norton2026,
author = {Norton, Sean T. and Greene, Kevin T. and Leu, Olivia and DeMattee, Anthony J. and Shapiro, Jacob N.},
title = {The Election Monitoring Trilemma: Measuring Rare Elite Threats on Social Media With Large Language Models},
journal = {Political Research Quarterly},
year = {2026},
doi = {10.1177/10659129261503387}
}
EUVIMED