EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Yesterday’s News: Benchmarking Multi-Dimensional Out-of-Distribution Generalization of Misinformation Detection Models

Ivo Verhoeven, Pushkar Mishra, Ekaterina Shutova

Computational Linguistics · 01.06.2026 · 52 (2) · 619-675

DOI: 10.1162/coli.a.585 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computational Linguistics, online erschienen am 01.06.2026. Verfasst von Ivo Verhoeven und 2 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 134 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This article introduces misinfo-general, a benchmark dataset for evaluating misinformation models’ ability to perform out-of-distribution generalization. Misinformation changes rapidly, much more quickly than moderators can annotate at scale, resulting in a shift between the training and inference data distributions. As a result, misinformation detectors need to be able to perform out-of-distribution generalization, an attribute they currently lack. Our benchmark uses distant labeling to enable simulating covariate shifts in misinformation content. We identify time, event, topic, publisher, political bias, and misinformation type as important axes for generalization, and we evaluate a common class of baseline models on each. Using article metadata, we show how this model fails desiderata, which is not necessarily obvious from classification metrics. Finally, we analyze properties of the data to ensure limited presence of modelling shortcuts. We make the dataset and accompanying code publicly available.1

Zitieren

APA

Verhoeven, I., Mishra, P., & Shutova, E. (2026). Yesterday’s News: Benchmarking Multi-Dimensional Out-of-Distribution Generalization of Misinformation Detection Models. Computational Linguistics, 52(2), 619-675. https://doi.org/10.1162/coli.a.585

Vancouver

Verhoeven I, Mishra P, Shutova E. Yesterday’s News: Benchmarking Multi-Dimensional Out-of-Distribution Generalization of Misinformation Detection Models. Computational Linguistics. 2026;52(2):619-675. doi:10.1162/coli.a.585

BibTeX
@article{Verhoeven2026,
  author = {Verhoeven, Ivo and Mishra, Pushkar and Shutova, Ekaterina},
  title = {Yesterday’s News: Benchmarking Multi-Dimensional Out-of-Distribution Generalization of Misinformation Detection Models},
  journal = {Computational Linguistics},
  year = {2026},
  volume = {52},
  number = {2},
  pages = {619--675},
  doi = {10.1162/coli.a.585}
}
Kostenlos starten →