Rethinking the evaluation of news algorithms: aligning epistemic standards, user priorities and evaluation metrics in recommender system design
Frontiers in Communication · 19.06.2026 · 11
DOI: 10.3389/fcomm.2026.1844993 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Communication, online erschienen am 19.06.2026. Verfasst von Michelle Kulig und 7 weiteren Autor:innen. Die Arbeit nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Fonds Wetenschappelijk Onderzoek, Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung.
Abstract (Originalsprache)
As media organizations increasingly deploy recommender systems, these technologies play a growing role in shaping how individuals encounter and engage with news and public information online. Designing and evaluating these systems effectively, particularly in the news domain, requires attention to the challenges users face in forming knowledge and justified beliefs within complex digital information environments. To address this need, we draw on the normative concept of epistemic welfare, which offers a systematic, veritistically grounded approach to assessing how recommender systems support users’ capacity to access, interpret, and use information. Using large-scale online surveys in Belgium and Switzerland ( N = 3,076), this study investigates how users prioritize distinct epistemic standards in algorithmic recommendations of news vs. entertainment from public service vs. private media across two structurally similar contexts, with entertainment recommendations serving as a comparative reference category. Results show a consistent prioritization of reliability across all contexts, including entertainment, while efficiency and speed are systematically deprioritized. We integrate theoretical and empirical insights into the Epistemic Welfare Evaluation Framework for News Recommender Systems (EWEF-NR), an exploratory conceptual framework that connects normative epistemic standards and empirical user priorities with established evaluation metrics. Bridging social scientific and computational perspectives, this paper provides an interdisciplinary user-centered approach for designing and assessing news recommender systems that strengthen users’ epistemic agency.
Förderung
- Fonds Wetenschappelijk Onderzoek
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung
Zitieren
APA
Kulig, M., Buyens, W., Tuor, R., Treuillier, C., Puppis, M., Bulck, H. V. D., Paulussen, S., & Lalanne, D. (2026). Rethinking the evaluation of news algorithms: aligning epistemic standards, user priorities and evaluation metrics in recommender system design. Frontiers in Communication, 11. https://doi.org/10.3389/fcomm.2026.1844993
Vancouver
Kulig M, Buyens W, Tuor R, Treuillier C, Puppis M, Bulck HVD, et al. Rethinking the evaluation of news algorithms: aligning epistemic standards, user priorities and evaluation metrics in recommender system design. Frontiers in Communication. 2026;11. doi:10.3389/fcomm.2026.1844993
BibTeX
@article{Kulig2026,
author = {Kulig, Michelle and Buyens, Willem and Tuor, Raphaël and Treuillier, Célina and Puppis, Manuel and Bulck, Hilde Van den and Paulussen, Steve and Lalanne, Denis},
title = {Rethinking the evaluation of news algorithms: aligning epistemic standards, user priorities and evaluation metrics in recommender system design},
journal = {Frontiers in Communication},
year = {2026},
volume = {11},
doi = {10.3389/fcomm.2026.1844993}
}
EUVIMED