EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Rethinking the evaluation of news algorithms: aligning epistemic standards, user priorities and evaluation metrics in recommender system design

Michelle Kulig, Willem Buyens, Raphaël Tuor, Célina Treuillier, Manuel Puppis, Hilde Van den Bulck, Steve Paulussen, Denis Lalanne

Frontiers in Communication · 19.06.2026 · 11

DOI: 10.3389/fcomm.2026.1844993 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Communication, online erschienen am 19.06.2026. Verfasst von Michelle Kulig und 7 weiteren Autor:innen. Die Arbeit nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Fonds Wetenschappelijk Onderzoek, Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As media organizations increasingly deploy recommender systems, these technologies play a growing role in shaping how individuals encounter and engage with news and public information online. Designing and evaluating these systems effectively, particularly in the news domain, requires attention to the challenges users face in forming knowledge and justified beliefs within complex digital information environments. To address this need, we draw on the normative concept of epistemic welfare, which offers a systematic, veritistically grounded approach to assessing how recommender systems support users’ capacity to access, interpret, and use information. Using large-scale online surveys in Belgium and Switzerland ( N = 3,076), this study investigates how users prioritize distinct epistemic standards in algorithmic recommendations of news vs. entertainment from public service vs. private media across two structurally similar contexts, with entertainment recommendations serving as a comparative reference category. Results show a consistent prioritization of reliability across all contexts, including entertainment, while efficiency and speed are systematically deprioritized. We integrate theoretical and empirical insights into the Epistemic Welfare Evaluation Framework for News Recommender Systems (EWEF-NR), an exploratory conceptual framework that connects normative epistemic standards and empirical user priorities with established evaluation metrics. Bridging social scientific and computational perspectives, this paper provides an interdisciplinary user-centered approach for designing and assessing news recommender systems that strengthen users’ epistemic agency.

Förderung

  • Fonds Wetenschappelijk Onderzoek
  • Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung

Zitieren

APA

Kulig, M., Buyens, W., Tuor, R., Treuillier, C., Puppis, M., Bulck, H. V. D., Paulussen, S., & Lalanne, D. (2026). Rethinking the evaluation of news algorithms: aligning epistemic standards, user priorities and evaluation metrics in recommender system design. Frontiers in Communication, 11. https://doi.org/10.3389/fcomm.2026.1844993

Vancouver

Kulig M, Buyens W, Tuor R, Treuillier C, Puppis M, Bulck HVD, et al. Rethinking the evaluation of news algorithms: aligning epistemic standards, user priorities and evaluation metrics in recommender system design. Frontiers in Communication. 2026;11. doi:10.3389/fcomm.2026.1844993

BibTeX
@article{Kulig2026,
  author = {Kulig, Michelle and Buyens, Willem and Tuor, Raphaël and Treuillier, Célina and Puppis, Manuel and Bulck, Hilde Van den and Paulussen, Steve and Lalanne, Denis},
  title = {Rethinking the evaluation of news algorithms: aligning epistemic standards, user priorities and evaluation metrics in recommender system design},
  journal = {Frontiers in Communication},
  year = {2026},
  volume = {11},
  doi = {10.3389/fcomm.2026.1844993}
}
Kostenlos starten →