EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Fair assessment of fair recommender systems: an experimental framework on model and data characteristics

Yaren Yilmaz, Umutcan Karakas, Yıldız Ulaşlı, Omer Faruk Zeybek, Ayse Tosun, Sule Gunduz Oguducu

PeerJ Computer Science · 31.07.2026 · 12 · e4012

DOI: 10.7717/peerj-cs.4012 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 31.07.2026. Verfasst von Yaren Yilmaz und 5 weiteren Autor:innen. Die Arbeit nennt 65 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Istanbul Technical University Scientific Research Project Unit.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recommender systems deliver personalized content to users, but often introduce biases that affect fairness. Despite growing interest, lack of a standardized set of fairness metrics and dataset-specific biases make fair assessment among recommender systems very challenging, as well as the reported findings unreliable. This study proposes an evaluation framework to address these challenges by analyzing 900 experimental runs across two widely used datasets (MovieLens-1M, BookCrossing), three state-of-the-art recommenders, five fairness metrics, and two sensitive attributes. Through regression analyses, statistical tests and effect size analysis, we show that data characteristics and sensitive attribute distributions significantly influence fairness outcomes, while the significance and magnitude of these effects vary depending on the chosen fairness metric. We also uncover significant interaction effects between model and data properties, offering deeper insights into fair model dynamics. Notably, some fairness metrics conflict with accuracy, highlighting trade-offs in fairness-aware optimization. Our framework offers a systematic approach to evaluating fairness in recommender systems, supporting more transparent and comparable research.

Förderung

  • Istanbul Technical University Scientific Research Project Unit

Zitieren

APA

Yilmaz, Y., Karakas, U., Ulaşlı, Y., Zeybek, O. F., Tosun, A., & Oguducu, S. G. (2026). Fair assessment of fair recommender systems: an experimental framework on model and data characteristics. PeerJ Computer Science, 12, e4012. https://doi.org/10.7717/peerj-cs.4012

Vancouver

Yilmaz Y, Karakas U, Ulaşlı Y, Zeybek OF, Tosun A, Oguducu SG. Fair assessment of fair recommender systems: an experimental framework on model and data characteristics. PeerJ Computer Science. 2026;12:e4012. doi:10.7717/peerj-cs.4012

BibTeX
@article{Yilmaz2026,
  author = {Yilmaz, Yaren and Karakas, Umutcan and Ulaşlı, Yıldız and Zeybek, Omer Faruk and Tosun, Ayse and Oguducu, Sule Gunduz},
  title = {Fair assessment of fair recommender systems: an experimental framework on model and data characteristics},
  journal = {PeerJ Computer Science},
  year = {2026},
  volume = {12},
  pages = {e4012},
  doi = {10.7717/peerj-cs.4012}
}
Kostenlos starten →