Bias meets Bayes: Bayesian aggregation for peer and self-ranking
Journal of the Royal Statistical Society Series A: Statistics in Society · 03.11.2026
DOI: 10.1093/jrsssa/qnag122 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of the Royal Statistical Society Series A: Statistics in Society, online erschienen am 03.11.2026. Verfasst von Haoyao Ruan und 3 weiteren Autor:innen. Die Arbeit nennt 40 Literaturangaben. Gefördert von: National Institute of General Medical Sciences of the National Institutes of Health.
Abstract (Originalsprache)
Rank aggregation, which aims to combine multiple ordinal rankings into a single, reliable ranking, is widely studied in diverse fields. In academic and professional settings, peer- and self-evaluations play a pivotal role and offer insights into both individual performance and the competence of rankers. However, subjective biases can lead to unreliable or unfair outcomes, especially in a small sample setting. Despite the broad applications of rank aggregation, existing methods often fail to address nuanced biases and the special structure of such data. This paper introduces BayeSPeer, a novel Bayesian hierarchical model designed to jointly estimate latent performance scores and self-assessment biases in peer- and self-ranking data. Through comprehensive simulation studies, BayeSPeer demonstrates superior performance in rank recovery and top-k identification under various levels of sample size, ranking quality, and bias magnitudes. Real-world applications in classroom peer evaluations also highlight the model’s interpretability and practical utility. Our findings showcase the advantages of incorporating structured bias correction rather than omitting self-evaluation, offering a statistically principled and transparent approach to bias-aware ranking in educational and other evaluation contexts.
Förderung
- National Institute of General Medical Sciences of the National Institutes of Health
Zitieren
APA
Ruan, H., Wang, K., Lim, J., & Wang, X. (2026). Bias meets Bayes: Bayesian aggregation for peer and self-ranking. Journal of the Royal Statistical Society Series A: Statistics in Society. https://doi.org/10.1093/jrsssa/qnag122
Vancouver
Ruan H, Wang K, Lim J, Wang X. Bias meets Bayes: Bayesian aggregation for peer and self-ranking. Journal of the Royal Statistical Society Series A: Statistics in Society. 2026. doi:10.1093/jrsssa/qnag122
BibTeX
@article{Ruan2026,
author = {Ruan, Haoyao and Wang, Kaiwen and Lim, Johan and Wang, Xinlei},
title = {Bias meets Bayes: Bayesian aggregation for peer and self-ranking},
journal = {Journal of the Royal Statistical Society Series A: Statistics in Society},
year = {2026},
doi = {10.1093/jrsssa/qnag122}
}
EUVIMED