Reviewer self‐reported confidence and evaluation breadth/depth in open peer review
Journal of the Association for Information Science and Technology · 2026-06 · 77 (6) · 863-885
DOI: 10.1002/asi.70069 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of the Association for Information Science and Technology, online erschienen am 10.03.2026. Verfasst von Weixi Xie und 2 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 43 Literaturangaben.
Abstract (Originalsprache)
Understanding how reviewer self‐reported confidence shapes evaluation behavior is vital, as it influences editorial decisions, the identification of methodological flaws, and which research directions gain prominence. However, prior studies have rarely examined how self‐reported confidence affects both the breadth and depth of review content across distinct evaluative dimensions. This study addresses this gap using large‐scale data from an open peer review platform to analyze the relationship between reviewer self‐reported confidence and evaluation breadth and depth. Results show that self‐reported confidence is negatively associated with breadth, meaning reviewers with higher confidence focus on fewer dimensions. However, it is positively associated with depth, as reviewers with higher confidence provide more detailed, rigorous feedback within chosen dimensions. Dimension‐specific analyses show heterogeneous focus patterns. For soundness, reviewers with higher confidence attend to fewer aspects without adding depth; for contribution, they narrow focus but deepen feedback; for novelty, they broaden focus and increase depth. These findings align with attention allocation theory, suggesting that reviewers with higher confidence selectively allocate attention to dimensions they deem most relevant or demanding.
Zitieren
APA
Xie, W., Jia, P., & Wang, X. (2026). Reviewer self‐reported confidence and evaluation breadth/depth in open peer review. Journal of the Association for Information Science and Technology, 77(6), 863-885. https://doi.org/10.1002/asi.70069
Vancouver
Xie W, Jia P, Wang X. Reviewer self‐reported confidence and evaluation breadth/depth in open peer review. Journal of the Association for Information Science and Technology. 2026;77(6):863-885. doi:10.1002/asi.70069
BibTeX
@article{Xie2026,
author = {Xie, Weixi and Jia, Pengfei and Wang, Xianwen},
title = {Reviewer self‐reported confidence and evaluation breadth/depth in open peer review},
journal = {Journal of the Association for Information Science and Technology},
year = {2026},
volume = {77},
number = {6},
pages = {863--885},
doi = {10.1002/asi.70069}
}
EUVIMED