Introducing multiverse analysis to bibliometrics: The case of team size effects on disruptive research
Quantitative Science Studies · 15.06.2026 · 7 · 695-716
DOI: 10.1162/qss.a.475 ↗Kurz gefasst
Fachartikel in der Zeitschrift Quantitative Science Studies, online erschienen am 15.06.2026. Verfasst von Christian Leibel und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 77 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: German Federal Ministry of Research, Technology and Space.
Abstract (Originalsprache)
Although bibliometrics has become an essential tool in the evaluation of research performance, bibliometric analyses are sensitive to a range of methodological choices. Subtle choices in data selection, indicator construction, and modeling decisions can substantially alter results. Ensuring robustness—meaning that findings hold up under different reasonable scenarios—is therefore critical for credible research and research evaluation. To address this issue, this study introduces multiverse analysis to bibliometrics. Multiverse analysis is a statistical tool that enables analysts to transparently discuss modeling assumptions and thoroughly assess model robustness. Whereas standard robustness checks usually cover only a small subset of all plausible models, multiverse analysis includes all plausible models. The benefits of multiverse analysis are illustrated by assessing the robustness of the findings reported by Wu, Wang, and Evans (2019), who observed that small teams tend to produce more disruptive research than large teams. While we found robust evidence of a negative effect of team size on disruption index scores, the effect size depends substantially on the model specification. Our findings underscore the importance of assessing the multiverse robustness of bibliometric results to clarify their practical implications.
Förderung
- German Federal Ministry of Research, Technology and Space
Zitieren
APA
Leibel, C., & Bornmann, L. (2026). Introducing multiverse analysis to bibliometrics: The case of team size effects on disruptive research. Quantitative Science Studies, 7, 695-716. https://doi.org/10.1162/qss.a.475
Vancouver
Leibel C, Bornmann L. Introducing multiverse analysis to bibliometrics: The case of team size effects on disruptive research. Quantitative Science Studies. 2026;7:695-716. doi:10.1162/qss.a.475
BibTeX
@article{Leibel2026,
author = {Leibel, Christian and Bornmann, Lutz},
title = {Introducing multiverse analysis to bibliometrics: The case of team size effects on disruptive research},
journal = {Quantitative Science Studies},
year = {2026},
volume = {7},
pages = {695--716},
doi = {10.1162/qss.a.475}
}
EUVIMED