Citation metrics covary with researchers’ assessments of the quality of their works
Quantitative Science Studies · 01.03.2023 · 4 (1) · 105-126
DOI: 10.1162/qss_a_00241 ↗Kurz gefasst
Fachartikel in der Zeitschrift Quantitative Science Studies, online erschienen am 01.03.2023. Verfasst von Dag W. Aksnes und 2 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Norges Forskningsråd.
Abstract (Originalsprache)
For a long time, citation counts have been used to measure scientific impact or quality. Do such measures align with researchers’ assessments of the quality of their work? In this study, we address this issue by decomposing the research quality concept into constituent parts and analyzing their correspondence with citation measures. The focus is on individual publications, their citation counts and how the publications are rated by the authors themselves along quality dimensions. Overall, the study shows a statistically significant relationship for all dimensions analyzed: solidity, novelty/originality, scientific importance and societal impact. The highest correlation is found for scientific importance. However, it is not very strong, but we find distinct gradients when publications are grouped by quality scores. This means that the higher the researchers rate their work, the more they are cited. The results suggest that citation metrics have low reliability as indicators at the level of individual articles, but at aggregated levels, the validity is higher, at least according to how authors perceive quality.
Förderung
- Norges Forskningsråd
Zitieren
APA
Aksnes, D. W., Piro, F. N., & Fossum, L. W. (2023). Citation metrics covary with researchers’ assessments of the quality of their works. Quantitative Science Studies, 4(1), 105-126. https://doi.org/10.1162/qss_a_00241
Vancouver
Aksnes DW, Piro FN, Fossum LW. Citation metrics covary with researchers’ assessments of the quality of their works. Quantitative Science Studies. 2023;4(1):105-126. doi:10.1162/qss_a_00241
BibTeX
@article{Aksnes2023,
author = {Aksnes, Dag W. and Piro, Fredrik Niclas and Fossum, Lone Wanderås},
title = {Citation metrics covary with researchers’ assessments of the quality of their works},
journal = {Quantitative Science Studies},
year = {2023},
volume = {4},
number = {1},
pages = {105--126},
doi = {10.1162/qss_a_00241}
}
EUVIMED