Do altmetric scores reflect article quality? Evidence from the UK Research Excellence Framework 2021
Journal of the Association for Information Science and Technology · 2023-05 · 74 (5) · 582-593
DOI: 10.1002/asi.24751 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of the Association for Information Science and Technology, online erschienen am 14.03.2023. Verfasst von Mike Thelwall und 6 weiteren Autor:innen. Die Arbeit wurde bisher 26-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Research England, Department for the Economy.
Abstract (Originalsprache)
Altmetrics are web‐based quantitative impact or attention indicators for academic articles that have been proposed to supplement citation counts. This article reports the first assessment of the extent to which mature altmetrics from Altmetric.com and Mendeley associate with individual article quality scores. It exploits expert norm‐referenced peer review scores from the UK Research Excellence Framework 2021 for 67,030+ journal articles in all fields 2014–2017/2018, split into 34 broadly field‐based Units of Assessment (UoAs). Altmetrics correlated more strongly with research quality than previously found, although less strongly than raw and field normalized Scopus citation counts. Surprisingly, field normalizing citation counts can reduce their strength as a quality indicator for articles in a single field. For most UoAs, Mendeley reader counts are the best altmetric (e.g., three Spearman correlations with quality scores above 0.5), tweet counts are also a moderate strength indicator in eight UoAs (Spearman correlations with quality scores above 0.3), ahead of news (eight correlations above 0.3, but generally weaker), blogs (five correlations above 0.3), and Facebook (three correlations above 0.3) citations, at least in the United Kingdom. In general, altmetrics are the strongest indicators of research quality in the health and physical sciences and weakest in the arts and humanities.
Förderung
- Research England
- Department for the Economy
Zitieren
APA
Thelwall, M., Kousha, K., Abdoli, M., Stuart, E., Makita, M., Wilson, P., & Levitt, J. (2023). Do altmetric scores reflect article quality? Evidence from the UK Research Excellence Framework 2021. Journal of the Association for Information Science and Technology, 74(5), 582-593. https://doi.org/10.1002/asi.24751
Vancouver
Thelwall M, Kousha K, Abdoli M, Stuart E, Makita M, Wilson P, et al. Do altmetric scores reflect article quality? Evidence from the UK Research Excellence Framework 2021. Journal of the Association for Information Science and Technology. 2023;74(5):582-593. doi:10.1002/asi.24751
BibTeX
@article{Thelwall2023,
author = {Thelwall, Mike and Kousha, Kayvan and Abdoli, Mahshid and Stuart, Emma and Makita, Meiko and Wilson, Paul and Levitt, Jonathan},
title = {Do altmetric scores reflect article quality? Evidence from the UK Research Excellence Framework 2021},
journal = {Journal of the Association for Information Science and Technology},
year = {2023},
volume = {74},
number = {5},
pages = {582--593},
doi = {10.1002/asi.24751}
}
EUVIMED