The Analytic Fluency Scale: Measuring the Skill of a Data Analyst
Collabra: Psychology · 14.07.2026 · 12 (1)
DOI: 10.1525/collabra.163031 ↗Kurz gefasst
Fachartikel in der Zeitschrift Collabra: Psychology, online erschienen am 14.07.2026. Verfasst von Matthew E. Vanaman und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Psychologists should analyze their data well rather than badly, but how do we know whether they are actually good at analyzing data in the real world? Currently, there is a dearth of empirically grounded criteria for assessing real-world analytic skill, leaving us to judge analysts’ decisions on the uncertain or even arbitrary standards of routine, disciplinary norms, or what “feels right” or “seems off”. This knowledge gap is surprising given widespread concerns about low replication, high rates of questionable research practices, and the recent proliferation of data science initiatives – within and beyond psychology – that purport to increase job-readiness for data-intensive workplaces. We address this gap by introducing a new construct for scholarly inquiry: analytic fluency, or experience-based, real-world analytic decision-making which – due to being learned from real-world experience analyzing data – are commonly assumed to consistently produce trustworthy, informative, and reliable analyses across contexts. Using a mixed methods approach combining interviews with experienced analysts and psychometric validation, we identify four qualitatively distinct and measurable dimensions of analytic skill: Analyzing Flexibly, Appreciating the Importance of Data, Prioritizing Stakeholder Needs, and Striving for Simplicity. We show that analytic fluency scores are predicted by real analytic experience, are empirically distinct from a closely related skillset (statistical knowledge), and show no evidence of bias by gender, race/ethnicity, or education level. By naming and measuring analytic fluency, we address a longstanding conceptual and empirical gap in knowledge about how data analysis is, and ought to be, carried out in practice.
Zitieren
APA
Vanaman, M. E., & Peng, R. D. (2026). The Analytic Fluency Scale: Measuring the Skill of a Data Analyst. Collabra: Psychology, 12(1). https://doi.org/10.1525/collabra.163031
Vancouver
Vanaman ME, Peng RD. The Analytic Fluency Scale: Measuring the Skill of a Data Analyst. Collabra: Psychology. 2026;12(1). doi:10.1525/collabra.163031
BibTeX
@article{Vanaman2026,
author = {Vanaman, Matthew E. and Peng, Roger D.},
title = {The Analytic Fluency Scale: Measuring the Skill of a Data Analyst},
journal = {Collabra: Psychology},
year = {2026},
volume = {12},
number = {1},
doi = {10.1525/collabra.163031}
}
EUVIMED