EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

The Analytic Fluency Scale: Measuring the Skill of a Data Analyst

Matthew E. Vanaman, Roger D. Peng

Collabra: Psychology · 14.07.2026 · 12 (1)

DOI: 10.1525/collabra.163031 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Collabra: Psychology, online erschienen am 14.07.2026. Verfasst von Matthew E. Vanaman und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Psychologists should analyze their data well rather than badly, but how do we know whether they are actually good at analyzing data in the real world? Currently, there is a dearth of empirically grounded criteria for assessing real-world analytic skill, leaving us to judge analysts’ decisions on the uncertain or even arbitrary standards of routine, disciplinary norms, or what “feels right” or “seems off”. This knowledge gap is surprising given widespread concerns about low replication, high rates of questionable research practices, and the recent proliferation of data science initiatives – within and beyond psychology – that purport to increase job-readiness for data-intensive workplaces. We address this gap by introducing a new construct for scholarly inquiry: analytic fluency, or experience-based, real-world analytic decision-making which – due to being learned from real-world experience analyzing data – are commonly assumed to consistently produce trustworthy, informative, and reliable analyses across contexts. Using a mixed methods approach combining interviews with experienced analysts and psychometric validation, we identify four qualitatively distinct and measurable dimensions of analytic skill: Analyzing Flexibly, Appreciating the Importance of Data, Prioritizing Stakeholder Needs, and Striving for Simplicity. We show that analytic fluency scores are predicted by real analytic experience, are empirically distinct from a closely related skillset (statistical knowledge), and show no evidence of bias by gender, race/ethnicity, or education level. By naming and measuring analytic fluency, we address a longstanding conceptual and empirical gap in knowledge about how data analysis is, and ought to be, carried out in practice.

Zitieren

APA

Vanaman, M. E., & Peng, R. D. (2026). The Analytic Fluency Scale: Measuring the Skill of a Data Analyst. Collabra: Psychology, 12(1). https://doi.org/10.1525/collabra.163031

Vancouver

Vanaman ME, Peng RD. The Analytic Fluency Scale: Measuring the Skill of a Data Analyst. Collabra: Psychology. 2026;12(1). doi:10.1525/collabra.163031

BibTeX
@article{Vanaman2026,
  author = {Vanaman, Matthew E. and Peng, Roger D.},
  title = {The Analytic Fluency Scale: Measuring the Skill of a Data Analyst},
  journal = {Collabra: Psychology},
  year = {2026},
  volume = {12},
  number = {1},
  doi = {10.1525/collabra.163031}
}
Kostenlos starten →