EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

The Burden for High-Quality Online Data Collection Lies With Researchers, Not Recruitment Platforms

Christine Cuskley, Justin Sulik iD

Perspectives on Psychological Science · 2024-11 · 19 (6) · 891-899

DOI: 10.1177/17456916241242734 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Perspectives on Psychological Science, online erschienen am 22.04.2024. Verfasst von Christine Cuskley und 1 weiteren Autor:innen. Beteiligte Einrichtung: Language Evolution, Acquisition, and Development Group, Newcastle University. Hauptthemen laut MEDLINE: Data Collection, Crowdsourcing. Die Arbeit wurde bisher 34-mal zitiert (Crossref) und nennt 72 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

A recent article in Perspectives on Psychological Science (Webb & Tangney, 2022) reported a study in which just 2.6% of participants recruited on Amazon’s Mechanical Turk (MTurk) were deemed “valid.” The authors highlighted some well-established limitations of MTurk, but their central claims—that MTurk is “too good to be true” and that it captured “only 14 human beings . . . [out of] N = 529”—are radically misleading, yet have been repeated widely. This commentary aims to (a) correct the record (i.e., by showing that Webb and Tangney’s approach to data collection led to unusually low data quality) and (b) offer a shift in perspective for running high-quality studies online. Negative attitudes toward MTurk sometimes reflect a fundamental misunderstanding of what the platform offers and how it should be used in research. Beyond pointing to research that details strategies for effective design and recruitment on MTurk, we stress that MTurk is not suitable for every study. Effective use requires specific expertise and design considerations. Like all tools used in research—from advanced hardware to specialist software—the tool itself places constraints on what one should use it for. Ultimately, high-quality data is the responsibility of the researcher, not the crowdsourcing platform.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Data CollectionCrowdsourcingHumansResearch PersonnelInternetData AccuracyPsychologyResearch DesignPatient Selection

Stichwörter der Autor:innen

Mechanical Turkattention checkscrowdsourcingdata qualityethicsonline research

Autor:innen und Institutionen

  • Language Evolution, Acquisition, and Development Group, Newcastle University.
  • Cognition, Values and Behavior, LMU Munich.

ORCID-Profile: Justin Sulik

Zitieren

APA

Cuskley, C., & Sulik, J. (2024). The Burden for High-Quality Online Data Collection Lies With Researchers, Not Recruitment Platforms. Perspectives on Psychological Science, 19(6), 891-899. https://doi.org/10.1177/17456916241242734

Vancouver

Cuskley C, Sulik J. The Burden for High-Quality Online Data Collection Lies With Researchers, Not Recruitment Platforms. Perspectives on Psychological Science. 2024;19(6):891-899. doi:10.1177/17456916241242734

BibTeX
@article{Cuskley2024,
  author = {Cuskley, Christine and Sulik, Justin},
  title = {The Burden for High-Quality Online Data Collection Lies With Researchers, Not Recruitment Platforms},
  journal = {Perspectives on Psychological Science},
  year = {2024},
  volume = {19},
  number = {6},
  pages = {891--899},
  doi = {10.1177/17456916241242734}
}
Kostenlos starten →