EUVIMEDEUVIMED entdecken
Crossref

Too Good to Be True: Bots and Bad Data From Mechanical Turk

Margaret A Webb iD, June P Tangney

Perspectives on Psychological Science · 2024-11 · 19 (6) · 887-890

DOI: 10.1177/17456916221120027 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Perspectives on Psychological Science, online erschienen am 07.11.2022. Verfasst von Margaret A Webb und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Criminology, Max-Planck Institute for the Study of Crime, Security, and Law Freiburg im Breisgau. Hauptthemen laut MEDLINE: Psychology. Die Arbeit wurde bisher 136-mal zitiert (Crossref) und nennt 5 Literaturangaben. Gefördert von: National Science Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Psychology is moving increasingly toward digital sources of data, with Amazon’s Mechanical Turk (MTurk) at the forefront of that charge. In 2015, up to an estimated 45% of articles published in the top behavioral and social science journals included at least one study conducted on MTurk. In this article, I summarize my own experience with MTurk and how I deduced that my sample was—at best—only 2.6% valid, by my estimate. I share these results as a warning and call for caution. Recently, I conducted an online study via Amazon’s MTurk, eager and excited to collect my own data for the first time as a doctoral student. What resulted has prompted me to write this as a warning: it is indeed too good to be true. This is a summary of how I determined that, at best, I had gathered valid data from 14 human beings—2.6% of my participant sample ( N = 529).

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

PsychologyHumansData Collection

Stichwörter der Autor:innen

Mechanical Turkcrowdsourcingdata qualityresearch data

Autor:innen und Institutionen

  • Department of Criminology, Max-Planck Institute for the Study of Crime, Security, and Law Freiburg im Breisgau.
  • Department of Psychology, George Mason University.

ORCID-Profile: Margaret A Webb

Förderung

  • National Science Foundation

Zitieren

APA

Webb, M. A., & Tangney, J. P. (2024). Too Good to Be True: Bots and Bad Data From Mechanical Turk. Perspectives on Psychological Science, 19(6), 887-890. https://doi.org/10.1177/17456916221120027

Vancouver

Webb MA, Tangney JP. Too Good to Be True: Bots and Bad Data From Mechanical Turk. Perspectives on Psychological Science. 2024;19(6):887-890. doi:10.1177/17456916221120027

BibTeX
@article{Webb2024,
  author = {Webb, Margaret A and Tangney, June P},
  title = {Too Good to Be True: Bots and Bad Data From Mechanical Turk},
  journal = {Perspectives on Psychological Science},
  year = {2024},
  volume = {19},
  number = {6},
  pages = {887--890},
  doi = {10.1177/17456916221120027}
}
Kostenlos starten →