Too Good to Be True: Bots and Bad Data From Mechanical Turk
Perspectives on Psychological Science · 2024-11 · 19 (6) · 887-890
DOI: 10.1177/17456916221120027 ↗Kurz gefasst
Fachartikel in der Zeitschrift Perspectives on Psychological Science, online erschienen am 07.11.2022. Verfasst von Margaret A Webb und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Criminology, Max-Planck Institute for the Study of Crime, Security, and Law Freiburg im Breisgau. Hauptthemen laut MEDLINE: Psychology. Die Arbeit wurde bisher 136-mal zitiert (Crossref) und nennt 5 Literaturangaben. Gefördert von: National Science Foundation.
Abstract (Originalsprache)
Psychology is moving increasingly toward digital sources of data, with Amazon’s Mechanical Turk (MTurk) at the forefront of that charge. In 2015, up to an estimated 45% of articles published in the top behavioral and social science journals included at least one study conducted on MTurk. In this article, I summarize my own experience with MTurk and how I deduced that my sample was—at best—only 2.6% valid, by my estimate. I share these results as a warning and call for caution. Recently, I conducted an online study via Amazon’s MTurk, eager and excited to collect my own data for the first time as a doctoral student. What resulted has prompted me to write this as a warning: it is indeed too good to be true. This is a summary of how I determined that, at best, I had gathered valid data from 14 human beings—2.6% of my participant sample ( N = 529).
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Criminology, Max-Planck Institute for the Study of Crime, Security, and Law Freiburg im Breisgau.
- Department of Psychology, George Mason University.
ORCID-Profile: Margaret A Webb
Förderung
- National Science Foundation
Zitieren
APA
Webb, M. A., & Tangney, J. P. (2024). Too Good to Be True: Bots and Bad Data From Mechanical Turk. Perspectives on Psychological Science, 19(6), 887-890. https://doi.org/10.1177/17456916221120027
Vancouver
Webb MA, Tangney JP. Too Good to Be True: Bots and Bad Data From Mechanical Turk. Perspectives on Psychological Science. 2024;19(6):887-890. doi:10.1177/17456916221120027
BibTeX
@article{Webb2024,
author = {Webb, Margaret A and Tangney, June P},
title = {Too Good to Be True: Bots and Bad Data From Mechanical Turk},
journal = {Perspectives on Psychological Science},
year = {2024},
volume = {19},
number = {6},
pages = {887--890},
doi = {10.1177/17456916221120027}
}
EUVIMED