EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

No Evidence of Experimenter Demand Effects in Three Online Psychology Experiments

Lucas Woodley iD, Xavier Roberts-Gaal iD, Rachel Calcott iD, Fiery Cushman iD

Open Mind · 15.07.2026 · 10 · 998-1016

DOI: 10.1162/opmi.a.367 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Open Mind, online erschienen am 15.07.2026. Verfasst von Lucas Woodley und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, Harvard University, Cambridge, MA, USA. Die Arbeit nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NSF GRFP, National Defense Science and Engineering Graduate Fellowship Program, Air Force Office of Scientific Research.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Experimenter demand effects occur when participants alter their behavior to align with perceived study hypotheses, threatening internal validity. Concern about demand effects is pervasive in psychology. Experimenter demand may be especially acute in studies relying on experienced participants recruited online (e.g., via Prolific), who may readily guess hypotheses, or when using common paradigms (e.g., vignette studies and interventions) where study goals are transparent. We conducted three preregistered experiments (N = 2,252) examining whether explicit demand cues influence online participants’ behavior across three paradigms commonly used in psychology: a dictator game, replicating prior work on demand effects (Experiment 1); a moral dilemma vignette (Experiment 2); and an intervention on group attitudes (Experiment 3). We randomly assigned participants on Prolific to receive information about the study’s hypothesis or to a no-information control. As expected, we find that receiving such information significantly shifts participants’ beliefs about the study’s hypothesis, creating the potential for experimenter demand effects. Yet we find no evidence that learning any study’s hypothesis alters participants’ behavior, judgments, or attitudes, suggesting that demand effects may be elusive in online samples. Bayesian region-of-practical-equivalence (ROPE) analyses indicate that experimenter demand effects in these paradigms are typically confined to small magnitudes (|d| < 0.20), suggesting that effects larger than Cohen’s d = 0.20 are unlikely to be fully explained by experimenter demand alone. These findings offer important insights for the design and interpretation of modern online psychology experiments.

Schlagwörter

Stichwörter der Autor:innen

demand effectsexperimenter demandinternal validityreactance

Autor:innen und Institutionen

  • Department of Psychology, Harvard University, Cambridge, MA, USA.

ORCID-Profile: Lucas Woodley, Xavier Roberts-Gaal, Rachel Calcott, Fiery Cushman

Förderung

  • NSF GRFP
  • National Defense Science and Engineering Graduate Fellowship Program
  • Air Force Office of Scientific Research

Zitieren

APA

Woodley, L., Roberts-Gaal, X., Calcott, R., & Cushman, F. (2026). No Evidence of Experimenter Demand Effects in Three Online Psychology Experiments. Open Mind, 10, 998-1016. https://doi.org/10.1162/opmi.a.367

Vancouver

Woodley L, Roberts-Gaal X, Calcott R, Cushman F. No Evidence of Experimenter Demand Effects in Three Online Psychology Experiments. Open Mind. 2026;10:998-1016. doi:10.1162/opmi.a.367

BibTeX
@article{Woodley2026,
  author = {Woodley, Lucas and Roberts-Gaal, Xavier and Calcott, Rachel and Cushman, Fiery},
  title = {No Evidence of Experimenter Demand Effects in Three Online Psychology Experiments},
  journal = {Open Mind},
  year = {2026},
  volume = {10},
  pages = {998--1016},
  doi = {10.1162/opmi.a.367}
}
Kostenlos starten →