Metascientific replication project with the advanced meta-experimental protocol of the transparent psi project procedures for testing the precognitive effect claimed by Bem
PLOS One · 05.11.2025 · 20 (11) · e0335330
DOI: 10.1371/journal.pone.0335330 ↗Kurz gefasst
Studienprotokoll in der Zeitschrift PLOS One, online erschienen am 05.11.2025. Verfasst von Jan Walleczek und 6 weiteren Autor:innen. Beteiligte Einrichtung: Phenoscience Laboratories, Berlin, Germany. Hauptthemen laut MEDLINE: Research Design. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 69 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Fetzer Franklin Fund of the John E. Fetzer Memorial Trust, Scients Institute.
Abstract (Originalsprache)
This metascientific project studied the replicability of Bem Experiment 1, which had claimed a precognitive effect, i.e., the ability to successfully guess the outcome of future random events (Bem. J Pers Soc Psychol. 2011;100: 407−25). The use of advanced methodologies—based on the advanced meta-experimental protocol (AMP) and transparent psi project (TPP) procedures—reduced the risk of false discoveries as a function of (i) confirmation bias, (ii) non-transparency, and (iii) intrinsic measurement bias. The combined AMP-TPP test strategy performed three replication studies with a total of 26,483 participants resulting in N = 420,472 critical trials. Study 1 failed to replicate the precognitive effect. An exploratory analysis of Study 1 suggested an effect in the opposite direction than was originally predicted (49.48% ± 0.26 SE; N = 37,836). Study 2 confirmed this exploratory result using a high-powered replication design (49.65% ± 0.14 SE; p = 0.013; N = 127,000). Study 3 was unable to replicate the result from Study 2 (50.07% ± 0.11 SE; p = 0.496; N = 217,800). The results of Study 2 represent a rare example in psi research of the successful replication of an exploratory result using a confirmatory protocol. The source of the one-time confirmed anomalous result in Study 2 remains to be identified. This result presents either (i) a psi-derived anomaly that defies known physical laws, or (ii) a method-derived anomaly, e.g., a false-positive statistical finding. Using conventional standards, based on the lack of replicability in Study 3 and absence of an accepted scientific theory, the second scenario appears more plausible. This AMP-TPP metascientific project demonstrated the use of advanced controls for assessing the reliability of the employed scientific process. This project shows how rigor-enhancing test strategies can improve the reliability, not only of psi research, but any type of weak-effects experiments, including in psychology.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Phenoscience Laboratories, Berlin, Germany.
- Paradox Science Institute, Palo Alto, Santa Clara, California, United States of America.
- Department of Psychosomatic Medicine and Psychotherapy, Medical Faculty, Medical Center, University of Freiburg, Freiburg, Germany.
- Institute for Frontier Areas of Psychology and Mental Health, Freiburg, Germany.
- Department of Psychology, Technical University Dresden, Dresden, Germany.
- Cognitive Neuroscience Unit, D'Or Institute for Research and Education, Rio de Janeiro, Brazil.
ORCID-Profile: Jan Walleczek, Marc Wittmann
Förderung
- Fetzer Franklin Fund of the John E. Fetzer Memorial Trust
- Scients Institute
Zitieren
APA
Walleczek, J., von Stillfried, N., Schmidt, S., Wittmann, M., Kirmse, K. A., Moll, J., & Kekecs, Z. (2025). Metascientific replication project with the advanced meta-experimental protocol of the transparent psi project procedures for testing the precognitive effect claimed by Bem. PLOS One, 20(11), e0335330. https://doi.org/10.1371/journal.pone.0335330
Vancouver
Walleczek J, von Stillfried N, Schmidt S, Wittmann M, Kirmse KA, Moll J, et al. Metascientific replication project with the advanced meta-experimental protocol of the transparent psi project procedures for testing the precognitive effect claimed by Bem. PLOS One. 2025;20(11):e0335330. doi:10.1371/journal.pone.0335330
BibTeX
@article{Walleczek2025,
author = {Walleczek, Jan and von Stillfried, Nikolaus and Schmidt, Stefan and Wittmann, Marc and Kirmse, Karolina A and Moll, Jorge and Kekecs, Zoltan},
title = {Metascientific replication project with the advanced meta-experimental protocol of the transparent psi project procedures for testing the precognitive effect claimed by Bem},
journal = {PLOS One},
year = {2025},
volume = {20},
number = {11},
pages = {e0335330},
doi = {10.1371/journal.pone.0335330}
}
EUVIMED