Repeatedly unreliable, and unreliably repeatable: the trials-to-criterion fallacy
Animal Cognition · 13.07.2026 · 29 (1)
DOI: 10.1007/s10071-026-02082-0 ↗Kurz gefasst
Fachartikel in der Zeitschrift Animal Cognition, online erschienen am 13.07.2026. Verfasst von Robert J Dugand. Beteiligte Einrichtung: Centre for Evolutionary Biology, School of Biological Sciences, The University of Western Australia, Crawley, WA, 6009, Australia. robert.dugand@uwa.…. Hauptthemen laut MEDLINE: Intelligence, Learning. Die Arbeit nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: University of Western Australia.
Abstract (Originalsprache)
Trials-to-criterion (TTC) is a common method used to quantify learning speed and estimate intelligence. Often, individuals are presented with tasks that have two choices: one has a reward (pass), while the other does not (fail). The task is repeatedly presented until a pre-determined criterion is met (e.g., five passes in a row). The total number of trials to reach the criterion purportedly estimates intelligence, with lower scores reflecting higher intelligence. However, in any given trial, the probability of guessing correctly and passing is 50%, meaning that lucky streaks can readily result in individuals reaching the task criterion by chance. Although the criterion is intended to minimise lucky streaks and ensure that < 5% of tasks are completed by random chance, this is a long recognised, but underappreciated, fallacy of TTC. Using simulations, I show the extent to which random runs of passes, rather than deterministic reaching of the task completion criterion via learning, conflate ‘smart’ with ‘lucky’. Moreover, occasional errors by intelligent individuals can dramatically inflate scores, conflating ‘smart-less’ with ‘luck-less’. The extreme variability in outcomes generated by TTC for a fixed level of intelligence exposes its unreliability and suggests that inferences based on TTC data may often be misleading. I offer considerations for future studies that aim to reduce the risk of artefactual results, but ultimately caution against TTC.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Centre for Evolutionary Biology, School of Biological Sciences, The University of Western Australia, Crawley, WA, 6009, Australia. robert.dugand@uwa.edu.au.
Förderung
- University of Western Australia
Zitieren
APA
Dugand, R. J. (2026). Repeatedly unreliable, and unreliably repeatable: the trials-to-criterion fallacy. Animal Cognition, 29(1). https://doi.org/10.1007/s10071-026-02082-0
Vancouver
Dugand RJ. Repeatedly unreliable, and unreliably repeatable: the trials-to-criterion fallacy. Animal Cognition. 2026;29(1). doi:10.1007/s10071-026-02082-0
BibTeX
@article{Dugand2026,
author = {Dugand, Robert J},
title = {Repeatedly unreliable, and unreliably repeatable: the trials-to-criterion fallacy},
journal = {Animal Cognition},
year = {2026},
volume = {29},
number = {1},
doi = {10.1007/s10071-026-02082-0}
}
EUVIMED