More than meets the ITT: A guide for anticipating and investigating nonsignificant results in survey experiments
Journal of Experimental Political Science · 2025 · 12 (1) · 110-125
DOI: 10.1017/xps.2024.1 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Experimental Political Science, online erschienen am 19.02.2024. Verfasst von John V. Kane. Die Arbeit wurde bisher 51-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Survey experiments often yield intention-to-treat effects that are either statistically and/or practically “non-significant.” There has been a commendable shift toward publishing such results, either to avoid the “file drawer problem” and/or to encourage studies that conclude in favor of the null hypothesis. But how can researchers more confidently adjudicate between true, versus erroneous, nonsignificant results? Guidance on this critically important question has yet to be synthesized into a single, comprehensive text. The present essay therefore highlights seven “alternative explanations” that can lead to (erroneous) nonsignificant findings. It details how researchers can more rigorously anticipate and investigate these alternative explanations in the design and analysis stages of their studies, and also offers recommendations for subsequent studies. Researchers are thus provided with a set of strategies for better designing their experiments, and more thoroughly investigating their survey-experimental data, before concluding that a given result is indicative of “no significant effect.”
Zitieren
APA
Kane, J. V. (2025). More than meets the ITT: A guide for anticipating and investigating nonsignificant results in survey experiments. Journal of Experimental Political Science, 12(1), 110-125. https://doi.org/10.1017/xps.2024.1
Vancouver
Kane JV. More than meets the ITT: A guide for anticipating and investigating nonsignificant results in survey experiments. Journal of Experimental Political Science. 2025;12(1):110-125. doi:10.1017/xps.2024.1
BibTeX
@article{Kane2025,
author = {Kane, John V.},
title = {More than meets the ITT: A guide for anticipating and investigating nonsignificant results in survey experiments},
journal = {Journal of Experimental Political Science},
year = {2025},
volume = {12},
number = {1},
pages = {110--125},
doi = {10.1017/xps.2024.1}
}
EUVIMED