EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

More than meets the ITT: A guide for anticipating and investigating nonsignificant results in survey experiments

John V. Kane

Journal of Experimental Political Science · 2025 · 12 (1) · 110-125

DOI: 10.1017/xps.2024.1 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Experimental Political Science, online erschienen am 19.02.2024. Verfasst von John V. Kane. Die Arbeit wurde bisher 51-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Survey experiments often yield intention-to-treat effects that are either statistically and/or practically “non-significant.” There has been a commendable shift toward publishing such results, either to avoid the “file drawer problem” and/or to encourage studies that conclude in favor of the null hypothesis. But how can researchers more confidently adjudicate between true, versus erroneous, nonsignificant results? Guidance on this critically important question has yet to be synthesized into a single, comprehensive text. The present essay therefore highlights seven “alternative explanations” that can lead to (erroneous) nonsignificant findings. It details how researchers can more rigorously anticipate and investigate these alternative explanations in the design and analysis stages of their studies, and also offers recommendations for subsequent studies. Researchers are thus provided with a set of strategies for better designing their experiments, and more thoroughly investigating their survey-experimental data, before concluding that a given result is indicative of “no significant effect.”

Zitieren

APA

Kane, J. V. (2025). More than meets the ITT: A guide for anticipating and investigating nonsignificant results in survey experiments. Journal of Experimental Political Science, 12(1), 110-125. https://doi.org/10.1017/xps.2024.1

Vancouver

Kane JV. More than meets the ITT: A guide for anticipating and investigating nonsignificant results in survey experiments. Journal of Experimental Political Science. 2025;12(1):110-125. doi:10.1017/xps.2024.1

BibTeX
@article{Kane2025,
  author = {Kane, John V.},
  title = {More than meets the ITT: A guide for anticipating and investigating nonsignificant results in survey experiments},
  journal = {Journal of Experimental Political Science},
  year = {2025},
  volume = {12},
  number = {1},
  pages = {110--125},
  doi = {10.1017/xps.2024.1}
}
Kostenlos starten →