EUVIMEDEUVIMED entdecken
Crossref

On the “Where” of Social Experiments: Selecting More Representative Samples to Inform Policy

Robert B. Olsen, Larry L. Orr

New Directions for Evaluation · 2016-12 · 2016 (152) · 61-71

DOI: 10.1002/ev.20207 ↗

Kurz gefasst

Fachartikel in der Zeitschrift New Directions for Evaluation, online erschienen am 06.12.2016. Verfasst von Robert B. Olsen und 1 weiteren Autor:innen. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 20 Literaturangaben. Gefördert von: Institute of Education Sciences, U.S. Department of Education, National Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Most social experiments are conducted in samples of sites that are not formally representative of the population of policy interest. These studies may produce impact estimates that are unbiased for the sample but biased for the population from which the sample was selected. Recent research has estimated the bias associated with nonrandom inclusion. Although some research has focused on solutions to the problem at the design stage or the analysis stage, research on ways to address this problem is still sparse. This paper provides four recommendations to help researchers obtain more representative samples in impact studies. The fundamental challenge is that, in most impact studies, sites are not required to participate if selected. Therefore, obtaining a sample that adequately represents the population of policy interest can be difficult, and the resulting impact estimates may suffer from external validity bias. The recommendations in this chapter address this challenge to help researchers obtain more representative samples when obtaining a perfectly representative sample is not possible. The recommendations, which are based on standard survey sampling methods, demonstrate that researchers can take practical steps to obtain impact estimates that are more generalizable from the study sample to the broader population of policy interest—and therefore more relevant for informing policy decisions.

Förderung

  • Institute of Education Sciences
  • U.S. Department of Education
  • National Science Foundation

Zitieren

APA

Olsen, R. B., & Orr, L. L. (2016). On the “Where” of Social Experiments: Selecting More Representative Samples to Inform Policy. New Directions for Evaluation, 2016(152), 61-71. https://doi.org/10.1002/ev.20207

Vancouver

Olsen RB, Orr LL. On the “Where” of Social Experiments: Selecting More Representative Samples to Inform Policy. New Directions for Evaluation. 2016;2016(152):61-71. doi:10.1002/ev.20207

BibTeX
@article{Olsen2016,
  author = {Olsen, Robert B. and Orr, Larry L.},
  title = {On the “Where” of Social Experiments: Selecting More Representative Samples to Inform Policy},
  journal = {New Directions for Evaluation},
  year = {2016},
  volume = {2016},
  number = {152},
  pages = {61--71},
  doi = {10.1002/ev.20207}
}
Kostenlos starten →