EUVIMEDEUVIMED entdecken
Crossref

Evaluating Organizational Effectiveness: A New Strategy to Leverage Multisite Randomized Trials for Valid Assessment

Guanglei Hong, Jonah Deutsch, Peter Kress, Jose Eos Trinidad, Zhengyan Xu

American Journal of Evaluation · 2026-09 · 47 (3) · 392-420

DOI: 10.1177/10982140261438465 ↗

Kurz gefasst

Fachartikel in der Zeitschrift American Journal of Evaluation, online erschienen am 25.04.2026. Verfasst von Guanglei Hong und 4 weiteren Autor:innen. Die Arbeit nennt 98 Literaturangaben. Gefördert von: Spencer Foundation, Institute of Education Sciences.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Determining which organizations are more effective in implementing an intervention program is essential for theoretically and empirically characterizing exemplary practice and for intervening to enhance the capacity of ineffective ones. However, sites differ in their local ecological conditions including client composition, availability of alternative programs, and broader community context. Applying the causal inference framework, this study proposes a formal mathematical definition of an organization's local relative effectiveness attributable solely to malleable organizational practice. Capitalizing on multisite randomized trials, the identification leverages observed control group outcomes that capture some of the confounding impacts of otherwise unmeasured contextual variation. We propose a two-step mixed-effects modeling procedure that adjusts for pre-existing between-site variation. Monte Carlo simulations demonstrate its superior performance compared to conventional methods. We apply the new strategy to an evaluation of Job Corps centers nationwide serving disadvantaged youths.

Förderung

  • Spencer Foundation
  • Institute of Education Sciences

Zitieren

APA

Hong, G., Deutsch, J., Kress, P., Trinidad, J. E., & Xu, Z. (2026). Evaluating Organizational Effectiveness: A New Strategy to Leverage Multisite Randomized Trials for Valid Assessment. American Journal of Evaluation, 47(3), 392-420. https://doi.org/10.1177/10982140261438465

Vancouver

Hong G, Deutsch J, Kress P, Trinidad JE, Xu Z. Evaluating Organizational Effectiveness: A New Strategy to Leverage Multisite Randomized Trials for Valid Assessment. American Journal of Evaluation. 2026;47(3):392-420. doi:10.1177/10982140261438465

BibTeX
@article{Hong2026,
  author = {Hong, Guanglei and Deutsch, Jonah and Kress, Peter and Trinidad, Jose Eos and Xu, Zhengyan},
  title = {Evaluating Organizational Effectiveness: A New Strategy to Leverage Multisite Randomized Trials for Valid Assessment},
  journal = {American Journal of Evaluation},
  year = {2026},
  volume = {47},
  number = {3},
  pages = {392--420},
  doi = {10.1177/10982140261438465}
}
Kostenlos starten →