EUVIMEDEUVIMED entdecken
Open Access · CC BY-SA 4.0

Should teacher observation systems be used for making high-stakes decisions?

Michael Strong, Jaehoon Lee, John Gargani, Minju Yi, Hyunjin Shim, Hyunchang Moon

Education Policy Analysis Archives · 07.04.2026 · 34

DOI: 10.14507/epaa.34.9841 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Education Policy Analysis Archives, online erschienen am 07.04.2026. Verfasst von Michael Strong und 5 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study questions the suitability of teaching observation data for making high-stakes decisions that affect teachers. We define suitability (the extent to which intended purposes are advanced without causing undue harm) and argue that it fundamentally depends on the technical properties of the data produced by an observation system, which, in turn, depend on the attributes designed into the system. We conducted an experiment to understand better the relationship between the attributes of teaching observation systems and the suitability of their data. We compared three systems with different attributes, including rubrics that impose varying inference loads on raters. Experienced raters were randomly assigned to a system and properly trained. Then, they evaluated the instruction of advanced teacher candidates by viewing videos of their lessons. We considered three criteria when judging the resulting data: the power to predict a teacher’s contribution to student learning, the correlation of scores across systems, and rater agreement within systems. We found that a system with a low inference load (along with other attributes) outperformed systems with higher inference loads, but it may still be insufficient for making confident, high-stakes decisions. We maintain that few, if any, widely used observation systems are.

Zitieren

APA

Strong, M., Lee, J., Gargani, J., Yi, M., Shim, H., & Moon, H. (2026). Should teacher observation systems be used for making high-stakes decisions?. Education Policy Analysis Archives, 34. https://doi.org/10.14507/epaa.34.9841

Vancouver

Strong M, Lee J, Gargani J, Yi M, Shim H, Moon H. Should teacher observation systems be used for making high-stakes decisions?. Education Policy Analysis Archives. 2026;34. doi:10.14507/epaa.34.9841

BibTeX
@article{Strong2026,
  author = {Strong, Michael and Lee, Jaehoon and Gargani, John and Yi, Minju and Shim, Hyunjin and Moon, Hyunchang},
  title = {Should teacher observation systems be used for making high-stakes decisions?},
  journal = {Education Policy Analysis Archives},
  year = {2026},
  volume = {34},
  doi = {10.14507/epaa.34.9841}
}
Kostenlos starten →