Decoding Judgements: Can Holistic Assessment of Writing Quality Be Predicted?
Sage Open · 2026-07 · 16 (3)
DOI: 10.1177/21582440261473308 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sage Open, online erschienen am 22.07.2026. Verfasst von Bayan AlAmir. Die Arbeit nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Human rating of writing is often seen as inherently judgment-based, so writing assessment research often examines how scoring procedures support meaningful and defensible interpretations of scores. Drawing on contemporary measurement theory, which conceptualizes validity as evidence supporting score interpretation and use, this study examines the internal structure of holistic writing assessment by investigating how analytic rubric criteria and their underlying components are statistically associated with teachers’ holistic judgments of writing quality. Ninety-seven academic essays and ninety-six single-paragraph compositions (N = 193) written by EFL learners were evaluated holistically, analytically, and componentially. Two rounds of regression analyses were conducted to examine how analytic criteria and their components account for variance in holistic scores. Results indicated that four of the five analytic criteria—task achievement, grammatical range and accuracy, organization, and mechanics—were significantly associated with holistic scores, whereas lexical resources were not. Componential analyses further demonstrated that structural organization and topical coverage accounted for the largest proportion of variance in holistic judgments. These findings contribute evidence based on internal structure to the validity argument for holistic scoring and provide insight into how teachers weigh construct components when forming holistic assessments of writing quality.
Zitieren
APA
AlAmir, B. (2026). Decoding Judgements: Can Holistic Assessment of Writing Quality Be Predicted?. Sage Open, 16(3). https://doi.org/10.1177/21582440261473308
Vancouver
AlAmir B. Decoding Judgements: Can Holistic Assessment of Writing Quality Be Predicted?. Sage Open. 2026;16(3). doi:10.1177/21582440261473308
BibTeX
@article{AlAmir2026,
author = {AlAmir, Bayan},
title = {Decoding Judgements: Can Holistic Assessment of Writing Quality Be Predicted?},
journal = {Sage Open},
year = {2026},
volume = {16},
number = {3},
doi = {10.1177/21582440261473308}
}
EUVIMED