Less Marking, More Meaning: Assessing Higher-Level Thinking in Engineering with Auto-Graded Exams
Proceedings of the Canadian Engineering Education Association (CEEA) · 07.08.2026
DOI: 10.24908/pceea.2026.21575 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the Canadian Engineering Education Association (CEEA), online erschienen am 07.08.2026. Verfasst von Peter Ostafichuk und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
This study examines measurement quality following a shift from constructed-response (CR) exams to fully auto-graded selected-response (SR) exams in large engineering courses. Using Classical Test Theory, we analyzed ten final exams across three engineering courses spanning a transition from mixed CR/SR to fully auto-graded SR formats. Internal consistency improved in two first-year courses (Cronbach's α: 0.666–0.758 to 0.781–0.851), with lower relative measurement error (SEM/SD), meeting or exceeding published university MCQ reliability norms. These gains occurred alongside a deliberate upward shift in Bloom's Taxonomy level, suggesting increased cognitive demand did not reduce psychometric quality. Discrimination evidence strengthened, with Bloom’s Apply and Analyze subscores retaining particularly strong alignment with overall proficiency. The same metrics remained acceptable and stable in a third-year design course. Overall results support that deliberate SR design is a scalable and psychometrically credible approach for high-stakes assessment across Bloom's levels in the studied contexts.
Zitieren
APA
Ostafichuk, P., & Nakane, J. (2026). Less Marking, More Meaning: Assessing Higher-Level Thinking in Engineering with Auto-Graded Exams. Proceedings of the Canadian Engineering Education Association (CEEA). https://doi.org/10.24908/pceea.2026.21575
Vancouver
Ostafichuk P, Nakane J. Less Marking, More Meaning: Assessing Higher-Level Thinking in Engineering with Auto-Graded Exams. Proceedings of the Canadian Engineering Education Association (CEEA). 2026. doi:10.24908/pceea.2026.21575
BibTeX
@article{Ostafichuk2026,
author = {Ostafichuk, Peter and Nakane, Jon},
title = {Less Marking, More Meaning: Assessing Higher-Level Thinking in Engineering with Auto-Graded Exams},
journal = {Proceedings of the Canadian Engineering Education Association (CEEA)},
year = {2026},
doi = {10.24908/pceea.2026.21575}
}
EUVIMED