From black box to pedagogical partner: Students’ sense-making of LLM-based automated assessment
Participatory Educational Research · 03.07.2026 · 13 (4) · 251-270
DOI: 10.17275/per.26.58.13.4 ↗Kurz gefasst
Fachartikel in der Zeitschrift Participatory Educational Research, online erschienen am 03.07.2026. Verfasst von Abdulkadir Kara und 1 weiteren Autor:innen. Die Arbeit nennt 59 Literaturangaben. Gefördert von: Atatürk University Graduate School of Educational Sciences.
Abstract (Originalsprache)
While current educational research on automated assessment heavily emphasizes technical validity, a significant gap remains in understanding students’ sustained, real-world experiences with these systems in authentic learning environments. This study examines students’ experiences with a large language model-based automated assessment system embedded in the regular flow of a university course. The study employed a mixed-methods design with 47 university students over a seven-week period. Quantitative data were obtained from system interaction logs and student feedback ratings, while qualitative data were collected from focus group interviews with 24 students and 175 written feedback responses. The results reveal that students perceive the LLM-based assessment system as a learning assistant, an impartial evaluator, and a self-assessment tool. The transparency of explanations was identified as a decisive factor in building trust in the algorithmic system by helping students understand the rationale behind scores and feedback. Sustained interaction with the system triggered a shift from high-frequency trial and error to more efficient and strategic participation, indicating that the assessment criteria were gradually internalized. The system appeared to create an environment free from perceived social judgment, providing favorable conditions for productive failure, repeated attempts, and self-directed revision. Overall, the study demonstrates that artificial intelligence can be positioned as a tool that scales pedagogical intent without replacing the teacher and can be effectively integrated within the framework of human–AI complementarity in higher education.
Förderung
- Atatürk University Graduate School of Educational Sciences
Zitieren
APA
Kara, A., & Yıldırım, S. (2026). From black box to pedagogical partner: Students’ sense-making of LLM-based automated assessment. Participatory Educational Research, 13(4), 251-270. https://doi.org/10.17275/per.26.58.13.4
Vancouver
Kara A, Yıldırım S. From black box to pedagogical partner: Students’ sense-making of LLM-based automated assessment. Participatory Educational Research. 2026;13(4):251-270. doi:10.17275/per.26.58.13.4
BibTeX
@article{Kara2026,
author = {Kara, Abdulkadir and Yıldırım, Serkan},
title = {From black box to pedagogical partner: Students’ sense-making of LLM-based automated assessment},
journal = {Participatory Educational Research},
year = {2026},
volume = {13},
number = {4},
pages = {251--270},
doi = {10.17275/per.26.58.13.4}
}
EUVIMED