Attention-Based Sentence Aggregation Model for Automated Essay Scoring
Korean Educational Research Association · 28.02.2026 · 64 (1) · 29-52
DOI: 10.30916/kera.64.1.29 ↗Kurz gefasst
Fachartikel in der Zeitschrift Korean Educational Research Association, online erschienen am 28.02.2026. Verfasst von Ji Yeong Ahn und 1 weiteren Autor:innen.
Abstract (Originalsprache)
This study examines how prediction performance and sentence information utilization differ according to methods for aggregating sentence-level embeddings to the document level in Korean essay assessment using Automated Essay Scoring (AES). Non-trainable aggregation methods (such as Mean, Max, and Min Pooling) were compared with attention-based aggregation methods that learn sentence-level importance (such as Gated MIL Attention and TransMIL Attention). The results show that simple pooling methods achieved a certain level of performance, but they did not demonstrate consistent advantages across evaluation metrics compared with attention-based approaches. In contrast, Gated MIL Attention and TransMIL Attention performed relatively better on several metrics, indicating that sentence-level information can be more effectively utilized when sentences are differentially weighted or modeled within inter-sentence relational contexts. Result of attention-based aggregation further revealed that sentences assigned higher importance weights tended to perform core argumentative functions, such as presenting claims, providing evidence, and emphasizing key points. These findings suggest that attention-based sentence aggregation is not only beneficial for score prediction but also informative and explainable for interpreting essay structure. Despite limitations related to exploratory analysis and the absence of rater identification data, this study empirically demonstrates that attention-based aggregation constitutes a structurally meaningful approach in AES.
Zitieren
APA
Ahn, J. Y., & Ryoo, J. H. (2026). Attention-Based Sentence Aggregation Model for Automated Essay Scoring. Korean Educational Research Association, 64(1), 29-52. https://doi.org/10.30916/kera.64.1.29
Vancouver
Ahn JY, Ryoo JH. Attention-Based Sentence Aggregation Model for Automated Essay Scoring. Korean Educational Research Association. 2026;64(1):29-52. doi:10.30916/kera.64.1.29
BibTeX
@article{Ahn2026,
author = {Ahn, Ji Yeong and Ryoo, Ji Hoon},
title = {Attention-Based Sentence Aggregation Model for Automated Essay Scoring},
journal = {Korean Educational Research Association},
year = {2026},
volume = {64},
number = {1},
pages = {29--52},
doi = {10.30916/kera.64.1.29}
}
EUVIMED