Enhancing neural automatic short answer grading with attention masking, WordNet-based semantic enrichment, and ordinal regression
PeerJ Computer Science · 03.11.2026 · 12 · e4157
DOI: 10.7717/peerj-cs.4157 ↗Kurz gefasst
Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 03.11.2026. Verfasst von Nurul Chamidah und 2 weiteren Autor:innen. Die Arbeit nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Directorate of Research Funding and Ecosystem, Universitas Indonesia.
Abstract (Originalsprache)
Automatic Short Answer Grading (ASAG) is an important task in educational technology and natural language processing (NLP), enabling efficient and consistent evaluation of open-ended student responses. Although recent neural architectures have achieved strong performance, further improvements are possible in model focus, semantic understanding, and score consistency. This study builds upon the hybrid convolutional neural network–bidirectional long short-term memory (CNN-BiLSTM) Siamese model by Chen et al. (2023) and introduces three complementary extensions. First, an attention masking mechanism is applied to enhance focus on relevant tokens and reduce noise from padding or less informative text. Second, semantic enrichment is achieved through the integration of WordNet-based lexical similarity, enabling the model to capture deeper relationships between conceptually related terms. Third, rank-consistent ordinal regression replaces categorical prediction to better reflect the ordered nature of grading. Experiments on three datasets (Haidir, Mohler, and Rahutomo) demonstrate that each enhancement improves performance, with the combined model achieving the strongest overall results. On average across datasets, the proposed framework reduces normalized mean absolute error (NMAE) from 0.117 to 0.087 and normalized root mean squared error (NRMSE) from 0.205 to 0.159, while increasing Pearson correlation from 0.703 to 0.806 and Spearman correlation from 0.708 to 0.792. These findings show that integrating attention refinement, external semantic knowledge, and ordinal modelling substantially enhances ASAG accuracy and ranking reliability. This work contributes to the development of more robust, linguistically grounded, and educationally meaningful ASAG systems for diverse learning contexts.
Förderung
- Directorate of Research Funding and Ecosystem, Universitas Indonesia
Zitieren
APA
Chamidah, N., Budi, I., & Aji, R. F. (2026). Enhancing neural automatic short answer grading with attention masking, WordNet-based semantic enrichment, and ordinal regression. PeerJ Computer Science, 12, e4157. https://doi.org/10.7717/peerj-cs.4157
Vancouver
Chamidah N, Budi I, Aji RF. Enhancing neural automatic short answer grading with attention masking, WordNet-based semantic enrichment, and ordinal regression. PeerJ Computer Science. 2026;12:e4157. doi:10.7717/peerj-cs.4157
BibTeX
@article{Chamidah2026,
author = {Chamidah, Nurul and Budi, Indra and Aji, Rizal F.},
title = {Enhancing neural automatic short answer grading with attention masking, WordNet-based semantic enrichment, and ordinal regression},
journal = {PeerJ Computer Science},
year = {2026},
volume = {12},
pages = {e4157},
doi = {10.7717/peerj-cs.4157}
}
EUVIMED