EUVIMEDEUVIMED entdecken
Open Access · CC BY-SA 4.0

A BERT-based modular framework for automated English essay scoring via trait analysis

Jasman Pardede, Rizka Milandga Milenio, Thalita Zharifa Nathania

Bulletin of Electrical Engineering and Informatics · 01.06.2026 · 15 (3) · 2327-2344

DOI: 10.11591/eei.v15i3.11235 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Bulletin of Electrical Engineering and Informatics, online erschienen am 01.06.2026. Verfasst von Jasman Pardede und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Automated essay scoring (AES) systems are commonly implemented using holistic scoring, which limits interpretability and prevents assessment at the writing trait level. As a result, such systems provide limited diagnostic and actionable feedback. To address this limitation, this study proposes a modular trait-based AES framework that separates structure and grammar evaluation while maintaining an integrated scoring mechanism. The proposed framework consists of two modules. The structure module evaluates the ideas, organization, and style traits using a bidirectional encoder representations from transformer-bidirectional long short-term memory (BERT-BiLSTM-Attention) architecture trained on the automated student assessment prize (ASAP) dataset. The grammar module evaluates the Conventions trait by applying a BERT-based grammatical acceptability classifier trained on the Corpus of linguistic acceptability (CoLA) dataset, followed by multinomial logistic regression to convert grammatical patterns into interpretable grammar scores. Experiments were conducted on the ASAP dataset and evaluated using the quadratic weighted Kappa (QWK) metric. The structure module achieved a QWK score of 0.7906 on the test set, while the grammar module obtained a QWK of 0.3923. The integrated holistic score reached a QWK of 0.7847. These results demonstrate that the proposed modular framework improves interpretability and scoring performance, supporting more objective and actionable essay evaluation for formative assessment in English language education.

Zitieren

APA

Pardede, J., Milenio, R. M., & Nathania, T. Z. (2026). A BERT-based modular framework for automated English essay scoring via trait analysis. Bulletin of Electrical Engineering and Informatics, 15(3), 2327-2344. https://doi.org/10.11591/eei.v15i3.11235

Vancouver

Pardede J, Milenio RM, Nathania TZ. A BERT-based modular framework for automated English essay scoring via trait analysis. Bulletin of Electrical Engineering and Informatics. 2026;15(3):2327-2344. doi:10.11591/eei.v15i3.11235

BibTeX
@article{Pardede2026,
  author = {Pardede, Jasman and Milenio, Rizka Milandga and Nathania, Thalita Zharifa},
  title = {A BERT-based modular framework for automated English essay scoring via trait analysis},
  journal = {Bulletin of Electrical Engineering and Informatics},
  year = {2026},
  volume = {15},
  number = {3},
  pages = {2327--2344},
  doi = {10.11591/eei.v15i3.11235}
}
Kostenlos starten →