Hybrid Approach to Automated Essay Scoring: Integrating Deep Learning Embeddings with Handcrafted Linguistic Features for Improved Accuracy
Mathematics · 31.10.2024 · 12 (21) · 3416
DOI: 10.3390/math12213416 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematics, online erschienen am 31.10.2024. Verfasst von Muhammad Faseeh und 6 weiteren Autor:innen. Die Arbeit wurde bisher 46-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Korea Agency for Technology and Standards.
Abstract (Originalsprache)
Automated Essay Scoring (AES) systems face persistent challenges in delivering accuracy and efficiency in evaluations. This study introduces an approach that combines embeddings generated using RoBERTa with handcrafted linguistic features, leveraging Lightweight XGBoost (LwXGBoost) for enhanced scoring precision. The embeddings capture the contextual and semantic aspects of essay content, while handcrafted features incorporate domain-specific attributes such as grammar errors, readability, and sentence length. This hybrid feature set allows LwXGBoost to handle high-dimensional data and model intricate feature interactions effectively. Our experiments on a diverse AES dataset, consisting of essays from students across various educational levels, yielded a QWK score of 0.941. This result demonstrates the superior scoring accuracy and the model’s robustness against noisy and sparse data. The research underscores the potential for integrating embeddings with traditional handcrafted features to improve automated assessment systems.
Förderung
- Korea Agency for Technology and Standards
Zitieren
APA
Faseeh, M., Jaleel, A., Iqbal, N., Ghani, A., Abdusalomov, A., Mehmood, A., & Cho, Y. (2024). Hybrid Approach to Automated Essay Scoring: Integrating Deep Learning Embeddings with Handcrafted Linguistic Features for Improved Accuracy. Mathematics, 12(21), 3416. https://doi.org/10.3390/math12213416
Vancouver
Faseeh M, Jaleel A, Iqbal N, Ghani A, Abdusalomov A, Mehmood A, et al. Hybrid Approach to Automated Essay Scoring: Integrating Deep Learning Embeddings with Handcrafted Linguistic Features for Improved Accuracy. Mathematics. 2024;12(21):3416. doi:10.3390/math12213416
BibTeX
@article{Faseeh2024,
author = {Faseeh, Muhammad and Jaleel, Abdul and Iqbal, Naeem and Ghani, Anwar and Abdusalomov, Akmalbek and Mehmood, Asif and Cho, Young-Im},
title = {Hybrid Approach to Automated Essay Scoring: Integrating Deep Learning Embeddings with Handcrafted Linguistic Features for Improved Accuracy},
journal = {Mathematics},
year = {2024},
volume = {12},
number = {21},
pages = {3416},
doi = {10.3390/math12213416}
}
EUVIMED