EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Hybrid Semantic–Syntactic NLP Framework for Intelligent Grading of Short Answers and Cloze Questions

Olaniyan Julius, Silas Formunyuy Verkijika, Ibidun C. Obagbuwa

Applied Sciences · 26.03.2026 · 16 (7) · 3191

DOI: 10.3390/app16073191 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 26.03.2026. Verfasst von Olaniyan Julius und 2 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: I.C.O..

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The increasing demand for scalable and fair assessment of open-form responses in digital education shows the need for intelligent grading systems capable of balancing syntactic precision with semantic understanding. This study proposes a hybrid semantic–syntactic NLP framework for automated grading of short-answer and cloze-type questions. The framework integrates a rule-based matcher for syntactic accuracy, MPNet (Masked and Permuted Pre-trained Network) embeddings for semantic similarity, and a fine-tuned DeBERTa (Decoding-enhanced Bidirectional Encoder Representations from Transformer with Disentangled Attention) regressor for continuous score prediction, while a T5-small model provides pedagogically aligned feedback generation. Evaluations were conducted using benchmark corpora, synthetic cloze datasets, and a domain-specific short-answer corpus. Results demonstrate that the hybrid system outperforms traditional baselines, achieving 91% accuracy, a 0.89 F1 score, a mean absolute error of 0.36, and strong inter-rater agreement (κ = 0.87), aligning closely with human graders. Qualitative analyses show that the framework successfully recognizes paraphrased responses, assigns partial credit, and generates meaningful feedback. Ablation studies further validate the necessity of each subsystem, with performance significantly declining when components were removed. The findings confirm that the proposed framework is both computationally robust and pedagogically valuable, establishing a foundation for scalable, interpretable, and fair automated grading in contemporary educational environments.

Förderung

  • I.C.O.

Zitieren

APA

Julius, O., Verkijika, S. F., & Obagbuwa, I. C. (2026). Hybrid Semantic–Syntactic NLP Framework for Intelligent Grading of Short Answers and Cloze Questions. Applied Sciences, 16(7), 3191. https://doi.org/10.3390/app16073191

Vancouver

Julius O, Verkijika SF, Obagbuwa IC. Hybrid Semantic–Syntactic NLP Framework for Intelligent Grading of Short Answers and Cloze Questions. Applied Sciences. 2026;16(7):3191. doi:10.3390/app16073191

BibTeX
@article{Julius2026,
  author = {Julius, Olaniyan and Verkijika, Silas Formunyuy and Obagbuwa, Ibidun C.},
  title = {Hybrid Semantic–Syntactic NLP Framework for Intelligent Grading of Short Answers and Cloze Questions},
  journal = {Applied Sciences},
  year = {2026},
  volume = {16},
  number = {7},
  pages = {3191},
  doi = {10.3390/app16073191}
}
Kostenlos starten →