EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An exploratory feasibility study of adaptive assessment: a multivariate, data-driven approach to formative evaluation

Ahlam Almalawi, Ben Soh, Alice Li, Afrah Alanazi, Halima Samra

Frontiers in Education · 03.08.2026 · 11

DOI: 10.3389/feduc.2026.1849701 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Education, online erschienen am 03.08.2026. Verfasst von Ahlam Almalawi und 4 weiteren Autor:innen. Die Arbeit nennt 21 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

Adaptive assessment has emerged as a promising approach for addressing learner heterogeneity in digital and online education, yet many existing systems rely on predefined psychometric assumptions that inadequately capture the complex, non-linear relationships among learner characteristics, engagement patterns, and academic performance. This study reports an exploratory feasibility study of a data-driven framework for personalised adaptive question recommendation, designed to estimate anticipated item difficulty using a multivariate set of learner indicators comprising prior academic achievement, engagement levels, study behaviours, and prior course experience. Because the anticipated-difficulty label is derived from four of these same learner indicators, the framework is best understood as a proof-of-concept for recovering a theoretically motivated scoring rule rather than as an independently validated measure of difficulty.

Methods

To explore this proof-of-concept, an exploratory research design was adopted using an authentic dataset of 71 undergraduate students enrolled across two courses at a higher education institution in Saudi Arabia. A multilayer perceptron (MLP) model was employed to capture non-linear interactions among learner variables, with preprocessing safeguards including ordinal-preserving feature encoding, LOWESS-based outlier suppression, and stratification-controlled oversampling applied exclusively to the training partition. Model performance was evaluated using Repeated Stratified K-Fold cross-validation across nine classifiers, with holdout test evaluation and post hoc feature influence analysis conducted to support pedagogical interpretability.

Results

The proposed MLP (RMSprop) achieved 93.33% test accuracy (Wilson 95% CI: 70.2%–98.8%, n = 15), demonstrating stable predictive performance and generalisation beyond training data despite sample size constraints. However, the small holdout sample, and the single observation underlying the Hard-class result in particular, mean these figures should be read as indicative rather than precise. Feature analysis indicated that learner engagement and prior academic performance were the most influential contributors to anticipated difficulty estimation, while misclassification patterns were primarily confined to adjacent difficulty levels, reflecting the inherent continuity of learner challenge.

Discussion

The findings suggest that data-driven adaptive mechanisms can complement traditional assessment approaches by providing context-sensitive, learner-relative difficulty estimation aligned with formative assessment principles. Fairness was not empirically evaluated in this study and is identified as a direction for future work rather than a current contribution. While exploratory in nature, this work contributes to bridging the gap between machine learning–based modelling and principled educational assessment design, offering a foundation for future large-scale and multi-context investigations.

Zitieren

APA

Almalawi, A., Soh, B., Li, A., Alanazi, A., & Samra, H. (2026). An exploratory feasibility study of adaptive assessment: a multivariate, data-driven approach to formative evaluation. Frontiers in Education, 11. https://doi.org/10.3389/feduc.2026.1849701

Vancouver

Almalawi A, Soh B, Li A, Alanazi A, Samra H. An exploratory feasibility study of adaptive assessment: a multivariate, data-driven approach to formative evaluation. Frontiers in Education. 2026;11. doi:10.3389/feduc.2026.1849701

BibTeX
@article{Almalawi2026,
  author = {Almalawi, Ahlam and Soh, Ben and Li, Alice and Alanazi, Afrah and Samra, Halima},
  title = {An exploratory feasibility study of adaptive assessment: a multivariate, data-driven approach to formative evaluation},
  journal = {Frontiers in Education},
  year = {2026},
  volume = {11},
  doi = {10.3389/feduc.2026.1849701}
}
Kostenlos starten →