EUVIMEDEUVIMED entdecken
StudienprotokollOpen Access · CC BY 4.0

A Survey-Aware Evaluation Protocol for Feature Selection in Educational Data Mining: Variable-Length Particle Swarm Optimisation Benchmarked on PISA 2018

Odai Amer Hamid, Dalbir Singh, Faizan Qamar, Azuraliza Abu Bakar

Applied System Innovation · 30.10.2026 · 9 (11) · 228

DOI: 10.3390/asi9110228 ↗

Kurz gefasst

Studienprotokoll in der Zeitschrift Applied System Innovation, online erschienen am 30.10.2026. Verfasst von Odai Amer Hamid und 3 weiteren Autor:innen. Die Arbeit nennt 55 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Fundamental Research Grant Scheme (FRGS) of the Ministry of Higher Education, Malaysia, Universiti Kebangsaan Malaysia Internal Funding.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Educational data mining (EDM) often reports classifiers and feature selectors fitted to large-scale assessments without respecting how these surveys are designed. This study specifies an evaluation protocol for such data—a published predictor allowlist enforced in code, school-grouped nested cross-validation, outcome categories derived from each of ten plausible values and combined by Rubin’s rules, and design-based standard errors from replicate weights for the fitted prediction rules—and uses it to benchmark variable-length particle swarm optimisation (VLPSO) against fifteen alternatives on the Spanish sample of PISA 2018 (29,786 students, 1087 schools). Mathematics proficiency bands were discriminated with an area under the curve of 0.8850 (Low vs. High), 0.7520 (Low vs. Medium) and 0.6963 (Medium vs. High); a label-permutation null averaged 0.4989, and measurement error contributed about half of the variance. Across 12,000 matched selector fits, no method improved on the full predictor set. VLPSO retained four to six of 31 items at a cost of 0.0257–0.0368 in AUC, did not differ from binary swarm optimisation, and was less stable than most filter and embedded selectors. SHAP rankings were concordant across 50 models per task, and models transferred to Portugal without loss. VLPSO compresses predictors at a measurable cost; it does not improve prediction.

Förderung

  • Fundamental Research Grant Scheme (FRGS) of the Ministry of Higher Education, Malaysia
  • Universiti Kebangsaan Malaysia Internal Funding

Zitieren

APA

Hamid, O. A., Singh, D., Qamar, F., & Bakar, A. A. (2026). A Survey-Aware Evaluation Protocol for Feature Selection in Educational Data Mining: Variable-Length Particle Swarm Optimisation Benchmarked on PISA 2018. Applied System Innovation, 9(11), 228. https://doi.org/10.3390/asi9110228

Vancouver

Hamid OA, Singh D, Qamar F, Bakar AA. A Survey-Aware Evaluation Protocol for Feature Selection in Educational Data Mining: Variable-Length Particle Swarm Optimisation Benchmarked on PISA 2018. Applied System Innovation. 2026;9(11):228. doi:10.3390/asi9110228

BibTeX
@article{Hamid2026,
  author = {Hamid, Odai Amer and Singh, Dalbir and Qamar, Faizan and Bakar, Azuraliza Abu},
  title = {A Survey-Aware Evaluation Protocol for Feature Selection in Educational Data Mining: Variable-Length Particle Swarm Optimisation Benchmarked on PISA 2018},
  journal = {Applied System Innovation},
  year = {2026},
  volume = {9},
  number = {11},
  pages = {228},
  doi = {10.3390/asi9110228}
}
Kostenlos starten →