Ensemble Variable Importance: Combining Random Forest, Neural Network, and Support Vector Machine via Genetic Algorithm (Case Study: Student Productivity)
Infolitika Journal of Data Science · 30.05.2026 · 4 (1) · 8-18
DOI: 10.60084/ijds.v4i1.424 ↗Kurz gefasst
Fachartikel in der Zeitschrift Infolitika Journal of Data Science, online erschienen am 30.05.2026. Verfasst von Asep Rusyana und 6 weiteren Autor:innen. Die Arbeit nennt 22 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
This study proposes and evaluates an ensemble variable‑importance framework that integrates permutation‑based importance scores from three distinct supervised learning algorithms: Random Forest, Neural Network, and Support Vector Machine, using a genetic‑algorithm optimizer. The approach addresses the well‑known problem that algorithm‑specific importance diagnostics can yield divergent feature rankings, complicating substantive interpretation and downstream decision‑making. Using a large publicly available student‑productivity dataset (N = 20,000), predictors describing study behavior, digital‑media use, lifestyle, and academic indicators were normalized with Min–Max scaling, and permutation variable importance (PVI) was estimated repeatedly within each model to obtain stable mean PVI values and standard errors. A genetic algorithm was then employed to search the space of ensemble weightings (rank‑aggregation solutions) that maximize a chosen fitness criterion—Spearman rank concordance with out‑of‑sample predictive relevance—thereby producing a consensus ranking of predictors. Empirical results indicate rapid GA convergence (fitness ≈ 0.82 within 20–30 generations) and strong cross‑model agreement for a small core of predictors: study hours (X3) and focus score (X15) consistently emerged as the most salient features across individual models and in the ensemble ranking. A secondary set of variables (e.g., sleep hours, phone usage, attendance, and stress level) displayed moderate importance, while several features exhibited model‑dependent variability in ranks. The ensemble procedure thereby yields stable, model‑agnostic importance estimates that enhance interpretability and reduce dependence on any single algorithm’s idiosyncrasies. We discuss implications for educational analytics and recommend external validation, targeted feature engineering, and sensitivity analyses (alternate scalings and GA settings) to assess robustness and to support reliable, actionable inferences from machine‑learning models in applied settings.
Zitieren
APA
Rusyana, A., Marzuki, M., Rusdiana, S., AR, F., Nurhasanah, N., Salwa, N., & Mahmudi, M. (2026). Ensemble Variable Importance: Combining Random Forest, Neural Network, and Support Vector Machine via Genetic Algorithm (Case Study: Student Productivity). Infolitika Journal of Data Science, 4(1), 8-18. https://doi.org/10.60084/ijds.v4i1.424
Vancouver
Rusyana A, Marzuki M, Rusdiana S, AR F, Nurhasanah N, Salwa N, et al. Ensemble Variable Importance: Combining Random Forest, Neural Network, and Support Vector Machine via Genetic Algorithm (Case Study: Student Productivity). Infolitika Journal of Data Science. 2026;4(1):8-18. doi:10.60084/ijds.v4i1.424
BibTeX
@article{Rusyana2026,
author = {Rusyana, Asep and Marzuki, Marzuki and Rusdiana, Siti and AR, Fitriana and Nurhasanah, Nurhasanah and Salwa, Nany and Mahmudi, Mahmudi},
title = {Ensemble Variable Importance: Combining Random Forest, Neural Network, and Support Vector Machine via Genetic Algorithm (Case Study: Student Productivity)},
journal = {Infolitika Journal of Data Science},
year = {2026},
volume = {4},
number = {1},
pages = {8--18},
doi = {10.60084/ijds.v4i1.424}
}
EUVIMED