EUVIMEDEUVIMED entdecken
Crossref

Analysis of an Educational dataset using Classification Algorithm in Conjunction with Wrapper Feature Selection Methods

Mamta Saxena, Netra Pal Singh

International Journal of Technical and Natural Sciences · 2025

DOI: 10.69648/xaph5884 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Technical and Natural Sciences, 2025. Verfasst von Mamta Saxena und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Feature selection plays a critical role in improving the efficiency, accuracy, and interpretability of machine learning models, particularly when dealing with high-dimensional datasets. Among various approaches, wrapper-based feature selection methods are known for their ability to capture feature interactions by directly optimizing model performance. This study presents a comprehensive comparative analysis of six wrapper feature selection techniques—Recursive Feature Elimination (RFE), Sequential Forward Selection (SFS), Sequential Backward Selection (SBS), Genetic Algorithm (GA), Particle Swarm Optimization (PSO), and Differential Evolution (DE)—in conjunction with five widely used classification algorithms: Decision Tree, K-Nearest Neighbour, Random Forest, Logistic Regression, and Support Vector Machine. Experiments are conducted on an educational dataset comprising 395 student records with 30 attributes obtained from the UCI repository, using different feature subset sizes (all features, top 20, top 15, and top 10). Model performance is evaluated using accuracy, precision, recall, F1-score, and AUC. The results demonstrate that wrapper methods significantly enhance classification performance while reducing dimensionality, with GA and RFE consistently emerging as the most effective techniques across multiple classifiers. DE also shows strong performance, particularly with Logistic Regression and Random Forest, whereas PSO generally underperforms in terms of AUC. Furthermore, reducing the feature set does not adversely affect predictive accuracy and, in several cases, leads to improved generalization. The findings confirm the effectiveness of wrapper methods for educational data mining and provide practical insights for selecting optimal feature–classifier combinations.

Zitieren

APA

Saxena, M., & Singh, N. P. (2025). Analysis of an Educational dataset using Classification Algorithm in Conjunction with Wrapper Feature Selection Methods. International Journal of Technical and Natural Sciences. https://doi.org/10.69648/xaph5884

Vancouver

Saxena M, Singh NP. Analysis of an Educational dataset using Classification Algorithm in Conjunction with Wrapper Feature Selection Methods. International Journal of Technical and Natural Sciences. 2025. doi:10.69648/xaph5884

BibTeX
@article{Saxena2025,
  author = {Saxena, Mamta and Singh, Netra Pal},
  title = {Analysis of an Educational dataset using Classification Algorithm in Conjunction with Wrapper Feature Selection Methods},
  journal = {International Journal of Technical and Natural Sciences},
  year = {2025},
  doi = {10.69648/xaph5884}
}
Kostenlos starten →