Simple yet Effective Ensemble Feature Selection Using Hierarchical Binning
Applied Sciences · 31.03.2026 · 16 (7) · 3404
DOI: 10.3390/app16073404 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 31.03.2026. Verfasst von Jinho Park und 2 weiteren Autor:innen. Die Arbeit nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Trade, Industry and Energy (MOTIE) https://ror.org/008nkqk13, Korea Evaluation Institute of Industrial Technology (KEIT) https://ror.org/03z9cwa38, Ministry of SMEs and Startups project.
Abstract (Originalsprache)
Feature selection is essential for improving classification performance and reducing overfitting in high-dimensional learning tasks. However, conventional importance-based methods often suffer from instability, model bias, and sensitivity to threshold settings. To address these limitations, we propose EFSHB (Ensemble Feature Selection using Hierarchical Binning), a hybrid ensemble framework that integrates importance-based sorting, bin-level greedy evaluation, iterative hierarchical refinement, and union-based integration of model-wise selected features. At each iteration, five tree-based models independently perform bin-wise greedy selection, and their selected subsets are merged through a union operation to form the feature set for the next iteration. This iterative process progressively refines the feature space while mitigating model-specific bias and promoting robust predictive performance across heterogeneous models. EFSHB was evaluated on nine high-dimensional benchmark datasets, including biomedical gene-expression, synthetic, proteomics, and speech-feature data. Across all datasets, EFSHB achieved the highest or near-highest classification accuracy, outperforming traditional Greedy Feature Selection (GFS), binning-based GFS (GFSB), and hierarchical binning GFS (GFSHB). On average, EFSHB improved accuracy for all classifiers, achieving mean gains of 14.0% over GFS and 13.3% over GFSHB. EFSHB also provided balanced feature reduction by avoiding excessive feature retention while preserving complementary informative features identified across models. In terms of computational efficiency, EFSHB reduced average feature selection time from 266 min (GFS) to 11 min, corresponding to a 24-fold speed-up. These results demonstrate that EFSHB achieves robust predictive performance and high computational efficiency, making it suitable for diverse high-dimensional applications.
Förderung
- Ministry of Trade, Industry and Energy (MOTIE) https://ror.org/008nkqk13
- Korea Evaluation Institute of Industrial Technology (KEIT) https://ror.org/03z9cwa38
- Ministry of SMEs and Startups project
Zitieren
APA
Park, J., Kim, D., & Kim, W. (2026). Simple yet Effective Ensemble Feature Selection Using Hierarchical Binning. Applied Sciences, 16(7), 3404. https://doi.org/10.3390/app16073404
Vancouver
Park J, Kim D, Kim W. Simple yet Effective Ensemble Feature Selection Using Hierarchical Binning. Applied Sciences. 2026;16(7):3404. doi:10.3390/app16073404
BibTeX
@article{Park2026,
author = {Park, Jinho and Kim, Dohun and Kim, Wonjong},
title = {Simple yet Effective Ensemble Feature Selection Using Hierarchical Binning},
journal = {Applied Sciences},
year = {2026},
volume = {16},
number = {7},
pages = {3404},
doi = {10.3390/app16073404}
}
EUVIMED