Linear-Time Multivariate Unsupervised Feature Selection Using Nyström-Based Entropy Approximation
Mathematics · 05.11.2026 · 14 (21) · 4057
DOI: 10.3390/math14214057 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematics, online erschienen am 05.11.2026. Verfasst von Gyu-Il Kim und 3 weiteren Autor:innen. Die Arbeit nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Institute of Information & Communications Technology Planning & Evaluation.
Abstract (Originalsprache)
Unsupervised feature selection seeks to identify informative, nonredundant features without using class labels. Motivated by Fano’s inequality, we use the entropy of the selected feature subset as a task-agnostic heuristic for its information capacity. Because multivariate joint entropy is difficult to estimate and exact evaluation of all pairwise joint entropies is computationally costly, we propose a landmark-based block approximation inspired by the Nyström method. Features with high marginal entropy are selected as landmarks. Joint entropy is computed exactly for pairs involving at least one landmark, while non-landmark pairs are approximated in constant time per pair using the geometric mean of their marginal entropies. We establish deterministic bounds for the surrogate and incorporate the resulting hybrid estimator into an incremental feature selection strategy. Experiments on 25 public benchmark datasets show that the proposed method achieves the lowest average rank across eight evaluation metrics. It exhibits significant advantages over most baselines on information-preservation metrics while maintaining competitive classification and clustering performance.
Förderung
- Institute of Information & Communications Technology Planning & Evaluation
Zitieren
APA
Kim, G., Khairulov, T., Seo, W., & Lee, J. (2026). Linear-Time Multivariate Unsupervised Feature Selection Using Nyström-Based Entropy Approximation. Mathematics, 14(21), 4057. https://doi.org/10.3390/math14214057
Vancouver
Kim G, Khairulov T, Seo W, Lee J. Linear-Time Multivariate Unsupervised Feature Selection Using Nyström-Based Entropy Approximation. Mathematics. 2026;14(21):4057. doi:10.3390/math14214057
BibTeX
@article{Kim2026,
author = {Kim, Gyu-Il and Khairulov, Timur and Seo, Wangduk and Lee, Jaesung},
title = {Linear-Time Multivariate Unsupervised Feature Selection Using Nyström-Based Entropy Approximation},
journal = {Mathematics},
year = {2026},
volume = {14},
number = {21},
pages = {4057},
doi = {10.3390/math14214057}
}
EUVIMED