Estimating Importance of Highly Correlated Features Using Matrix Factorization
Mathematics & AI · 28.05.2026 · 1 (2)
DOI: 10.66693/mathai.1026 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematics & AI, online erschienen am 28.05.2026. Verfasst von Alexander Minkin. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Hyperspectral images contain a large volume of source data that exhibits high correlations along neighboring spectral bands. This makes it necessary to select the most informative features among correlated groups of features to effectively solve various machine learning problems. A method of feature importance evaluation for hyperspectral image data is proposed. This method combines iterative training of Decision Tree classifiers based on spectral features with matrix factorization to overcome sparsity. Decision trees provide intrinsic feature selection mechanism but only a small number of features are usually taken into account by the CART algorithm for training a single decision tree classifier instance. Furthermore when features are highly correlated (e.g., Pearson $\rho > 0.8$), tree-based methods like Random Forest or XGBoost arbitrarily assign importance to one feature while suppressing others, as they redundantly capture the same signal. To overcome this problem, an additional balancing term was incorporated into the optimization function used to obtain the matrix factorization. The considered method of feature importance evaluation is compared with such model-specific tree-based methods as vanilla Gini impurity decrease and more complicated Boruta algorithm. Classification accuracy is tested using a Random Forest classifier on significant features. Selecting features with higher importance scores yields models boasting greater training accuracy.
Zitieren
APA
Minkin, A. (2026). Estimating Importance of Highly Correlated Features Using Matrix Factorization. Mathematics & AI, 1(2). https://doi.org/10.66693/mathai.1026
Vancouver
Minkin A. Estimating Importance of Highly Correlated Features Using Matrix Factorization. Mathematics & AI. 2026;1(2). doi:10.66693/mathai.1026
BibTeX
@article{Minkin2026,
author = {Minkin, Alexander},
title = {Estimating Importance of Highly Correlated Features Using Matrix Factorization},
journal = {Mathematics & AI},
year = {2026},
volume = {1},
number = {2},
doi = {10.66693/mathai.1026}
}
EUVIMED