EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Estimating Importance of Highly Correlated Features Using Matrix Factorization

Alexander Minkin

Mathematics & AI · 28.05.2026 · 1 (2)

DOI: 10.66693/mathai.1026 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Mathematics & AI, online erschienen am 28.05.2026. Verfasst von Alexander Minkin. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Hyperspectral images contain a large volume of source data that exhibits high correlations along neighboring spectral bands. This makes it necessary to select the most informative features among correlated groups of features to effectively solve various machine learning problems. A method of feature importance evaluation for hyperspectral image data is proposed. This method combines iterative training of Decision Tree classifiers based on spectral features with matrix factorization to overcome sparsity. Decision trees provide intrinsic feature selection mechanism but only a small number of features are usually taken into account by the CART algorithm for training a single decision tree classifier instance. Furthermore when features are highly correlated (e.g., Pearson $\rho > 0.8$), tree-based methods like Random Forest or XGBoost arbitrarily assign importance to one feature while suppressing others, as they redundantly capture the same signal. To overcome this problem, an additional balancing term was incorporated into the optimization function used to obtain the matrix factorization. The considered method of feature importance evaluation is compared with such model-specific tree-based methods as vanilla Gini impurity decrease and more complicated Boruta algorithm. Classification accuracy is tested using a Random Forest classifier on significant features. Selecting features with higher importance scores yields models boasting greater training accuracy.

Zitieren

APA

Minkin, A. (2026). Estimating Importance of Highly Correlated Features Using Matrix Factorization. Mathematics & AI, 1(2). https://doi.org/10.66693/mathai.1026

Vancouver

Minkin A. Estimating Importance of Highly Correlated Features Using Matrix Factorization. Mathematics & AI. 2026;1(2). doi:10.66693/mathai.1026

BibTeX
@article{Minkin2026,
  author = {Minkin, Alexander},
  title = {Estimating Importance of Highly Correlated Features Using Matrix Factorization},
  journal = {Mathematics & AI},
  year = {2026},
  volume = {1},
  number = {2},
  doi = {10.66693/mathai.1026}
}
Kostenlos starten →