EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Cross‐validated permutation feature importance considering correlation between features

Hiromasa Kaneko

Analytical Science Advances · 2022-10 · 3 (9-10) · 278-287

DOI: 10.1002/ansa.202200018 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Analytical Science Advances, online erschienen am 07.09.2022. Verfasst von Hiromasa Kaneko. Beteiligte Einrichtung: Department of Applied Chemistry, School of Science and Technology Meiji University Kawasaki Japan. Die Arbeit wurde bisher 148-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Society for the Promotion of Science.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In molecular design, material design, process design, and process control, it is important not only to construct a model with high predictive ability between explanatory features x and objective features y using a dataset but also to interpret the constructed model. An index of feature importance in x is permutation feature importance (PFI), which can be combined with any regressors and classifiers. However, the PFI becomes unstable when the number of samples is low because it is necessary to divide a dataset into training and validation data when calculating it. Additionally, when there are strongly correlated features in x, the PFI of these features is estimated to be low. Hence, a cross‐validated PFI (CVPFI) method is proposed. CVPFI can be calculated stably, even with a small number of samples, because model construction and feature evaluation are repeated based on cross‐validation. Furthermore, by considering the absolute correlation coefficients between the features, the feature importance can be evaluated appropriately even when there are strongly correlated features in x. Case studies using numerical simulation data and actual compound data showed that the feature importance can be evaluated appropriately using CVPFI compared to PFI. This is possible when the number of samples is low, when linear and nonlinear relationships are mixed between x and y when there are strong correlations between features in x, and when quantised and biased features exist in x. Python codes for CVPFI are available at https://github.com/hkaneko1985/dcekit .

Schlagwörter

Stichwörter der Autor:innen

correlationcross‐validationfeature importancemodel interpretationpermutation importance

Autor:innen und Institutionen

  • Department of Applied Chemistry, School of Science and Technology Meiji University Kawasaki Japan.

Förderung

  • Japan Society for the Promotion of Science

Zitieren

APA

Kaneko, H. (2022). Cross‐validated permutation feature importance considering correlation between features. Analytical Science Advances, 3(9-10), 278-287. https://doi.org/10.1002/ansa.202200018

Vancouver

Kaneko H. Cross‐validated permutation feature importance considering correlation between features. Analytical Science Advances. 2022;3(9-10):278-287. doi:10.1002/ansa.202200018

BibTeX
@article{Kaneko2022,
  author = {Kaneko, Hiromasa},
  title = {Cross‐validated permutation feature importance considering correlation between features},
  journal = {Analytical Science Advances},
  year = {2022},
  volume = {3},
  number = {9-10},
  pages = {278--287},
  doi = {10.1002/ansa.202200018}
}
Kostenlos starten →