Feature Importance: A Closer Look at Shapley Values and LOCO
Statistical Science · 01.11.2024 · 39 (4) · 623-636
DOI: 10.1214/24-sts937 ↗Kurz gefasst
Fachartikel in der Zeitschrift Statistical Science, erschienen am 01.11.2024. Verfasst von Isabella Verdinelli und 1 weiteren Autor:innen. Die Arbeit wurde bisher 36-mal zitiert (Crossref) und nennt 31 Literaturangaben.
Abstract (Originalsprache)
There is much interest lately in explainability in statistics and machine learning. One aspect of explainability is to quantify the importance of various features (or covariates). Two popular methods for defining variable importance are LOCO (Leave Out COvariates) and Shapley Values. We take a look at the properties of these methods and their advantages and disadvantages. We are particularly interested in the effect of correlation between features which can obscure interpretability. Contrary to some claims, Shapley values do not eliminate feature correlation. We critique the game theoretic axioms for Shapley values and we question their relevance for assessing feature importance. We propose new, more statistically oriented axioms for feature importance and some measures that satisfy these axioms. However, correcting for correlation is a Faustian bargain: removing the effect of correlation creates other forms of bias. Ultimately, we recommend a slightly modified version of LOCO. We briefly consider how to modify Shapley values to better address feature correlation.
Zitieren
APA
Verdinelli, I., & Wasserman, L. (2024). Feature Importance: A Closer Look at Shapley Values and LOCO. Statistical Science, 39(4), 623-636. https://doi.org/10.1214/24-sts937
Vancouver
Verdinelli I, Wasserman L. Feature Importance: A Closer Look at Shapley Values and LOCO. Statistical Science. 2024;39(4):623-636. doi:10.1214/24-sts937
BibTeX
@article{Verdinelli2024,
author = {Verdinelli, Isabella and Wasserman, Larry},
title = {Feature Importance: A Closer Look at Shapley Values and LOCO},
journal = {Statistical Science},
year = {2024},
volume = {39},
number = {4},
pages = {623--636},
doi = {10.1214/24-sts937}
}
EUVIMED