EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Model-agnostic variable importance for predictive uncertainty: an entropy-based approach

Danny Wood, Theodore Papamarkou, Matt Benatan, Richard Allmendinger

Data Mining and Knowledge Discovery · 2024-11 · 38 (6) · 4184-4216

DOI: 10.1007/s10618-024-01070-7 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Data Mining and Knowledge Discovery, online erschienen am 29.08.2024. Verfasst von Danny Wood und 3 weiteren Autor:innen. Die Arbeit wurde bisher 34-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In order to trust the predictions of a machine learning algorithm, it is necessary to understand the factors that contribute to those predictions. In the case of probabilistic and uncertainty-aware models, it is necessary to understand not only the reasons for the predictions themselves, but also the reasons for the model’s level of confidence in those predictions. In this paper, we show how existing methods in explainability can be extended to uncertainty-aware models and how such extensions can be used to understand the sources of uncertainty in a model’s predictive distribution. In particular, by adapting permutation feature importance, partial dependence plots, and individual conditional expectation plots, we demonstrate that novel insights into model behaviour may be obtained and that these methods can be used to measure the impact of features on both the entropy of the predictive distribution and the log-likelihood of the ground truth labels under that distribution. With experiments using both synthetic and real-world data, we demonstrate the utility of these approaches to understand both the sources of uncertainty and their impact on model performance.

Zitieren

APA

Wood, D., Papamarkou, T., Benatan, M., & Allmendinger, R. (2024). Model-agnostic variable importance for predictive uncertainty: an entropy-based approach. Data Mining and Knowledge Discovery, 38(6), 4184-4216. https://doi.org/10.1007/s10618-024-01070-7

Vancouver

Wood D, Papamarkou T, Benatan M, Allmendinger R. Model-agnostic variable importance for predictive uncertainty: an entropy-based approach. Data Mining and Knowledge Discovery. 2024;38(6):4184-4216. doi:10.1007/s10618-024-01070-7

BibTeX
@article{Wood2024,
  author = {Wood, Danny and Papamarkou, Theodore and Benatan, Matt and Allmendinger, Richard},
  title = {Model-agnostic variable importance for predictive uncertainty: an entropy-based approach},
  journal = {Data Mining and Knowledge Discovery},
  year = {2024},
  volume = {38},
  number = {6},
  pages = {4184--4216},
  doi = {10.1007/s10618-024-01070-7}
}
Kostenlos starten →