Principal feature detection via ϕ-Sobolev inequalities
Bernoulli · 01.11.2024 · 30 (4) · 2979-3003
DOI: 10.3150/23-bej1702 ↗Kurz gefasst
Fachartikel in der Zeitschrift Bernoulli, erschienen am 01.11.2024. Verfasst von Matthew T.C. Li und 2 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 65 Literaturangaben.
Abstract (Originalsprache)
We investigate the approximation of high-dimensional target measures as low-dimensional updates of a dominating reference measure. This approximation class replaces the associated density with the composition of: (i) a feature map that identifies the leading principal components or features of the target measure, relative to the reference, and (ii) a low-dimensional profile function. When the reference measure satisfies a subspace ϕ-Sobolev inequality, we construct a computationally tractable approximation that yields certifiable error guarantees with respect to the Amari α-divergences. Our construction proceeds in two stages. First, for any feature map and any α-divergence, we obtain an analytical expression for the optimal profile function. Second, for linear feature maps, the principal features are obtained from eigenvectors of a matrix involving gradients of the log-density. Neither step requires explicit access to normalizing constants. Notably, by leveraging the ϕ-Sobolev inequalities, we demonstrate that these features universally certify approximation errors across the range of α-divergences α∈(0,1]. We then propose an application to Bayesian inverse problems and provide an analogous construction with approximation guarantees that hold in expectation over the data. We conclude with an extension of the proposed dimension reduction strategy to nonlinear feature maps.
Zitieren
APA
Li, M. T., Marzouk, Y., & Zahm, O. (2024). Principal feature detection via ϕ-Sobolev inequalities. Bernoulli, 30(4), 2979-3003. https://doi.org/10.3150/23-bej1702
Vancouver
Li MT, Marzouk Y, Zahm O. Principal feature detection via ϕ-Sobolev inequalities. Bernoulli. 2024;30(4):2979-3003. doi:10.3150/23-bej1702
BibTeX
@article{Li2024,
author = {Li, Matthew T.C. and Marzouk, Youssef and Zahm, Olivier},
title = {Principal feature detection via ϕ-Sobolev inequalities},
journal = {Bernoulli},
year = {2024},
volume = {30},
number = {4},
pages = {2979--3003},
doi = {10.3150/23-bej1702}
}
EUVIMED