PanIC: Consistent information criteria for general model selection problems
Australian & New Zealand Journal of Statistics · 2024-12 · 66 (4) · 441-466
DOI: 10.1111/anzs.12426 ↗Kurz gefasst
Fachartikel in der Zeitschrift Australian & New Zealand Journal of Statistics, online erschienen am 31.10.2024. Verfasst von Hien Duy Nguyen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Australian Research Council.
Abstract (Originalsprache)
Model selection is a ubiquitous problem that arises in the application of many statistical and machine learning methods. In the likelihood and related settings, it is typical to use the method of information criteria (ICs) to choose the most parsimonious among competing models by penalizing the likelihood‐based objective function. Theorems guaranteeing the consistency of ICs can often be difficult to verify and are often specific and bespoke. We present a set of results that guarantee consistency for a class of ICs, which we call PanIC (from the Greek root ‘ pan ’, meaning ‘ of everything ’), with easily verifiable regularity conditions. PanICs are applicable in any loss‐based learning problem and are not exclusive to likelihood problems. We illustrate the verification of regularity conditions for model selection problems regarding finite mixture models, least absolute deviation and support vector regression and principal component analysis, and demonstrate the effectiveness of PanICs for such problems via numerical simulations. Furthermore, we present new sufficient conditions for the consistency of BIC‐like estimators and provide comparisons of the BIC with PanIC.
Förderung
- Australian Research Council
Zitieren
APA
Nguyen, H. D. (2024). PanIC: Consistent information criteria for general model selection problems. Australian & New Zealand Journal of Statistics, 66(4), 441-466. https://doi.org/10.1111/anzs.12426
Vancouver
Nguyen HD. PanIC: Consistent information criteria for general model selection problems. Australian & New Zealand Journal of Statistics. 2024;66(4):441-466. doi:10.1111/anzs.12426
BibTeX
@article{Nguyen2024,
author = {Nguyen, Hien Duy},
title = {PanIC: Consistent information criteria for general model selection problems},
journal = {Australian & New Zealand Journal of Statistics},
year = {2024},
volume = {66},
number = {4},
pages = {441--466},
doi = {10.1111/anzs.12426}
}
EUVIMED