Fast leave-one-cluster-out cross-validation using clustered network information criterion
Statistical Methods in Medical Research · 2025
DOI: 10.1177/09622802251345486 ↗Kurz gefasst
Fachartikel in der Zeitschrift Statistical Methods in Medical Research, 2025. Verfasst von Jiaxing Qiu und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Data Science, School of Medicine, University of Virginia, Charlottesville, VA, USA. Hauptthemen laut MEDLINE: Models, Statistical. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 71 Literaturangaben.
Abstract (Originalsprache)
For prediction models developed on clustered data that do not account for cluster heterogeneity in model parameterization, it is crucial to use cluster-based validation to assess model generalizability on unseen clusters. This article introduces a clustered estimator of the network information criterion to approximate leave-one-cluster-out deviance for standard prediction models with twice-differentiable log-likelihood functions. The clustered network information criterion serves as a fast alternative to cluster-based cross-validation. Stone proved that the Akaike information criterion is asymptotically equivalent to leave-one-observation-out cross-validation for true parametric models with independent and identically distributed observations. Ripley noted that the network information criterion, derived from Stone’s proof, is a better approximation when the model is misspecified. For clustered data, we derived clustered network information criterion by substituting the Fisher information matrix in the network information criterion with a clustering-adjusted estimator. The clustered network information criterion imposes a greater penalty when the data exhibits stronger clustering, thereby allowing the clustered network information criterion to better prevent over-parameterization. In a simulation study and an empirical example, we used standard regression to develop prediction models for clustered data with Gaussian or binomial responses. Compared to the commonly used Akaike information criterion and Bayesian information criterion for standard regression, clustered network information criterion provides a much more accurate approximation to leave-one-cluster-out deviance and results in more accurate model size and variable selection, as determined by cluster-based cross-validation, especially when the data exhibit strong clustering.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Data Science, School of Medicine, University of Virginia, Charlottesville, VA, USA.
- Public Health Sciences, School of Data Science, School of Medicine, University of Virginia, Charlottesville, VA, USA.
- School of Data Science, Department of Psychology, University of Virginia, Charlottesville, VA, USA.
ORCID-Profile: Jiaxing Qiu
Zitieren
APA
Qiu, J., Lake, D. E., Chernyavskiy, P., & Henry, T. R. (2025). Fast leave-one-cluster-out cross-validation using clustered network information criterion. Statistical Methods in Medical Research. https://doi.org/10.1177/09622802251345486
Vancouver
Qiu J, Lake DE, Chernyavskiy P, Henry TR. Fast leave-one-cluster-out cross-validation using clustered network information criterion. Statistical Methods in Medical Research. 2025. doi:10.1177/09622802251345486
BibTeX
@article{Qiu2025,
author = {Qiu, Jiaxing and Lake, Douglas E and Chernyavskiy, Pavel and Henry, Teague R},
title = {Fast leave-one-cluster-out cross-validation using clustered network information criterion},
journal = {Statistical Methods in Medical Research},
year = {2025},
doi = {10.1177/09622802251345486}
}
EUVIMED