EUVIMEDEUVIMED entdecken
Crossref

Fast leave-one-cluster-out cross-validation using clustered network information criterion

Jiaxing Qiu iD, Douglas E Lake, Pavel Chernyavskiy, Teague R Henry

Statistical Methods in Medical Research · 2025

DOI: 10.1177/09622802251345486 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Statistical Methods in Medical Research, 2025. Verfasst von Jiaxing Qiu und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Data Science, School of Medicine, University of Virginia, Charlottesville, VA, USA. Hauptthemen laut MEDLINE: Models, Statistical. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 71 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

For prediction models developed on clustered data that do not account for cluster heterogeneity in model parameterization, it is crucial to use cluster-based validation to assess model generalizability on unseen clusters. This article introduces a clustered estimator of the network information criterion to approximate leave-one-cluster-out deviance for standard prediction models with twice-differentiable log-likelihood functions. The clustered network information criterion serves as a fast alternative to cluster-based cross-validation. Stone proved that the Akaike information criterion is asymptotically equivalent to leave-one-observation-out cross-validation for true parametric models with independent and identically distributed observations. Ripley noted that the network information criterion, derived from Stone’s proof, is a better approximation when the model is misspecified. For clustered data, we derived clustered network information criterion by substituting the Fisher information matrix in the network information criterion with a clustering-adjusted estimator. The clustered network information criterion imposes a greater penalty when the data exhibits stronger clustering, thereby allowing the clustered network information criterion to better prevent over-parameterization. In a simulation study and an empirical example, we used standard regression to develop prediction models for clustered data with Gaussian or binomial responses. Compared to the commonly used Akaike information criterion and Bayesian information criterion for standard regression, clustered network information criterion provides a much more accurate approximation to leave-one-cluster-out deviance and results in more accurate model size and variable selection, as determined by cluster-based cross-validation, especially when the data exhibit strong clustering.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Models, StatisticalCluster AnalysisHumansLikelihood FunctionsComputer Simulation

Stichwörter der Autor:innen

Fisher information matrixPredictive modelingcluster-based cross-validationclustered datanetwork information criterion

Autor:innen und Institutionen

  • School of Data Science, School of Medicine, University of Virginia, Charlottesville, VA, USA.
  • Public Health Sciences, School of Data Science, School of Medicine, University of Virginia, Charlottesville, VA, USA.
  • School of Data Science, Department of Psychology, University of Virginia, Charlottesville, VA, USA.

ORCID-Profile: Jiaxing Qiu

Zitieren

APA

Qiu, J., Lake, D. E., Chernyavskiy, P., & Henry, T. R. (2025). Fast leave-one-cluster-out cross-validation using clustered network information criterion. Statistical Methods in Medical Research. https://doi.org/10.1177/09622802251345486

Vancouver

Qiu J, Lake DE, Chernyavskiy P, Henry TR. Fast leave-one-cluster-out cross-validation using clustered network information criterion. Statistical Methods in Medical Research. 2025. doi:10.1177/09622802251345486

BibTeX
@article{Qiu2025,
  author = {Qiu, Jiaxing and Lake, Douglas E and Chernyavskiy, Pavel and Henry, Teague R},
  title = {Fast leave-one-cluster-out cross-validation using clustered network information criterion},
  journal = {Statistical Methods in Medical Research},
  year = {2025},
  doi = {10.1177/09622802251345486}
}
Kostenlos starten →