EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Identifying the Best Approximating Model in Bayesian Phylogenetics: Bayes Factors, Cross-Validation or wAIC?

Nicolas Lartillot iD

Systematic Biology · 2023

DOI: 10.1093/sysbio/syad004 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Systematic Biology, 2023. Verfasst von Nicolas Lartillot. Beteiligte Einrichtung: Université de Lyon, Université Lyon 1, CNRS, VetAgro Sup, Laboratoire de Biométrie et Biologie Evolutive, UMR5558, Villeurbanne, France. Hauptthemen laut MEDLINE: Phylogeny. Die Arbeit wurde bisher 49-mal zitiert (Crossref) und nennt 88 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Agence Nationale de la Recherche, high-performance computing, Centre Informatique National de l'Enseignement Superieur.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

There is still no consensus as to how to select models in Bayesian phylogenetics, and more generally in applied Bayesian statistics. Bayes factors are often presented as the method of choice, yet other approaches have been proposed, such as cross-validation or information criteria. Each of these paradigms raises specific computational challenges, but they also differ in their statistical meaning, being motivated by different objectives: either testing hypotheses or finding the best-approximating model. These alternative goals entail different compromises, and as a result, Bayes factors, cross-validation, and information criteria may be valid for addressing different questions. Here, the question of Bayesian model selection is revisited, with a focus on the problem of finding the best-approximating model. Several model selection approaches were re-implemented, numerically assessed and compared: Bayes factors, cross-validation (CV), in its different forms (k-fold or leave-one-out), and the widely applicable information criterion (wAIC), which is asymptotically equivalent to leave-one-out cross-validation (LOO-CV). Using a combination of analytical results and empirical and simulation analyses, it is shown that Bayes factors are unduly conservative. In contrast, CV represents a more adequate formalism for selecting the model returning the best approximation of the data-generating process and the most accurate estimates of the parameters of interest. Among alternative CV schemes, LOO-CV and its asymptotic equivalent represented by the wAIC, stand out as the best choices, conceptually and computationally, given that both can be simultaneously computed based on standard Markov chain Monte Carlo runs under the posterior distribution. [Bayes factor; cross-validation; marginal likelihood; model comparison; wAIC.]

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

PhylogenyBayes TheoremComputer SimulationProbabilityMarkov ChainsMonte Carlo Method

Autor:innen und Institutionen

  • Université de Lyon, Université Lyon 1, CNRS, VetAgro Sup, Laboratoire de Biométrie et Biologie Evolutive, UMR5558, Villeurbanne, France.

ORCID-Profile: Nicolas Lartillot

Förderung

  • Agence Nationale de la Recherche
  • high-performance computing
  • Centre Informatique National de l'Enseignement Superieur
  • Grand Équipement National de Calcul Intensif
  • Pôle Rhône-Alpes de Bioinformatique, Laboratoire de Biométrie et Biologie Évolutve
  • Centre Informatique National de l’Enseignement Superieur

Zitieren

APA

Lartillot, N. (2023). Identifying the Best Approximating Model in Bayesian Phylogenetics: Bayes Factors, Cross-Validation or wAIC?. Systematic Biology. https://doi.org/10.1093/sysbio/syad004

Vancouver

Lartillot N. Identifying the Best Approximating Model in Bayesian Phylogenetics: Bayes Factors, Cross-Validation or wAIC?. Systematic Biology. 2023. doi:10.1093/sysbio/syad004

BibTeX
@article{Lartillot2023,
  author = {Lartillot, Nicolas},
  title = {Identifying the Best Approximating Model in Bayesian Phylogenetics: Bayes Factors, Cross-Validation or wAIC?},
  journal = {Systematic Biology},
  year = {2023},
  doi = {10.1093/sysbio/syad004}
}
Kostenlos starten →