EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A realistic benchmark for differential abundance testing and confounder adjustment in human microbiome studies

Jakob Wirbel, Morgan Essex, Sofia Kirke Forslund, Georg Zeller iD

Genome Biology · 25.09.2024 · 25 (1)

DOI: 10.1186/s13059-024-03390-9 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Genome Biology, online erschienen am 25.09.2024. Verfasst von Jakob Wirbel und 3 weiteren Autor:innen. Beteiligte Einrichtung: Structural and Computational Biology Unit (SCB), European Molecular Biology Laboratory (EMBL), Heidelberg, Germany. Hauptthemen laut MEDLINE: Microbiota, Benchmarking. Die Arbeit wurde bisher 58-mal zitiert (Crossref) und nennt 96 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

In microbiome disease association studies, it is a fundamental task to test which microbes differ in their abundance between groups. Yet, consensus on suitable or optimal statistical methods for differential abundance testing is lacking, and it remains unexplored how these cope with confounding. Previous differential abundance benchmarks relying on simulated datasets did not quantitatively evaluate the similarity to real data, which undermines their recommendations.

Results

Our simulation framework implants calibrated signals into real taxonomic profiles, including signals mimicking confounders. Using several whole meta-genome and 16S rRNA gene amplicon datasets, we validate that our simulated data resembles real data from disease association studies much more than in previous benchmarks . With extensively parametrized simulations, we benchmark the performance of nineteen differential abundance methods and further evaluate the best ones on confounded simulations. Only classic statistical methods (linear models, the Wilcoxon test, t -test), limma , and fastANCOM properly control false discoveries at relatively high sensitivity. When additionally considering confounders, these issues are exacerbated, but we find that adjusted differential abundance testing can effectively mitigate them. In a large cardiometabolic disease dataset, we showcase that failure to account for covariates such as medication causes spurious association in real-world applications.

Conclusions

Tight error control is critical for microbiome association studies. The unsatisfactory performance of many differential abundance methods and the persistent danger of unchecked confounding suggest these contribute to a lack of reproducibility among such studies. We have open-sourced our simulation and benchmarking software to foster a much-needed consolidation of statistical methodology for microbiome research.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

MicrobiotaBenchmarkingHumansRNA, Ribosomal, 16SComputer Simulation

Stichwörter der Autor:innen

BenchmarkConfoundingDifferential abundanceMetagenomicsMicrobiome

Substanzen

RNA, Ribosomal, 16S

Autor:innen und Institutionen

  • Structural and Computational Biology Unit (SCB), European Molecular Biology Laboratory (EMBL), Heidelberg, Germany.
  • Experimental and Clinical Research Center (ECRC), a cooperation of the Max-Delbrück Center and Charité-Universitätsmedizin, Berlin, Germany.
  • Max-Delbrück Center for Molecular Medicine in the Helmholtz Association (MDC), Berlin, Germany.
  • Charité-Universitätsmedizin Berlin (a corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin), Berlin, Germany.
  • Structural and Computational Biology Unit (SCB), European Molecular Biology Laboratory (EMBL), Heidelberg, Germany. sofia.forslund@mdc-berlin.de.
  • Experimental and Clinical Research Center (ECRC), a cooperation of the Max-Delbrück Center and Charité-Universitätsmedizin, Berlin, Germany. sofia.forslund@mdc-berlin.de.

ORCID-Profile: Georg Zeller

Zitieren

APA

Wirbel, J., Essex, M., Forslund, S. K., & Zeller, G. (2024). A realistic benchmark for differential abundance testing and confounder adjustment in human microbiome studies. Genome Biology, 25(1). https://doi.org/10.1186/s13059-024-03390-9

Vancouver

Wirbel J, Essex M, Forslund SK, Zeller G. A realistic benchmark for differential abundance testing and confounder adjustment in human microbiome studies. Genome Biology. 2024;25(1). doi:10.1186/s13059-024-03390-9

BibTeX
@article{Wirbel2024,
  author = {Wirbel, Jakob and Essex, Morgan and Forslund, Sofia Kirke and Zeller, Georg},
  title = {A realistic benchmark for differential abundance testing and confounder adjustment in human microbiome studies},
  journal = {Genome Biology},
  year = {2024},
  volume = {25},
  number = {1},
  doi = {10.1186/s13059-024-03390-9}
}
Kostenlos starten →