Impact of simulation and reference catalogues on the evaluation of taxonomic profiling pipelines
Microbial Genomics · 2025
DOI: 10.1099/mgen.0.001330 ↗Kurz gefasst
Fachartikel in der Zeitschrift Microbial Genomics, 2025. Verfasst von Vadim Puller und 3 weiteren Autor:innen. Beteiligte Einrichtung: GMT Science 75 route de Lyons-La-Foret, Rouen F-76000, France. Hauptthemen laut MEDLINE: Gastrointestinal Microbiome, Metagenomics, Bacteria. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 68 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Bpifrance, Conseil Régional de Haute Normandie.
Abstract (Originalsprache)
Microbiome profiling tools rely on reference catalogues, which significantly affect their performance. Comparing them is, however, challenging, mainly due to differences in their native catalogues. In this study, we present a novel standardized benchmarking framework that makes such comparisons more accurate. We decided not to customize databases but to translate results to a common reference to use the tools with their native environment. Specifically, we conducted two realistic simulations of gut microbiome samples, each based on a specific taxonomic profiler, and used two different taxonomic references to project their results, namely the Genome Taxonomy Database and the Unified Human Gastrointestinal Genome. To demonstrate the importance of using such a framework, we evaluated four established profilers as well as the impact of the simulations and that of the common taxonomic references on the perceived performance of these profilers. Finally, we provide guidelines to enhance future profiler comparisons for human microbiome ecosystems: (i) use or create realistic simulations tailored to your biological context (BC), (ii) identify a common feature space suited to your BC and independent of the catalogues used by the profilers and (iii) apply a comprehensive set of metrics covering accuracy (sensitivity/precision), overall representativity (richness/Shannon) and quantification (UniFrac and/or Aitchison distance).
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- GMT Science 75 route de Lyons-La-Foret, Rouen F-76000, France.
- IRD, Sorbonne Universit, Unit de Modlisation Mathmatique et Informatique des Systmes Complexes, UMMISCO, 32 Avenue Henri Varagnat, Bondy F-93143, France.
- Sorbonne Universit, INSERM, Nutrition et Obesities; Systemic Approaches, NutriOmique, AP-HP, Hpital Piti-Salptrire, 91 Boulevard de lHpital, Paris F-75013, France.
Förderung
- Bpifrance
- Conseil Régional de Haute Normandie
Zitieren
APA
Puller, V., Plaza Oñate, F., Prifti, E., & de Lahondès, R. (2025). Impact of simulation and reference catalogues on the evaluation of taxonomic profiling pipelines. Microbial Genomics. https://doi.org/10.1099/mgen.0.001330
Vancouver
Puller V, Plaza Oñate F, Prifti E, de Lahondès R. Impact of simulation and reference catalogues on the evaluation of taxonomic profiling pipelines. Microbial Genomics. 2025. doi:10.1099/mgen.0.001330
BibTeX
@article{Puller2025,
author = {Puller, Vadim and Plaza Oñate, Florian and Prifti, Edi and de Lahondès, Raynald},
title = {Impact of simulation and reference catalogues on the evaluation of taxonomic profiling pipelines},
journal = {Microbial Genomics},
year = {2025},
doi = {10.1099/mgen.0.001330}
}
EUVIMED