EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Impact of simulation and reference catalogues on the evaluation of taxonomic profiling pipelines

Vadim Puller, Florian Plaza Oñate, Edi Prifti, Raynald de Lahondès

Microbial Genomics · 2025

DOI: 10.1099/mgen.0.001330 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Microbial Genomics, 2025. Verfasst von Vadim Puller und 3 weiteren Autor:innen. Beteiligte Einrichtung: GMT Science 75 route de Lyons-La-Foret, Rouen F-76000, France. Hauptthemen laut MEDLINE: Gastrointestinal Microbiome, Metagenomics, Bacteria. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 68 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Bpifrance, Conseil Régional de Haute Normandie.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Microbiome profiling tools rely on reference catalogues, which significantly affect their performance. Comparing them is, however, challenging, mainly due to differences in their native catalogues. In this study, we present a novel standardized benchmarking framework that makes such comparisons more accurate. We decided not to customize databases but to translate results to a common reference to use the tools with their native environment. Specifically, we conducted two realistic simulations of gut microbiome samples, each based on a specific taxonomic profiler, and used two different taxonomic references to project their results, namely the Genome Taxonomy Database and the Unified Human Gastrointestinal Genome. To demonstrate the importance of using such a framework, we evaluated four established profilers as well as the impact of the simulations and that of the common taxonomic references on the perceived performance of these profilers. Finally, we provide guidelines to enhance future profiler comparisons for human microbiome ecosystems: (i) use or create realistic simulations tailored to your biological context (BC), (ii) identify a common feature space suited to your BC and independent of the catalogues used by the profilers and (iii) apply a comprehensive set of metrics covering accuracy (sensitivity/precision), overall representativity (richness/Shannon) and quantification (UniFrac and/or Aitchison distance).

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Gastrointestinal MicrobiomeMetagenomicsBacteriaHumansComputer SimulationMicrobiotaComputational BiologyBenchmarking

Stichwörter der Autor:innen

biasgut microbiomeprofiling toolreference cataloguessimulation

Autor:innen und Institutionen

  • GMT Science 75 route de Lyons-La-Foret, Rouen F-76000, France.
  • IRD, Sorbonne Universit, Unit de Modlisation Mathmatique et Informatique des Systmes Complexes, UMMISCO, 32 Avenue Henri Varagnat, Bondy F-93143, France.
  • Sorbonne Universit, INSERM, Nutrition et Obesities; Systemic Approaches, NutriOmique, AP-HP, Hpital Piti-Salptrire, 91 Boulevard de lHpital, Paris F-75013, France.

Förderung

  • Bpifrance
  • Conseil Régional de Haute Normandie

Zitieren

APA

Puller, V., Plaza Oñate, F., Prifti, E., & de Lahondès, R. (2025). Impact of simulation and reference catalogues on the evaluation of taxonomic profiling pipelines. Microbial Genomics. https://doi.org/10.1099/mgen.0.001330

Vancouver

Puller V, Plaza Oñate F, Prifti E, de Lahondès R. Impact of simulation and reference catalogues on the evaluation of taxonomic profiling pipelines. Microbial Genomics. 2025. doi:10.1099/mgen.0.001330

BibTeX
@article{Puller2025,
  author = {Puller, Vadim and Plaza Oñate, Florian and Prifti, Edi and de Lahondès, Raynald},
  title = {Impact of simulation and reference catalogues on the evaluation of taxonomic profiling pipelines},
  journal = {Microbial Genomics},
  year = {2025},
  doi = {10.1099/mgen.0.001330}
}
Kostenlos starten →