EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

CAMI Benchmarking Portal: online evaluation and ranking of metagenomic software

Fernando Meyer iD, Gary Robertson, Zhi-Luo Deng iD, David Koslicki iD, Alexey Gurevich iD, Alice C McHardy iD

Nucleic Acids Research · 07.07.2025 · 53 (W1) · W102-W109

DOI: 10.1093/nar/gkaf369 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Nucleic Acids Research, online erschienen am 07.05.2025. Verfasst von Fernando Meyer und 5 weiteren Autor:innen. Beteiligte Einrichtung: Computational Biology of Infection Research, Helmholtz Centre for Infection Research (HZI), 38124 Braunschweig, Germany. Hauptthemen laut MEDLINE: Software, Metagenomics, Metagenome. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NIGMS NIH HHS, Deutsche Forschungsgemeinschaft, NFDI4Microbiota consortium.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Finding appropriate software and parameter settings to process shotgun metagenome data is essential for meaningful metagenomic analyses. To enable objective and comprehensive benchmarking of metagenomic software, the community-led initiative for the Critical Assessment of Metagenome Interpretation (CAMI) promotes standards and best practices. Since 2015, CAMI has provided comprehensive datasets, benchmarking guidelines, and challenges. However, benchmarking had to be conducted offline, requiring substantial time and technical expertise and leading to gaps in results between challenges. We introduce the CAMI Benchmarking Portal—a central repository of CAMI resources and web server for the evaluation and ranking of metagenome assembly, binning, and taxonomic profiling software. The portal simplifies evaluation, enabling users to easily compare their results with previous and other users’ submissions through a variety of metrics and visualizations. As a demonstration, we benchmark software performance on the marine dataset of the CAMI II challenge. The portal currently hosts 28 675 results and is freely available at https://cami-challenge.org/.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

SoftwareMetagenomicsMetagenomeBenchmarkingInternet

Autor:innen und Institutionen

  • Computational Biology of Infection Research, Helmholtz Centre for Infection Research (HZI), 38124 Braunschweig, Germany.
  • Braunschweig Integrated Centre of Systems Biology (BRICS), Technische Universität Braunschweig, 38106 Braunschweig, Germany.
  • Initiative for the Critical Assessment of Metagenome Interpretation (CAMI ).
  • Computer Science and Engineering, Penn State University, University Park, PA 16802, United States.
  • Biology, Penn State University , University Park, PA 16802, United States.
  • Helmholtz Institute for Pharmaceutical Research Saarland (HIPS), Helmholtz Centre for Infection Research (HZI), 66123 Saarbrücken, Germany.

ORCID-Profile: Fernando Meyer, Zhi-Luo Deng, David Koslicki, Alexey Gurevich, Alice C McHardy

Förderung

  • NIGMS NIH HHS
  • Deutsche Forschungsgemeinschaft
  • NFDI4Microbiota consortium

Zitieren

APA

Meyer, F., Robertson, G., Deng, Z. L., Koslicki, D., Gurevich, A., & McHardy, A. C. (2025). CAMI Benchmarking Portal: online evaluation and ranking of metagenomic software. Nucleic Acids Research, 53(W1), W102-W109. https://doi.org/10.1093/nar/gkaf369

Vancouver

Meyer F, Robertson G, Deng ZL, Koslicki D, Gurevich A, McHardy AC. CAMI Benchmarking Portal: online evaluation and ranking of metagenomic software. Nucleic Acids Research. 2025;53(W1):W102-W109. doi:10.1093/nar/gkaf369

BibTeX
@article{Meyer2025,
  author = {Meyer, Fernando and Robertson, Gary and Deng, Zhi-Luo and Koslicki, David and Gurevich, Alexey and McHardy, Alice C},
  title = {CAMI Benchmarking Portal: online evaluation and ranking of metagenomic software},
  journal = {Nucleic Acids Research},
  year = {2025},
  volume = {53},
  number = {W1},
  pages = {W102--W109},
  doi = {10.1093/nar/gkaf369}
}
Kostenlos starten →