CAMI Benchmarking Portal: online evaluation and ranking of metagenomic software
Nucleic Acids Research · 07.07.2025 · 53 (W1) · W102-W109
DOI: 10.1093/nar/gkaf369 ↗Kurz gefasst
Fachartikel in der Zeitschrift Nucleic Acids Research, online erschienen am 07.05.2025. Verfasst von Fernando Meyer und 5 weiteren Autor:innen. Beteiligte Einrichtung: Computational Biology of Infection Research, Helmholtz Centre for Infection Research (HZI), 38124 Braunschweig, Germany. Hauptthemen laut MEDLINE: Software, Metagenomics, Metagenome. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NIGMS NIH HHS, Deutsche Forschungsgemeinschaft, NFDI4Microbiota consortium.
Abstract (Originalsprache)
Finding appropriate software and parameter settings to process shotgun metagenome data is essential for meaningful metagenomic analyses. To enable objective and comprehensive benchmarking of metagenomic software, the community-led initiative for the Critical Assessment of Metagenome Interpretation (CAMI) promotes standards and best practices. Since 2015, CAMI has provided comprehensive datasets, benchmarking guidelines, and challenges. However, benchmarking had to be conducted offline, requiring substantial time and technical expertise and leading to gaps in results between challenges. We introduce the CAMI Benchmarking Portal—a central repository of CAMI resources and web server for the evaluation and ranking of metagenome assembly, binning, and taxonomic profiling software. The portal simplifies evaluation, enabling users to easily compare their results with previous and other users’ submissions through a variety of metrics and visualizations. As a demonstration, we benchmark software performance on the marine dataset of the CAMI II challenge. The portal currently hosts 28 675 results and is freely available at https://cami-challenge.org/.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Computational Biology of Infection Research, Helmholtz Centre for Infection Research (HZI), 38124 Braunschweig, Germany.
- Braunschweig Integrated Centre of Systems Biology (BRICS), Technische Universität Braunschweig, 38106 Braunschweig, Germany.
- Initiative for the Critical Assessment of Metagenome Interpretation (CAMI ).
- Computer Science and Engineering, Penn State University, University Park, PA 16802, United States.
- Biology, Penn State University , University Park, PA 16802, United States.
- Helmholtz Institute for Pharmaceutical Research Saarland (HIPS), Helmholtz Centre for Infection Research (HZI), 66123 Saarbrücken, Germany.
ORCID-Profile: Fernando Meyer, Zhi-Luo Deng, David Koslicki, Alexey Gurevich, Alice C McHardy
Förderung
- NIGMS NIH HHS
- Deutsche Forschungsgemeinschaft
- NFDI4Microbiota consortium
Zitieren
APA
Meyer, F., Robertson, G., Deng, Z. L., Koslicki, D., Gurevich, A., & McHardy, A. C. (2025). CAMI Benchmarking Portal: online evaluation and ranking of metagenomic software. Nucleic Acids Research, 53(W1), W102-W109. https://doi.org/10.1093/nar/gkaf369
Vancouver
Meyer F, Robertson G, Deng ZL, Koslicki D, Gurevich A, McHardy AC. CAMI Benchmarking Portal: online evaluation and ranking of metagenomic software. Nucleic Acids Research. 2025;53(W1):W102-W109. doi:10.1093/nar/gkaf369
BibTeX
@article{Meyer2025,
author = {Meyer, Fernando and Robertson, Gary and Deng, Zhi-Luo and Koslicki, David and Gurevich, Alexey and McHardy, Alice C},
title = {CAMI Benchmarking Portal: online evaluation and ranking of metagenomic software},
journal = {Nucleic Acids Research},
year = {2025},
volume = {53},
number = {W1},
pages = {W102--W109},
doi = {10.1093/nar/gkaf369}
}
EUVIMED