The current landscape and emerging challenges of benchmarking single-cell methods
Briefings in Bioinformatics · 31.08.2025 · 26 (5)
DOI: 10.1093/bib/bbaf380 ↗Kurz gefasst
Übersichtsarbeit in der Zeitschrift Briefings in Bioinformatics, online erschienen am 04.10.2025. Verfasst von Yue Cao und 8 weiteren Autor:innen. Beteiligte Einrichtung: School of Mathematics and Statistics, University of Sydney, Sydney, Australia. Hauptthemen laut MEDLINE: Single-Cell Analysis, Benchmarking, Computational Biology. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Health and Medical Research Council, Chan Zuckerberg Initiative Single Cell Biology Data Insights, Australian Research Council Discovery Early Career Researcher Awards.
Abstract (Originalsprache)
With the rapid development of computational methods for single-cell sequencing data, benchmarking serves as a valuable resource. As the number of benchmarking studies surges, it is timely to assess the current state of the field. We conducted a systematic literature search and assessed 282 papers, including all 130 benchmark-only papers from the search and an additional 152 method development papers containing benchmarking. This collective effort provides the most comprehensive quantitative summary of the current landscape of single-cell benchmarking studies. We examine performances across nine broad categories, including often ignored aspects such as role of datasets, robustness of methods and downstream evaluation. Our analysis highlights challenges such as how to effectively combine knowledge across multiple benchmarking studies and in what ways can the community recognize the risk and prevent benchmarking fatigue. This paper highlights the importance of adopting a community-led research paradigm to tackle these challenges and establish best practice standards.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Mathematics and Statistics, University of Sydney, Sydney, Australia.
- Sydney Precision Data Science Centre, University of Sydney, NSW, 2006, Australia.
- Charles Perkins Centre, University of Sydney, Sydney, Australia.
- Computational Systems Biology Group, Children's Medical Research Institute, University of Sydney, Westmead, Australia.
- Walter and Eliza Hall Institute for Medical Research, Parkville, VIC 3052, Australia.
ORCID-Profile: Yue Cao, Lijia Yu, Pengyi Yang, Terence P Speed, Jean Yee Hwa Yang
Förderung
- National Health and Medical Research Council
- Chan Zuckerberg Initiative Single Cell Biology Data Insights
- Australian Research Council Discovery Early Career Researcher Awards
Zitieren
APA
Cao, Y., Yu, L., Torkel, M., Kim, S., Lin, Y., Yang, P., Speed, T. P., Ghazanfar, S., & Yang, J. Y. H. (2025). The current landscape and emerging challenges of benchmarking single-cell methods. Briefings in Bioinformatics, 26(5). https://doi.org/10.1093/bib/bbaf380
Vancouver
Cao Y, Yu L, Torkel M, Kim S, Lin Y, Yang P, et al. The current landscape and emerging challenges of benchmarking single-cell methods. Briefings in Bioinformatics. 2025;26(5). doi:10.1093/bib/bbaf380
BibTeX
@article{Cao2025,
author = {Cao, Yue and Yu, Lijia and Torkel, Marni and Kim, Sanghyun and Lin, Yingxin and Yang, Pengyi and Speed, Terence P and Ghazanfar, Shila and Yang, Jean Yee Hwa},
title = {The current landscape and emerging challenges of benchmarking single-cell methods},
journal = {Briefings in Bioinformatics},
year = {2025},
volume = {26},
number = {5},
doi = {10.1093/bib/bbaf380}
}
EUVIMED