EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitOpen Access · CC BY 4.0

The current landscape and emerging challenges of benchmarking single-cell methods

Yue Cao iD, Lijia Yu iD, Marni Torkel, Sanghyun Kim, Yingxin Lin, Pengyi Yang iD, Terence P Speed iD, Shila Ghazanfar, Jean Yee Hwa Yang iD

Briefings in Bioinformatics · 31.08.2025 · 26 (5)

DOI: 10.1093/bib/bbaf380 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift Briefings in Bioinformatics, online erschienen am 04.10.2025. Verfasst von Yue Cao und 8 weiteren Autor:innen. Beteiligte Einrichtung: School of Mathematics and Statistics, University of Sydney, Sydney, Australia. Hauptthemen laut MEDLINE: Single-Cell Analysis, Benchmarking, Computational Biology. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Health and Medical Research Council, Chan Zuckerberg Initiative Single Cell Biology Data Insights, Australian Research Council Discovery Early Career Researcher Awards.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the rapid development of computational methods for single-cell sequencing data, benchmarking serves as a valuable resource. As the number of benchmarking studies surges, it is timely to assess the current state of the field. We conducted a systematic literature search and assessed 282 papers, including all 130 benchmark-only papers from the search and an additional 152 method development papers containing benchmarking. This collective effort provides the most comprehensive quantitative summary of the current landscape of single-cell benchmarking studies. We examine performances across nine broad categories, including often ignored aspects such as role of datasets, robustness of methods and downstream evaluation. Our analysis highlights challenges such as how to effectively combine knowledge across multiple benchmarking studies and in what ways can the community recognize the risk and prevent benchmarking fatigue. This paper highlights the importance of adopting a community-led research paradigm to tackle these challenges and establish best practice standards.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Single-Cell AnalysisBenchmarkingComputational BiologyHumans

Stichwörter der Autor:innen

benchmarkingsingle-cellsingle-cell methodsystematic evaluation

Autor:innen und Institutionen

  • School of Mathematics and Statistics, University of Sydney, Sydney, Australia.
  • Sydney Precision Data Science Centre, University of Sydney, NSW, 2006, Australia.
  • Charles Perkins Centre, University of Sydney, Sydney, Australia.
  • Computational Systems Biology Group, Children's Medical Research Institute, University of Sydney, Westmead, Australia.
  • Walter and Eliza Hall Institute for Medical Research, Parkville, VIC 3052, Australia.

ORCID-Profile: Yue Cao, Lijia Yu, Pengyi Yang, Terence P Speed, Jean Yee Hwa Yang

Förderung

  • National Health and Medical Research Council
  • Chan Zuckerberg Initiative Single Cell Biology Data Insights
  • Australian Research Council Discovery Early Career Researcher Awards

Zitieren

APA

Cao, Y., Yu, L., Torkel, M., Kim, S., Lin, Y., Yang, P., Speed, T. P., Ghazanfar, S., & Yang, J. Y. H. (2025). The current landscape and emerging challenges of benchmarking single-cell methods. Briefings in Bioinformatics, 26(5). https://doi.org/10.1093/bib/bbaf380

Vancouver

Cao Y, Yu L, Torkel M, Kim S, Lin Y, Yang P, et al. The current landscape and emerging challenges of benchmarking single-cell methods. Briefings in Bioinformatics. 2025;26(5). doi:10.1093/bib/bbaf380

BibTeX
@article{Cao2025,
  author = {Cao, Yue and Yu, Lijia and Torkel, Marni and Kim, Sanghyun and Lin, Yingxin and Yang, Pengyi and Speed, Terence P and Ghazanfar, Shila and Yang, Jean Yee Hwa},
  title = {The current landscape and emerging challenges of benchmarking single-cell methods},
  journal = {Briefings in Bioinformatics},
  year = {2025},
  volume = {26},
  number = {5},
  doi = {10.1093/bib/bbaf380}
}
Kostenlos starten →