EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Synth4bench: generating synthetic data for benchmarking tumor-only somatic variant calling algorithms

Styliani-Christina Fragkouli, Nikos Pechlivanis, Anastasia Anastasiadou, Georgios Karakatsoulis, Aspasia Orfanou, Panagoula Kollia, Andreas Agathangelidis, Fotis Psomopoulos

Frontiers in Bioinformatics · 16.07.2026 · 6

DOI: 10.3389/fbinf.2026.1858375 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Bioinformatics, online erschienen am 16.07.2026. Verfasst von Styliani-Christina Fragkouli und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biology, National and Kapodistrian University of Athens, Athens, Greece. Die Arbeit nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Innovative Health Initiative.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Somatic variant calling is a key activity towards identifying genomic alterations; yet, the evaluation of the respective tools remains challenging due to the scarcity of high quality ground truth datasets. To overcome this limitation, we developed synth4bench, a synthetic data generation pipeline, which utilizes the NEAT simulator, for robust benchmarking. Using a systematic process to create distinct synthetic datasets, we thoroughly evaluated five variant callers (Mutect2, FreeBayes, VarDict, VarScan2 and LoFreq). We compared tool outputs against our synthetic ground truth across key sequencing aspects (such as depth and read length) to assess their capacities and shed light on their underlying algorithmic principles.

Results

Synth4bench is an approach for evaluating tumor-only somatic variant callers that relies on a systematic definition of fully controlled ground-truth datasets. Our analysis revealed significant inconsistencies among the tool outputs and a strong dependence of caller performance on sequencing parameters. Indels remain the hardest-to-call variant type, driven by errors at low allele frequencies. Algorithmic choice is also critical; the most robust callers displayed the highest Precision in allele frequency estimation, while the most sensitive caller was best for maximizing true positive recovery. Conversely, the least suitable caller exhibited systematic errors along with the poorest overall performance.

Conclusion

These findings indicate that there is not a one-size-fits-all approach; sequencing optimization together with caller selection are necessary to maximize sensitivity and reliability. Furthermore, the pronounced inconsistencies suggest that current algorithms are not yet able to capture all mutational mechanisms adequately, with the modeling of the underlying processes remaining an open challenge.

Schlagwörter

Stichwörter der Autor:innen

benchmarkinggenomicssoftwaresynthetic datavariant calling

Autor:innen und Institutionen

  • Department of Biology, National and Kapodistrian University of Athens, Athens, Greece.
  • Institute of Applied Biosciences, Centre for Research and Technology Hellas, Thessaloniki, Greece.

Förderung

  • Innovative Health Initiative

Zitieren

APA

Fragkouli, S. C., Pechlivanis, N., Anastasiadou, A., Karakatsoulis, G., Orfanou, A., Kollia, P., Agathangelidis, A., & Psomopoulos, F. (2026). Synth4bench: generating synthetic data for benchmarking tumor-only somatic variant calling algorithms. Frontiers in Bioinformatics, 6. https://doi.org/10.3389/fbinf.2026.1858375

Vancouver

Fragkouli SC, Pechlivanis N, Anastasiadou A, Karakatsoulis G, Orfanou A, Kollia P, et al. Synth4bench: generating synthetic data for benchmarking tumor-only somatic variant calling algorithms. Frontiers in Bioinformatics. 2026;6. doi:10.3389/fbinf.2026.1858375

BibTeX
@article{Fragkouli2026,
  author = {Fragkouli, Styliani-Christina and Pechlivanis, Nikos and Anastasiadou, Anastasia and Karakatsoulis, Georgios and Orfanou, Aspasia and Kollia, Panagoula and Agathangelidis, Andreas and Psomopoulos, Fotis},
  title = {Synth4bench: generating synthetic data for benchmarking tumor-only somatic variant calling algorithms},
  journal = {Frontiers in Bioinformatics},
  year = {2026},
  volume = {6},
  doi = {10.3389/fbinf.2026.1858375}
}
Kostenlos starten →