EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Cloud-native distributed genomic pileup operations

Marek Wiewiórka, Agnieszka Szmurło, Paweł Stankiewicz, Tomasz Gambin iD

Bioinformatics · 2023

DOI: 10.1093/bioinformatics/btac804 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Bioinformatics, 2023. Verfasst von Marek Wiewiórka und 3 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Computer Science, Warsaw University of Technology, Warsaw, Warsaw 00-661, Poland. Hauptthemen laut MEDLINE: Software, Genomics. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Research University.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Motivation Pileup analysis is a building block of many bioinformatics pipelines, including variant calling and genotyping. This step tends to become a bottleneck of the entire assay since the straightforward pileup implementations involve processing of all base calls from all alignments sequentially. On the other hand, a distributed version of the algorithm faces the intrinsic challenge of splitting reads-oriented file formats into self-contained partitions to avoid costly data exchange between computational nodes. Results Here, we present a scalable, distributed and efficient implementation of a pileup algorithm that is suitable for deploying in cloud computing environments. In particular, we implemented: (i) our custom data-partitioning algorithm optimized to work with the alignment reads, (ii) a novel and unique approach to process alignment events from sequencing reads using the MD tags, (iii) the source code micro-optimizations for recurrent operations, and (iv) a modular structure of the algorithm. We have proven that our novel approach consistently and significantly outperforms other state-of-the-art distributed tools in terms of execution time (up to 6.5× faster) and memory usage (up to 2× less), resulting in a substantial cloud cost reduction. SeQuiLa is a cloud-native solution that can be easily deployed using any managed Kubernetes and Hadoop services available in public clouds, like Microsoft Azure Cloud, Google Cloud Platform, or Amazon Web Services. Together with the already implemented distributed range join and coverage calculations, our package provides end-users with a unified SQL interface for convenient analyses of population-scale genomic data in an interactive way. Availability and implementation https://biodatageeks.github.io/sequila/

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

SoftwareGenomicsAlgorithmsGenomeComputational Biology

Autor:innen und Institutionen

  • Institute of Computer Science, Warsaw University of Technology, Warsaw, Warsaw 00-661, Poland.
  • Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, TX 77030, USA.

ORCID-Profile: Tomasz Gambin

Förderung

  • Research University

Zitieren

APA

Wiewiórka, M., Szmurło, A., Stankiewicz, P., & Gambin, T. (2023). Cloud-native distributed genomic pileup operations. Bioinformatics. https://doi.org/10.1093/bioinformatics/btac804

Vancouver

Wiewiórka M, Szmurło A, Stankiewicz P, Gambin T. Cloud-native distributed genomic pileup operations. Bioinformatics. 2023. doi:10.1093/bioinformatics/btac804

BibTeX
@article{Wiewirka2023,
  author = {Wiewiórka, Marek and Szmurło, Agnieszka and Stankiewicz, Paweł and Gambin, Tomasz},
  title = {Cloud-native distributed genomic pileup operations},
  journal = {Bioinformatics},
  year = {2023},
  doi = {10.1093/bioinformatics/btac804}
}
Kostenlos starten →