Cloud-native distributed genomic pileup operations
Bioinformatics · 2023
DOI: 10.1093/bioinformatics/btac804 ↗Kurz gefasst
Fachartikel in der Zeitschrift Bioinformatics, 2023. Verfasst von Marek Wiewiórka und 3 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Computer Science, Warsaw University of Technology, Warsaw, Warsaw 00-661, Poland. Hauptthemen laut MEDLINE: Software, Genomics. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Research University.
Abstract (Originalsprache)
Motivation Pileup analysis is a building block of many bioinformatics pipelines, including variant calling and genotyping. This step tends to become a bottleneck of the entire assay since the straightforward pileup implementations involve processing of all base calls from all alignments sequentially. On the other hand, a distributed version of the algorithm faces the intrinsic challenge of splitting reads-oriented file formats into self-contained partitions to avoid costly data exchange between computational nodes. Results Here, we present a scalable, distributed and efficient implementation of a pileup algorithm that is suitable for deploying in cloud computing environments. In particular, we implemented: (i) our custom data-partitioning algorithm optimized to work with the alignment reads, (ii) a novel and unique approach to process alignment events from sequencing reads using the MD tags, (iii) the source code micro-optimizations for recurrent operations, and (iv) a modular structure of the algorithm. We have proven that our novel approach consistently and significantly outperforms other state-of-the-art distributed tools in terms of execution time (up to 6.5× faster) and memory usage (up to 2× less), resulting in a substantial cloud cost reduction. SeQuiLa is a cloud-native solution that can be easily deployed using any managed Kubernetes and Hadoop services available in public clouds, like Microsoft Azure Cloud, Google Cloud Platform, or Amazon Web Services. Together with the already implemented distributed range join and coverage calculations, our package provides end-users with a unified SQL interface for convenient analyses of population-scale genomic data in an interactive way. Availability and implementation https://biodatageeks.github.io/sequila/
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Institute of Computer Science, Warsaw University of Technology, Warsaw, Warsaw 00-661, Poland.
- Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, TX 77030, USA.
ORCID-Profile: Tomasz Gambin
Förderung
- Research University
Zitieren
APA
Wiewiórka, M., Szmurło, A., Stankiewicz, P., & Gambin, T. (2023). Cloud-native distributed genomic pileup operations. Bioinformatics. https://doi.org/10.1093/bioinformatics/btac804
Vancouver
Wiewiórka M, Szmurło A, Stankiewicz P, Gambin T. Cloud-native distributed genomic pileup operations. Bioinformatics. 2023. doi:10.1093/bioinformatics/btac804
BibTeX
@article{Wiewirka2023,
author = {Wiewiórka, Marek and Szmurło, Agnieszka and Stankiewicz, Paweł and Gambin, Tomasz},
title = {Cloud-native distributed genomic pileup operations},
journal = {Bioinformatics},
year = {2023},
doi = {10.1093/bioinformatics/btac804}
}
EUVIMED