EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

GSC: efficient lossless compression of VCF files with fast query

Xiaolong Luo iD, Yuxin Chen iD, Ling Liu iD, Lulu Ding iD, Yuxiang Li iD, Shengkang Li iD, Yong Zhang iD, Zexuan Zhu iD

GigaScience · 2024

DOI: 10.1093/gigascience/giae046 ↗

Kurz gefasst

Fachartikel in der Zeitschrift GigaScience, 2024. Verfasst von Xiaolong Luo und 7 weiteren Autor:innen. Beteiligte Einrichtung: College of Computer Science and Software Engineering, Shenzhen University, Shenzhen 518060, China. Hauptthemen laut MEDLINE: Data Compression, Software. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

With the rise of large-scale genome sequencing projects, genotyping of thousands of samples has produced immense variant call format (VCF) files. It is becoming increasingly challenging to store, transfer, and analyze these voluminous files. Compression methods have been used to tackle these issues, aiming for both high compression ratio and fast random access. However, existing methods have not yet achieved a satisfactory compromise between these 2 objectives.

Findings

To address the aforementioned issue, we introduce GSC (Genotype Sparse Compression), a specialized and refined lossless compression tool for VCF files. In benchmark tests conducted across various open-source datasets, GSC showcased exceptional performance in genotype data compression. Compared with the industry’s most advanced tools (namely, GBC and GTC), GSC achieved compression ratios that were higher by 26.9% to 82.4% over GBC and GTC on the datasets, respectively. In lossless compression scenarios, GSC also demonstrated robust performance, with compression ratios 1.5× to 6.5× greater than general-purpose tools like gzip, zstd, and BCFtools—a mode not supported by either GBC or GTC. Achieving such high compression ratios did require some reasonable trade-offs, including longer decompression times, with GSC being 1.2× to 2× slower than GBC, yet 1.1× to 1.4× faster than GTC. Moreover, GSC maintained decompression query speeds that were equivalent to its competitors. In terms of RAM usage, GSC outperformed both counterparts. Overall, GSC’s comprehensive performance surpasses that of the most advanced technologies.

Conclusion

GSC balances high compression ratios with rapid data access, enhancing genomic data management. It supports seamless PLINK binary format conversion, simplifying downstream analysis.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Data CompressionSoftwareHumansGenotypeComputational BiologyAlgorithmsHigh-Throughput Nucleotide Sequencing

Stichwörter der Autor:innen

VCF/BCF fileslossless compressionrapid random access

Autor:innen und Institutionen

  • College of Computer Science and Software Engineering, Shenzhen University, Shenzhen 518060, China.
  • BGI Research, Wuhan 430074, China.
  • BGI Research, Shenzhen 518083, China.
  • Guangdong Bigdata Engineering Technology Research Center for Life Sciences, BGI Research, Shenzhen 518083, China.
  • Guangzhou Institute of Technology, Xidian University, Guangzhou 510555, China.
  • National Engineering Laboratory for Big Data System Computing Technology, Shenzhen University, Shenzhen 518060, China.

ORCID-Profile: Xiaolong Luo, Yuxin Chen, Ling Liu, Lulu Ding, Yuxiang Li, Shengkang Li, Yong Zhang, Zexuan Zhu

Förderung

  • National Key Research and Development Program of China
  • National Natural Science Foundation of China

Zitieren

APA

Luo, X., Chen, Y., Liu, L., Ding, L., Li, Y., Li, S., Zhang, Y., & Zhu, Z. (2024). GSC: efficient lossless compression of VCF files with fast query. GigaScience. https://doi.org/10.1093/gigascience/giae046

Vancouver

Luo X, Chen Y, Liu L, Ding L, Li Y, Li S, et al. GSC: efficient lossless compression of VCF files with fast query. GigaScience. 2024. doi:10.1093/gigascience/giae046

BibTeX
@article{Luo2024,
  author = {Luo, Xiaolong and Chen, Yuxin and Liu, Ling and Ding, Lulu and Li, Yuxiang and Li, Shengkang and Zhang, Yong and Zhu, Zexuan},
  title = {GSC: efficient lossless compression of VCF files with fast query},
  journal = {GigaScience},
  year = {2024},
  doi = {10.1093/gigascience/giae046}
}
Kostenlos starten →