GSC: efficient lossless compression of VCF files with fast query
GigaScience · 2024
DOI: 10.1093/gigascience/giae046 ↗Kurz gefasst
Fachartikel in der Zeitschrift GigaScience, 2024. Verfasst von Xiaolong Luo und 7 weiteren Autor:innen. Beteiligte Einrichtung: College of Computer Science and Software Engineering, Shenzhen University, Shenzhen 518060, China. Hauptthemen laut MEDLINE: Data Compression, Software. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China.
Abstract (Originalsprache)
Background
With the rise of large-scale genome sequencing projects, genotyping of thousands of samples has produced immense variant call format (VCF) files. It is becoming increasingly challenging to store, transfer, and analyze these voluminous files. Compression methods have been used to tackle these issues, aiming for both high compression ratio and fast random access. However, existing methods have not yet achieved a satisfactory compromise between these 2 objectives.
Findings
To address the aforementioned issue, we introduce GSC (Genotype Sparse Compression), a specialized and refined lossless compression tool for VCF files. In benchmark tests conducted across various open-source datasets, GSC showcased exceptional performance in genotype data compression. Compared with the industry’s most advanced tools (namely, GBC and GTC), GSC achieved compression ratios that were higher by 26.9% to 82.4% over GBC and GTC on the datasets, respectively. In lossless compression scenarios, GSC also demonstrated robust performance, with compression ratios 1.5× to 6.5× greater than general-purpose tools like gzip, zstd, and BCFtools—a mode not supported by either GBC or GTC. Achieving such high compression ratios did require some reasonable trade-offs, including longer decompression times, with GSC being 1.2× to 2× slower than GBC, yet 1.1× to 1.4× faster than GTC. Moreover, GSC maintained decompression query speeds that were equivalent to its competitors. In terms of RAM usage, GSC outperformed both counterparts. Overall, GSC’s comprehensive performance surpasses that of the most advanced technologies.
Conclusion
GSC balances high compression ratios with rapid data access, enhancing genomic data management. It supports seamless PLINK binary format conversion, simplifying downstream analysis.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- College of Computer Science and Software Engineering, Shenzhen University, Shenzhen 518060, China.
- BGI Research, Wuhan 430074, China.
- BGI Research, Shenzhen 518083, China.
- Guangdong Bigdata Engineering Technology Research Center for Life Sciences, BGI Research, Shenzhen 518083, China.
- Guangzhou Institute of Technology, Xidian University, Guangzhou 510555, China.
- National Engineering Laboratory for Big Data System Computing Technology, Shenzhen University, Shenzhen 518060, China.
ORCID-Profile: Xiaolong Luo, Yuxin Chen, Ling Liu, Lulu Ding, Yuxiang Li, Shengkang Li, Yong Zhang, Zexuan Zhu
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
Zitieren
APA
Luo, X., Chen, Y., Liu, L., Ding, L., Li, Y., Li, S., Zhang, Y., & Zhu, Z. (2024). GSC: efficient lossless compression of VCF files with fast query. GigaScience. https://doi.org/10.1093/gigascience/giae046
Vancouver
Luo X, Chen Y, Liu L, Ding L, Li Y, Li S, et al. GSC: efficient lossless compression of VCF files with fast query. GigaScience. 2024. doi:10.1093/gigascience/giae046
BibTeX
@article{Luo2024,
author = {Luo, Xiaolong and Chen, Yuxin and Liu, Ling and Ding, Lulu and Li, Yuxiang and Li, Shengkang and Zhang, Yong and Zhu, Zexuan},
title = {GSC: efficient lossless compression of VCF files with fast query},
journal = {GigaScience},
year = {2024},
doi = {10.1093/gigascience/giae046}
}
EUVIMED