Best Omic file compressor?

Best Omic file compressor?

1

Our team has been having storage space issues; we predicted that we will not have enough available memory to store the files generated by our pipelines. Standard file compressors (gzip, bzip2, 7zip) weren’t cutting it and I started experimenting with file-specific compressors. This is where google spat out ‘Genozip’.

I’ve managed to successfully reproduce it’s claimed compression ratios on fastq.gz, vcf.gz and BAM files within a timeframe comparable to standard compression tools. I was not able to compress CRAM though (code in comments). It’s got some additional utility which allows the user to read the doubly compressed files into stdout without decompressing.

I’m quite impressed with Genozip. It seems to be the best option but I remain a little skeptical as I haven’t found any forum posts discussing it.

Has anybody had any experience with Genozip, or recommends another file compressor?

Documentation: genozip.readthedocs.io/


cram


genozip


gzip


compression

• 19 views

Read more here: Source link