Skip to content

Add Blocked GZip Format (BGZF)#19

Open
robegan21 wants to merge 14 commits intomadler:masterfrom
JGI-Bioinformatics:AddBlockCompress-BGZip
Open

Add Blocked GZip Format (BGZF)#19
robegan21 wants to merge 14 commits intomadler:masterfrom
JGI-Bioinformatics:AddBlockCompress-BGZip

Conversation

@robegan21
Copy link

This patch adds the ability for pigz to compress and uncompress the Blocked GNU Zip Format (BGZF) variant of gzip whose specification can be found here in the SAM specification. http://samtools.github.io/hts-specs/SAMv1.pdf

This format uses an extra field in the gzip header to encode each independent block's length, thereby allowing parallel decompression and even fast random access of the compressed archive (with indexing or other tricks)

I hope that people interested in parallel compression will be willing to sacrifice a small amount of compression-space efficiency for the ability to greatly accelerate the speed and parallelism of decompression.

@sjackman
Copy link

👍 I would find this feature quite useful. I also use BGZF.

@sjackman
Copy link

I just noticed that bgzip has a -@, --threads option! I'll use that.

@h-2
Copy link

h-2 commented Feb 8, 2017

👍 for compatibility with bgzip!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants