Is there some consensus around use of `gzip` vs `b...
# modules
n
Is there some consensus around use of
gzip
vs
bgzip
in modules? I realized that using gzip can be a massive pita when things go to samtools later, since it refuses to take things that are not
bgzip
'ped. Is it preferred to take gzipped module output and un + bgzip again via https://nf-co.re/modules/htslib_bgziptabix/, patch whatever module I use to not gzip and instead pass the output fasta to
htslib_bgziptabix
? Or some better solution (update module + container to use bgzip)?
j
We've had problems with downstream modules not being able to read
bgzip
stuff
(I think itwas java with a quite basic gzip reading library or something)
But it appears to be quite rare
(as In you might be OK using bgzip if you're staying within the samtools ecosystem)
n
Hm, okay, in that case I think I will patch the module that gzips to not gzip and instead pass the fasta to htslib_bgziptabix
j
Again: the failure is rare though
n
Well, if there are failures in both "directions" I am not sure if patching things in the modules repo to facilitate my personal usage is very helpful
😆 1
j
Fair opint
s
I guess it might depend on the expected next steps for the tool
But I think bgzip is fine, and archaic tools that can't handle it can catch that in their own module
n
For me specifically it was gfatools, which probably goes into samtools quite often
a
I think for me it should be prefer bgzip for biological files
👍 2
n
Is there a preferred standalone bgzip, or does it always come via htslib?
a
Pretty certain the best way to get it is htslib
m
> (I think itwas java with a quite basic gzip reading library or something) There is bgzip support in JVM-based tools, but perhaps not across the board