I'm looking to update the bclconvert module, parti...
# team-maintainers
s
I'm looking to update the bclconvert module, particularly because it doesn't currently work when using fusion on Seqera Platform. The issue when using fusion is that the module has this line:
tuple val(meta), path("**/InterOp/*.bin", includeInputs: true), emit: interop
but fusion can't cope with
includeInputs
at the moment. So I've copied the relevant files directly : https://github.com/nf-core/modules/pull/8770
👀 1
Does anyone see any issue with that?
m
@Adam Talbot any other ideas on how to deal with this properly?
a
Fusion does support includeInputs, it's actually a nextflow issue: https://github.com/nextflow-io/nextflow/issues/5948
👍 1
Perhaps a too obvious question - why does interOp need to be included in the outputs?
🤷 1
s
I stand corrected (I forgot that was the underlying issue)
a
Unless there's a really important reason for it to be joined to the outputs, I would just remove interOp. Even if you want to use it downstream wouldn't you grab it from the first channel rather than copying it 3 times? If you're using symlinks, isn't there a danger you end up with a symlink to a symlink to the original when you try to use the data?
➕ 1
party this 1
s
The input to bclconvert is a massive folder of files or a tar file containing the same
so I guess maybe the reason is because you only want to untar it once, but if you are using a directory then you want to export it
a
But why do you need the interop files once you have the FASTQ files?
Oh and maybe to publish the interop files?
that's a weird subworkflow where it runs the channel logic but only runs processes when the demultiplex == bcl2fastq
s
I assume it is to publish the interop files
m
The reasoning behind keeping the
InterOp
files around is because Illumina’s SAV software relies on them to visualize some (most) of the metrics for the run. Both
bcl2fastq
and
bcl-convert
write additional
*.bin
files to the InterOp directory with metrics about index usage and other stuff. When I wrote the modules, I added the original InterOp files to the newly generated ones, so the output would be: • complete • still compatible with Illumina SAV
👍 1
So yeah, TLDR, it’s for publishing
👍 2