Running nf-core/mag just now, having problem with ...
# tools
j
Running nf-core/mag just now, having problem with its fastqc module, and i think this affects other pipelines with the latest nf-core/tools modules. Processing of memory data type as it is passed to the argument returns float, not integer (which fastq accepts)
Copy code
May-14 11:33:41.776 [TaskFinalizer-1] ERROR nextflow.processor.TaskProcessor - Error executing process > 'NFCORE_MAG:MAG:SHORTREAD_PREPROCESSING:FASTQC_RAW (S1_run0_raw)'

Caused by:
  Process `NFCORE_MAG:MAG:SHORTREAD_PREPROCESSING:FASTQC_RAW (S1_run0_raw)` terminated with an error exit status (1)


Command executed:

  printf "%s %s\n" 1_R1.fastq.gz S1_run0_raw_1.gz 1_R2.fastq.gz S1_run0_raw_2.gz | while read old_name new_name; do
      [ -f "${new_name}" ] || ln -s $old_name $new_name
  done
  
  fastqc \
      --quiet \
      --threads 6 \
      --memory 6144.0 \
      S1_run0_raw_1.gz S1_run0_raw_2.gz
  
  cat <-END_VERSIONS  versions.yml
  "NFCORE_MAG:MAG:SHORTREAD_PREPROCESSING:FASTQC_RAW":
      fastqc: $( fastqc --version | sed '/FastQC v/!d; s/.*v//' )
  END_VERSIONS

Command exit status:
  1

Command output:
  application/gzip
  application/gzip

Command error:
  Value "6144.0" invalid for option memory (number expected)
  Failed to process S1_run0_raw_1.gz
  java.util.zip.ZipException: Not in GZIP format
  	at java.base/java.util.zip.GZIPInputStream.readHeader(GZIPInputStream.java:165)
  	at java.base/java.util.zip.GZIPInputStream.init(GZIPInputStream.java:79)
  	at java.base/java.util.zip.GZIPInputStream.init(GZIPInputStream.java:91)
  	at uk.ac.babraham.FastQC.Utilities.MultiMemberGZIPInputStream.init(MultiMemberGZIPInputStream.java:37)
  	at uk.ac.babraham.FastQC.Sequence.FastQFile.init(FastQFile.java:84)
  	at uk.ac.babraham.FastQC.Sequence.SequenceFactory.getSequenceFile(SequenceFactory.java:106)
  	at uk.ac.babraham.FastQC.Sequence.SequenceFactory.getSequenceFile(SequenceFactory.java:62)
  	at uk.ac.babraham.FastQC.Analysis.OfflineRunner.processFile(OfflineRunner.java:163)
  	at uk.ac.babraham.FastQC.Analysis.OfflineRunner.init(OfflineRunner.java:125)
  	at uk.ac.babraham.FastQC.FastQCApplication.main(FastQCApplication.java:316)
  Failed to process S1_run0_raw_2.gz
  java.util.zip.ZipException: Not in GZIP format
  	at java.base/java.util.zip.GZIPInputStream.readHeader(GZIPInputStream.java:165)
  	at java.base/java.util.zip.GZIPInputStream.init(GZIPInputStream.java:79)
  	at java.base/java.util.zip.GZIPInputStream.init(GZIPInputStream.java:91)
  	at uk.ac.babraham.FastQC.Utilities.MultiMemberGZIPInputStream.init(MultiMemberGZIPInputStream.java:37)
  	at uk.ac.babraham.FastQC.Sequence.FastQFile.init(FastQFile.java:84)
  	at uk.ac.babraham.FastQC.Sequence.SequenceFactory.getSequenceFile(SequenceFactory.java:106)
  	at uk.ac.babraham.FastQC.Sequence.SequenceFactory.getSequenceFile(SequenceFactory.java:62)
  	at uk.ac.babraham.FastQC.Analysis.OfflineRunner.processFile(OfflineRunner.java:163)
  	at uk.ac.babraham.FastQC.Analysis.OfflineRunner.init(OfflineRunner.java:125)
  	at uk.ac.babraham.FastQC.FastQCApplication.main(FastQCApplication.java:316)
a
Don’t think this has anything to do with
nf-core/tools
. Issue seems to lie in:
Copy code
def memory_in_mb = task.memory ? task.memory.toUnit('MB').toFloat() / task.cpus : null
Which was added to
fastqc
4 months ago
👍 1
j
Could you provide more info, i.e. the command (plus version) and any config you're using?
a
And in fact that change has now been reverted in the latest version of
fastqc
So this is an issue for #mag and the developers there. They need to update
fastqc
to the latest version. Until then, any memory:cpu request for
fastqc
that results in between 100-10000MB per CPU will fail with this error
j
Aha! Easy peasy fix then - thank you @Arthur! Here is a PR to fix it 🙂 https://github.com/nf-core/mag/pull/804 You can test it if you want @John Michael Egana by using your previous commnad but with
-r update-fastqc
, but note this has other changes from
dev
too (including a major BUSCO update)
🎉 1
j
Will test and report here if if this patch works (or otherwise) thanks! @James Fellows Yates @Arthur
❤️ 2
Latest version’s (v4.0.0)
fastqc
module now works for me! Thanks again!