Does anyone know if there is an issue with fetchng...
# fetchngs
m
Does anyone know if there is an issue with fetchngs? I tried running it and I got the following error (See thread)
ids.csv
Copy code
SRR25700843
SRR25700844
command run
Copy code
nextflow run nf-core/fetchngs -r 1.12.0 -profile singularity --input ids.csv --outdir results
Command error
Copy code
Pulling Singularity image <https://depot.galaxyproject.org/singularity/python:3.9--1> [cache /ibex/user/pampum/2024-10-7_check-cryomilled-stickbug-read-lengths/work/singularity/depot.galaxyproject.org-singularity-python-3.9--1.img]
Pulling Singularity image <https://depot.galaxyproject.org/singularity/wget:1.20.1> [cache /ibex/user/pampum/2024-10-7_check-cryomilled-stickbug-read-lengths/work/singularity/depot.galaxyproject.org-singularity-wget-1.20.1.img]
WARN: Singularity cache directory has not been defined -- Remote image will be stored in the path: /ibex/user/pampum/2024-10-7_check-cryomilled-stickbug-read-lengths/work/singularity -- Use the environment variable NXF_SINGULARITY_CACHEDIR to specify a different location
[a4/d8b7ef] NOTE: Process `NFCORE_FETCHNGS:SRA:SRA_FASTQ_FTP (SRX21425721_SRR25700844)` terminated with an error exit status (4) -- Execution is retried (1)
[cb/c3c92d] NOTE: Process `NFCORE_FETCHNGS:SRA:SRA_FASTQ_FTP (SRX21425722_SRR25700843)` terminated with an error exit status (4) -- Execution is retried (1)
[1a/22cebb] NOTE: Process `NFCORE_FETCHNGS:SRA:SRA_FASTQ_FTP (SRX21425721_SRR25700844)` terminated with an error exit status (4) -- Execution is retried (2)
[0a/f15be4] NOTE: Process `NFCORE_FETCHNGS:SRA:SRA_FASTQ_FTP (SRX21425722_SRR25700843)` terminated with an error exit status (4) -- Execution is retried (2)
ERROR ~ Error executing process > 'NFCORE_FETCHNGS:SRA:SRA_FASTQ_FTP (SRX21425721_SRR25700844)'

Caused by:
  Process `NFCORE_FETCHNGS:SRA:SRA_FASTQ_FTP (SRX21425721_SRR25700844)` terminated with an error exit status (4)


Command executed:

  wget \
      -t 5 -nv -c -T 60 \
      -O SRX21425721_SRR25700844.fastq.gz \
      ftp.sra.ebi.ac.uk/vol1/fastq/SRR257/044/SRR25700844/SRR25700844_subreads.fastq.gz

  echo "843556d1efc5bf126805bf7ec11e1efe  SRX21425721_SRR25700844.fastq.gz" > SRX21425721_SRR25700844.fastq.gz.md5
  md5sum -c SRX21425721_SRR25700844.fastq.gz.md5

  cat <<-END_VERSIONS > versions.yml
  "NFCORE_FETCHNGS:SRA:SRA_FASTQ_FTP":
      wget: $(echo $(wget --version | head -n 1 | sed 's/^GNU Wget //; s/ .*$//'))
  END_VERSIONS

Command exit status:
  4

Command output:
  (empty)

Command error:
  INFO:    Converting SIF file to temporary sandbox...
  WARNING: Skipping mount /ibex/user/pampum/2024-10-7_check-cryomilled-stickbug-read-lengths/env/var/singularity/mnt/session/etc/resolv.conf [files]: /etc/resolv.conf doesn't exist in container
  wget: unable to resolve host address 'ftp.sra.ebi.ac.uk'
  INFO:    Cleaning up image...

Work dir:
  /ibex/user/pampum/2024-10-7_check-cryomilled-stickbug-read-lengths/work/2f/b0b55d2f4a3ed6d8b8d896c0eec7f7

Tip: view the complete command output by changing to the process work dir and entering the command `cat .command.out`

 -- Check '.nextflow.log' file for details
m
unable to resolve host address 'ftp.sra.ebi.ac.uk'
That sounds more like an issue with either the sra ftp, or your infra that blocks this link
m
I’m able to run the
.command.sh
file outside of the container
Copy code
cat .command.sh
#!/bin/bash -euo pipefail
wget \
    -t 5 -nv -c -T 60 \
    -O SRX21425721_SRR25700844.fastq.gz \
    ftp.sra.ebi.ac.uk/vol1/fastq/SRR257/044/SRR25700844/SRR25700844_subreads.fastq.gz

echo "843556d1efc5bf126805bf7ec11e1efe  SRX21425721_SRR25700844.fastq.gz" > SRX21425721_SRR25700844.fastq.gz.md5
md5sum -c SRX21425721_SRR25700844.fastq.gz.md5

cat <<-END_VERSIONS > versions.yml
"NFCORE_FETCHNGS:SRA:SRA_FASTQ_FTP":
    wget: $(echo $(wget --version | head -n 1 | sed 's/^GNU Wget //; s/ .*$//'))
END_VERSIONS
So it’s not a connection issue with the infrastructure. Could it be a container issue? I’m thinking this line has something to do with the DNS issues?
Copy code
WARNING: Skipping mount /ibex/user/pampum/2024-10-7_check-cryomilled-stickbug-read-lengths/env/var/singularity/mnt/session/etc/resolv.conf [files]: /etc/resolv.conf doesn't exist in container
I found this thread. Might be a related issue https://github.com/bioconda/bioconda-recipes/issues/11583
m
I'll investigate this as soon as I'm done with TEMPLATE merge
Thanks for the follow up
m
okay thank you