Hi! I am trying to run the hic pipeline using appt...
# hic
d
Hi! I am trying to run the hic pipeline using apptainer instead of singularity. I run into the following error, which is not present using singularity. Other pipelines work with apptainer. Has someone tried this before? 🙂 Apptainer seems not to be able to pull containers, the timelimit is not reached, it fails more or less instantly. When i try to pull the containers manually both singularity and apptainer fail.
Copy code
dos02bi@gaia2:~/test3$ nextflow run nf-core/hic -r 2.1.0 -profile test,apptainer --outdir ./
Nextflow 24.10.1 is available - Please consider updating your version to it

 N E X T F L O W   ~  version 24.10.0

[...]

Pulling Apptainer image <docker://biocontainers/python:3.8.3> [cache /home/dos02bi/test3/work/singularity/biocontainers-python-3.8.3.img]
Pulling Apptainer image <docker://biocontainers/mulled-v2-c6ff206325681cbb9c9ef890bb8de554172c0483:713df51cd897ceb893b9a6e6420f527d83c2ed95-0> [cache /home/dos02bi/test3/work/singularity/biocontainers-mulled-v2-c6ff206325681cbb9c9ef890bb8de554172c0483-713df51cd897ceb893b9a6e6420f527d83c2ed95-0.img]
Pulling Apptainer image <docker://biocontainers/samtools:1.16.1--h6899075_1> [cache /home/dos02bi/test3/work/singularity/biocontainers-samtools-1.16.1--h6899075_1.img]
Pulling Apptainer image <docker://biocontainers/bowtie2:2.4.4--py39hbb4e92a_0> [cache /home/dos02bi/test3/work/singularity/biocontainers-bowtie2-2.4.4--py39hbb4e92a_0.img]
WARN: Apptainer cache directory has not been defined -- Remote image will be stored in the path: /home/dos02bi/test3/work/singularity -- Use the environment variable NXF_APPTAINER_CACHEDIR to specify a different location
ERROR ~ Error executing process > 'NFCORE_HIC:HIC:INPUT_CHECK:SAMPLESHEET_CHECK'

Caused by:
  Failed to pull singularity image
    command: apptainer pull  --name biocontainers-python-3.8.3.img.pulling.1732529258575 <docker://biocontainers/python:3.8.3> > /dev/null
    status : 255
    hint   : Try and increase apptainer.pullTimeout in the config (current is "20m")
    message:
      FATAL:   While making image from oci registry: error fetching image to cache: failed to get checksum for <docker://biocontainers/python:3.8.3>: reading manifest 3.8.3 in <http://docker.io/biocontainers/python|docker.io/biocontainers/python>: requested access to the resource is denied



 -- Check '.nextflow.log' file for details
👀 1
✅ 2
Copy code
dos02bi@gaia2:~/test3$ apptainer pull  --name biocontainers-bowtie2-2.4.4--py39hbb4e92a_0.img.pulling.1732529260292 <docker://biocontainers/bowtie2:2.4.4--py39hbb4e92a_0>
FATAL:   While making image from oci registry: error fetching image to cache: failed to get checksum for <docker://biocontainers/bowtie2:2.4.4--py39hbb4e92a_0>: reading manifest 2.4.4--py39hbb4e92a_0 in <http://docker.io/biocontainers/bowtie2|docker.io/biocontainers/bowtie2>: manifest unknown
dos02bi@gaia2:~/test3$ singularity pull  --name biocontainers-bowtie2-2.4.4--py39hbb4e92a_0.img.pulling.1732529260292 <docker://biocontainers/bowtie2:2.4.4--py39hbb4e92a_0>
FATAL:   While making image from oci registry: error fetching image to cache: failed to get checksum for <docker://biocontainers/bowtie2:2.4.4--py39hbb4e92a_0>: reading manifest 2.4.4--py39hbb4e92a_0 in <http://docker.io/biocontainers/bowtie2|docker.io/biocontainers/bowtie2>: manifest unknown: manifest unknown
m
I think I know what the issue is
This pipeline is lagging a tiny bit behind
can you try adding this line in a
custom.config
file and supply it with
-c
with your command line?
👍 1
d
@Maxime Garcia Works like a charm. Thanks a lot!
m
wonderful
I can see that @nservant has made a PR in July to prepare for a new release, I'll try to see with him if we can squeeze in the TEMPLATE udpate at the same time
👍 1