Alejandra Rubio
05/20/2024, 8:31 AMPhil Ewels
05/20/2024, 8:45 AM-profile mycluster is easier than writing an sbatch job each time. Configuration precedence in Nextflow is here, but just to confirm - if you launch Nextflow in an sbatch job then the resources you give it won't matter. Nextflow itself will be submitting more sbatch jobs and they won't be affected by the resources assigned to the head Nextflow job. Also note that many people run Nextflow interactively as the head job shouldn't take much in the way of resources (though approach to this varies sysadmin to sysadmin and HPC to HPC).
2. Institutional configs typically never contain parameters for specific pipeline runs, only things related to the cluster. So yes, users should set the parameters each time. Typically we suggest that people do this in a YAML file in the launch directory and do nextflow run xxx -profile mycluster -params-file myparams.yml where the profile is the cluster specific config from the institutional configs and the params file are specific to this run.
3. Not necessary, defaults will be used. But on HPC it can be nice to set up a shared cache to prevent many users downloading the same (singularity) images again and again. You can do this using $NXF_SINGULARITY_LIBRARY which is allowed to be read-only, so you can put images there for end users. $NXF_SINGULARITY_CACHEDIR should then be writeable and Nextflow will fetch and save images there as needed. This is different to $SINGULARITY_CACHEDIR which is used by Singularity itself when building images. That also needs to be writeable.Phil Ewels
05/20/2024, 8:45 AMPhil Ewels
05/20/2024, 8:46 AMPhil Ewels
05/20/2024, 8:46 AMJames Fellows Yates
05/20/2024, 8:55 AMAlejandra Rubio
05/20/2024, 9:24 AMSimon Pearce
05/20/2024, 11:02 AMConfiguration precedence in Nextflow is here, but just to confirm - if you launch Nextflow in an@Phil Ewels, is this correct, without explicitly having specified slurm in a config file? I would have assumed that Nextflow would just act locally on the node that it lands on in this case.job then the resources you give it won't matter. Nextflow itself will be submitting moresbatchjobs and they won't be affected by the resources assigned to the head Nextflow job.sbatch
Phil Ewels
05/20/2024, 11:44 AMslurm already. You're right that it defaults to local 👍🏻Simon Pearce
05/20/2024, 11:46 AM