Mahesh Binzer-Panchal
06/04/2024, 8:46 PMenv {
// Handle java logging on stdout when discovering duplicated cgroups when
// running in singularity with Lustre mount
JAVA_TOOL_OPTIONS = "-Xlog:disable"
}
It's causing a tool to crash if I don't disable this. The JVM won't start.
Picked up JAVA_TOOL_OPTIONS: -Xlog:disable
Unrecognized option: -Xlog:disable
Error: Could not create the Java Virtual Machine.
Error: A fatal exception has occurred. Program will exit.pontus
06/05/2024, 4:35 AMpontus
06/05/2024, 3:07 PMpontus
06/05/2024, 3:19 PMpontus
06/05/2024, 3:20 PMpontus
06/05/2024, 3:28 PMMahesh Binzer-Panchal
06/10/2024, 10:44 AMprocess {
beforeScript = 'module load PDC apptainer'
}
I'm getting singularity not found if I don't do this before running nextflowpontus
06/10/2024, 10:50 AMbeforeScript helps to make sure singularity (or apptainer) is available in jobs.
For pulling images, that's done by the main process and there nextflow doesn't offer the same feature (AFAIK). So one needs to load those module before if it's the first time running with those images.Phil Ewels
06/10/2024, 12:30 PMPhil Ewels
06/10/2024, 12:33 PMociAutoPullpontus
06/10/2024, 12:35 PMsingularity.ociAutoPull that is mentioned in the documentation from earlier edge? There it seems to be for OCI images rather than generally.Phil Ewels
06/10/2024, 12:35 PMMahesh Binzer-Panchal
06/10/2024, 12:35 PMpontus
06/10/2024, 12:36 PMMarco C
06/10/2024, 12:55 PMociAutoPull relies on the Singularity/Apptainer engine for the caching of the images. Nextflow does not save any copy.
Also, there is no preliminary singularity pull executed, download happens as part of of singularity exec within each compute task.
Note how this reduces duplication of identical images across the filesystem, only the copy in the Singularity/Apptainer cache existsMarco C
06/10/2024, 12:55 PMMahesh Binzer-Panchal
06/10/2024, 12:57 PMSINGULARITY_CACHEDIR too instead of NXF_SINGULARITY_CACHEDIR / singularity.cacheDir?Mahesh Binzer-Panchal
06/10/2024, 12:58 PMMarco C
06/10/2024, 1:04 PMSo this means we should also setexactly, withtoo instead ofSINGULARITY_CACHEDIR/NXF_SINGULARITY_CACHEDIR?singularity.cacheDir
ociAutoPull, it is Singularity, not Nextflow that controls caching of the imagesMarco C
06/10/2024, 1:06 PMDoes that work if multiple people are using that dir as a cache?This is entirely left to Singularity/Apptainer, as long as cache directory permissions are set properly (everyone in the team able to read/write). This is not something that has been tested so far to be honest. Probably a good question for the Sing/Appt folks as well, they might have extra insights
Marco C
06/10/2024, 1:07 PMMarco C
06/10/2024, 1:27 PMMahesh Binzer-Panchal
06/10/2024, 1:28 PMpontus
06/10/2024, 1:42 PMSINGULARITY_CACHEDIR is not recommended.
I also don't see this changing anything, so far I'm still recommending using converted images ("SIF files") rather than oci (e.g. docker://).Marco C
06/10/2024, 1:53 PMNXF_SINGULARITY_CACHEDIR , still creates 2x copies of each image: 1 in the singularity cache (which is there anyway), and 1 managed by Nextflow.pontus
06/10/2024, 1:55 PMsingularity cache clean, there will be 8 copies instead of 1 🙂Marco C
06/10/2024, 2:13 PM