Juan Serranoi Fernández
09/17/2025, 7:53 AMNFCORE_TAXPROFILER:taxprofiler:PROFILING:KRAKEN2_KRAKEN2 (standard|bracken|4) terminated for an unknown reason -- Likely it has been terminated by the external system -- Execution is retried (2)Juan Serranoi Fernández
09/17/2025, 7:54 AMNFCORE_TAXPROFILER:taxprofiler:PROFILING:KRAKEN2_KRAKEN2 (standard|kraken2|1) terminated for an unknown reason -- Likely it has been terminated by the external system
Command executed:
kraken2 \
--db k2_standard_20250402 \
--threads 16 \
--report 1_1_standard.kraken2.kraken2.report.txt \
--gzip-compressed \
\
\
--output /dev/null \
--paired \
--quick \
1_1.fq.gz 1_2.fq.gz
cat <<-END_VERSIONS > versions.yml
"NFCORE_TAXPROFILERtaxprofilerPROFILING:KRAKEN2_KRAKEN2":
kraken2: $(echo $(kraken2 --version 2>&1) | sed 's/^.*Kraken version //; s/ .*$//')
pigz: $( pigz --version 2>&1 | sed 's/pigz //g' )
END_VERSIONS
Command exit status:
-
Command output:
(empty)
Command wrapper:
slurmstepd: info: Setting TMPDIR to /scratch/920716. Previous errors about TMPDIR can be discarded
Loading database information...
Work dir:
/mnt/lustre/scratch/nlsas/home/csic/bse/mmp/proyect_severo_ochoa/nextflow_work/d6/cdeba465fe28c10c3e98128045c996
Container:
/mnt/lustre/scratch/nlsas/home/csic/bse/mmp/proyect_severo_ochoa/apptainer_cache/community.wave.seqera.io-library-kraken2_coreutils_pigz-45764814c4bb5bf3.img
Tip: when you have fixed the problem you can continue the execution adding the option -resume to the run command line
-- Check '.nextflow.log' file for details
ERROR ~ Pipeline failed. Please refer to troubleshooting docs: https://nf-co.re/docs/usage/troubleshooting
-- Check '.nextflow.log' file for details
[86/96cd10] Re-submitted process > NFCORE_TAXPROFILERtaxprofilerPROFILING:KRAKEN2_KRAKEN2 (standard|kraken2|3)Juan Serranoi Fernández
09/17/2025, 7:58 AMJames Fellows Yates
09/17/2025, 8:07 AMJames Fellows Yates
09/17/2025, 8:08 AMJames Fellows Yates
09/17/2025, 8:08 AMSlackbot
09/17/2025, 8:08 AMJames Fellows Yates
09/17/2025, 8:08 AMJames Fellows Yates
09/17/2025, 8:12 AMCaused by:
Process `NFCORE_TAXPROFILER:taxprofiler:PROFILING:KRAKEN2_KRAKEN2 (standard|kraken2|1)` terminated for an unknown reason -- Likely it has been terminated by the external system
I guess is caused by SLURM killing the job as it took too long
But this is maybe related due to
ls: no se puede acceder a '*.classified.*': No existe el fichero o el directorio
ls: no se puede acceder a '*.classified_*': No existe el fichero o el directorio
ls: no se puede acceder a '*.unclassified.*': No existe el fichero o el directorio
ls: no se puede acceder a '*.unclassified_*': No existe el fichero o el directorio
ls: no se puede acceder a '*classifiedreads.txt': No existe el fichero o el directorio
As you identified. Which I think is coming from the the tool somehow not being able to write the output files...? This would be something to do with your system I think.
But I see that your .command.log (which combines .std and out in one) is larger... could you send the .command.loig file and see what other information is in there?Juan Serranoi Fernández
09/17/2025, 9:26 AMcat .command.log
slurmstepd: info: Setting TMPDIR to /scratch/921548. Previous errors about TMPDIR can be discarded
Loading database information... done.
32032736 sequences (9609.82 Mbp) processed in 181.492s (10589.8 Kseq/m, 3176.94 Mbp/m).
28169576 sequences classified (87.94%)
3863160 sequences unclassified (12.06%)
ls: no se puede acceder a '*.classified.*': No existe el fichero o el directorio
ls: no se puede acceder a '*.classified_*': No existe el fichero o el directorio
ls: no se puede acceder a '*.unclassified.*': No existe el fichero o el directorio
ls: no se puede acceder a '*.unclassified_*': No existe el fichero o el directorio
ls: no se puede acceder a '*classifiedreads.txt': No existe el fichero o el directorio
*****************************************************************************
* *
* JOB EFFICIENCY REPORT (seff 921548) *
* *
*****************************************************************************
Job ID: 921548
Cluster: finisterrae3
User/Group: csbsemmp/csic
State: COMPLETED (exit code 0)
Nodes: 1
Cores per node: 16
CPU Utilized: 00:10:21
CPU Efficiency: 0.94% of 18:23:28 core-walltime
Job Wall-clock time: 01:08:58
Memory Utilized: 90.92 GB
Memory Efficiency: 75.77% of 120.00 GB
*****************************************************************************James Fellows Yates
09/17/2025, 9:27 AMJames Fellows Yates
09/17/2025, 9:27 AM-resume but also with a config that increases your initial amount of memoryJames Fellows Yates
09/17/2025, 9:27 AMSlackbot
09/17/2025, 9:27 AMJames Fellows Yates
09/17/2025, 9:28 AMJuan Serranoi Fernández
09/17/2025, 9:51 AMprocess {
executor = 'slurm'
queue = 'medium'
cpus = 4
memory = '8 GB'
time = '4h'
stageInMode = 'symlink'
stageOutMode = 'copy'
scratch = true
errorStrategy = 'retry'
maxRetries = 2
maxForks = 2
withName: 'NFCORE_TAXPROFILER:TAXPROFILER:FASTQC' {
memory = '6144 MB'
time = '1h'
cpus = 2
}
withName: 'NFCORE_TAXPROFILER:TAXPROFILER:PROFILING:KRAKEN2_KRAKEN2' {
cpus = 16
memory = '120 GB'
time = '6h'
clusterOptions = ''
}
withName: 'NFCORE_TAXPROFILER:TAXPROFILER:PROFILING:BRACKEN_BRACKEN' {
cpus = 8
memory = '24 GB'
time = '3h'
clusterOptions = ''
}
}
params {
input {
staging = false
}
}
executor {
queueSize = 50
queueStatusPollingInterval = '10 sec'
exitStatusReadTimeout = '5 min'
}
apptainer {
enabled = true
autoMounts = false
runOptions = '--bind /mnt/lustre'
cacheDir = 'path/apptainer_cache'
}
env {
APPTAINER_BINDPATH = '/path/' // Asegura que apptainer monte esta ruta
}Juan Serranoi Fernández
09/17/2025, 9:53 AMnextflow run nf-core/taxprofiler \
-r 1.2.4 \
-profile apptainer \
--input /path/reduced_samplesheet.csv \
--databases /path/reduced_databases.csv \
--outdir /path/reduced_results/ \
--run_kraken2 \
--run_bracken true \
-resumeJames Fellows Yates
09/17/2025, 10:06 AMwithName: 'NFCORE_TAXPROFILER:TAXPROFILER:PROFILING:KRAKEN2_KRAKEN2' {
cpus = 16
memory = '120 GB'
time = '6h'
clusterOptions = ''
}
Looks good, is it still retrying with this?
But maybe you could explicitly reference the confic file in the command too by adding -c nextflow.config before resumeJuan Serranoi Fernández
09/17/2025, 10:24 AMJuan Serranoi Fernández
09/19/2025, 7:25 AMJames Fellows Yates
09/19/2025, 7:34 AM