i suspect error is : Caused by: Process exceeded ...
# configs
a
i suspect error is : Caused by: Process exceeded running time limit (16h)
j
Yes that's a common error
resourcehelp
s
You likely need to configure the pipeline to your available computational resources to you machine or infrastructure. Please see here: https://nf-co.re/docs/usage/configuration#max-resources and the following 'Tuning workflow resources' sections of the documentation for more information.
j
Hopefully those two sections will help :)
(important to read both!)
a
Thank you James for your response
I had rerun the pipeline . it generates results in batches. The TPM is calculated only for one sample group condition but not for other two sample groups. However, i did increase resource using config script - process { withName: 'NFCORE_RNASEQRNASEQALIGN_STAR:STAR_ALIGN' { memory = 100.GB cpus = 64 time = 72.h } }
Still it is keep running from previously saved cached in work directory. Does it suppose to be in this manner or am i doing something wrong?
j
What command are you using?
a
nextflow run /data/common/software/nf-core/rnaseq/nf-core-rnaseq-3.4/workflow/ -profile singularity --input /home/amrinds/scripts/ss_musL4pf79.csv --fasta /data/amrinds/RNAseq_ref_mouse/reference_genome/genomeDir/mm39.fa --gtf /data/amrinds/RNAseq_ref_mouse/reference_genome/genomeDir/mm39.ncbiRefSeq.gtf --gene_bed /data/amrinds/RNAseq_ref_mouse/reference_genome/genomeDir/mm39.trf.bed --star_index /data/amrinds/RNAseq_ref_mouse/reference_genome/musL/genome/index/star/ --salmon_index /data/amrinds/RNAseq_ref_mouse/reference_genome/musL/genome/index/salmon/ --outdir mouseLivv10/ --skipBiotypeQC TRUE --star_index /data/amrinds/RNAseq_ref_mouse/reference_genome/musL/genome/index/star/ --salmon_index /data/amrinds/RNAseq_ref_mouse/reference_genome/musL/genome/index/salmon/ -bg -resume -c /data/amrinds/RNAseq_ref_mouse/reference_genome/STAR.config
j
OK, that looks OK to me. If you use
-resume
, it will indeed re-use the 'cached' steps from before - these are steps that in the original run completed successfully with no error. But anything that failed, will be tried again - but this time with the updated config.
If you want to start completely from scratch, run
nextflow clean -f
a few times to remove the old runs executed in teh same directory, delete teh
--outdir
, and run the command again but without the
-resume
. However this shouldn't be ncessary.
a
Do you mean if that looks ok . I should give another try with extended time and resources allocation to next run? and if it doesnot complete successfully then i should try option 2. clean -f . right?
j
Yes, you can re-run the pipeline and wait until it finishes or times out after 72h
And then if it fails you can try from scratch after cleaning
a
Sure. Than
Thank you*
Does final results of nfcore rnaseq generates until TPM counts or DEseq2 analysis as well to compare samples with two conditons given in sampleSheet?
j
That you'll have to ask on #rnaseq 🙂
a
Will do so. 🙂
many thanks for redirecting to #rnaseq
j
Every pipeline has it's own dedicated channel 🙂
a
I am quite new to this channel on slack. Glad to have good members like you to navigate through 🙂
👍 1