Hi, I am having issue with the pipeline, I wanted ...
# mag
r
Hi, I am having issue with the pipeline, I wanted to restart the pipeline after lowering memory for several processes in the config file. Last time I launched the pipeline, it was almost finished, and now it is restarting from the assembly (NFCORE_MAG🔍ASSEMBLYSHORTREAD ASSEMBLYMEGAHIT). I really need help, please. I confirm that the last work directories still exist, and I have tried -resume 82d63175-557f-4551-b9a9-ab933b498e56 with the last hashes but it still doesn't work ... 😞
j
Unfortunately the
-resume
is really complicated in #CE9MS66BS 😕 it somewhat depends how far on the pipeline you got where it will successfully resume from 😕 Did you try with
-resume <run name>
? (I don't think it would make a difference with the run ID though ...)
c
I had some issues with resume as well, I know that some task that were supposed to be finished and then when I resumed it, the pipeline asume that it wasnt done and had to do it again...
r
@James Fellows Yates Yes I have tried this, and still restart assembly. I was wondering, I have all my binning generated. The pipeline have stopped just after the TIARA analysis, so I would need to restart from DasTool analysis then do the Bin quality, is it possible ? If not from nf/core mag, is it possible from Nextflow to do this type of analysis ? The pipeline took a lot of time to process these data si I can't restart all over again .
j
Ok that's unusual, usually, once you're passed binning it shouldn't go back to assembly
You could maybe use the
assembly_input
https://nf-co.re/mag/5.4.0/docs/usage/#supplying-pre-computed-assemblies and at least might be able to recover some of the time
r
Mmh yes, but I suspect that's because I changed the config file of already finished processes. I build a little pipeline to finish the analyses, thanks for the support
j
OK fair enough!
One day we will understand the mysteries of
-resuem
😅
Sorry I didn't have a better naswer!
r
I think that's my bad there, however the pipeline was really helpful and will be cited when this study will be published.
❤️ 1