Hey, here with what feels like a bit of a dumb que...
# help
t
Hey, here with what feels like a bit of a dumb question but for the life of me I can't seem to find an answer. I'm running a pipeline where one of the final processes is retried before timing out and consequently causing the pipeline to fail. At this point in the pipeline the log reports "Plus 3 more processes waiting for tasks…". I'd like to know what these three processes are, but can't seem to find this information after trying to query the log with
nextflow log
, inspecting the
.nextflow.log
, and running with
-ansi-log
. What is the easiest way to accessing this information for upcoming processes?
t
I have never had that message (not using the newest Nextflow version, though) and don't exactly knows what it refers to. But if you extract which processes have started (lines with `Starting process`/`Submitted process`) and finished (lines containing
status: COMPLETED;
for a process) from the
.nextflow.log
, that ideally should show you what was running at any given point. Personally, I don't worry about these things. If a run fails, I have to find the problem, fix it (be it faulty input or a the need for more resources in a config, etc.), and then rerun with
-resume
. (I use
finish
in my
errorStrategy
, so any process that starts is allowed to finish, rather than getting killed, so the progress to this point is not wasted and it can be used from cache with
-resume
.)