Hi all, I am running the mag pipeline with a conf...
# configs
n
Hi all, I am running the mag pipeline with a config that allocates fixed queueSize and cpus values and was wondering which is the best way to monitor that it actually works as expected (queueSize and cpus)? I am reading the logs but sometimes the task monitor shows more tasks with status RUNNING than the value of the queueSize.
👀 1
j
For queueSize I just check the number of jobs under your name on teh schedullar
e.g. SLURM
squeue -u $USER
cpus values are a little more tricky as you would have to find the specific jobs
queueSize should limit the number of jobs Nextflow submits at one point, so you shoun't have more than that number in your
squeue
thing (if slurm)
OR you use seqera platform all the information is right there for you in the table (cpus) and running jobs (summary at the top)
n
Great! Thanks for the fast response @James Fellows Yates, will try these suggestions. For the last one you mentioned, is it the one with the "tower" flag?
j
Yes that's the one!
💯 1
But you have to sign in etc
👍 1
s
If you are using slurm, I define an alias:
alias squeue='squeue -o "%.7i %.100j %.7u %.7P %.2t %.8M %.3c %.5m %Z"'
which means that squeue will show much more useful information
👍 1