Hello <!here>, Is there a way to directly change t...
# mag
s
Hello <!here>, Is there a way to directly change the number of threads or cores in the MAG pipeline at the workflow level? We need to process multiple deeper-depth samples on the server to reduce the overall time.
j
What do you mean exactly at a workflow level?
If nextflow is set up correctly you change the number of CPUs on a per pipeline step/job basis
👍 1
s
I was looking for the thread configuration in
nextflow.config
, but I realized it's actually defined in
base.config
with the other resource settings. Now I understand. Never mind!
j
OK!
Nice 🙂
🙌 1
Some more docs here:
resourcehelp
s
You likely need to configure the pipeline to your available computational resources to you machine or infrastructure. Please see the following two(!) sections: - https://nf-co.re/docs/usage/getting_started/configuration#tuning-workflow-resources - https://nf-co.re/docs/usage/getting_started/configuration#max-resources of the documentation for more information.
👍 1
s
Thank you @James Fellows Yates, For aircraft wastewater shotgun data, do you recommend any additional settings based on your experience? Any guidance would be helpful!
j
No clue, I've never worked on that type of sample sorry
You could ask #C070369GP7T if anyone is working on wastewater surveillance
s
No worries, Thanks!
d
I am right now looking at wastewater from a wastewater treatment plant. Its quite divers, i.e. all time to multiple days (just put a lot) and memory of most processes need to be up as well.
👍 1