Shall we add the `process_long` tag by default to ...
# proteinfold_dev
e
Shall we add the
process_long
tag by default to aria2? I was running it yesterday with defaults for colabfold, but the latest db would download never
j
Nice suggestion, I can add it to my current PR
❤️ 1
e
make sure to redo the
module patch
afterwards, thanks!
j
👌🏻
Umm, after a second thought this will make that any download will be applied the
long label
, maybe we should apply this in the
modules.config
instead?
with process names selectors instead
e
I noticed that each subworkflow has its own config..the main modules.config is not used, right? then we will need to add the aria2 to each one that is long. And better write its whole pipeline path in the withName?
j
It is used but for general stuff but yes each subworkflow has its own. I think I have a custom config for downloading the DBs where I may see which are the long downloads
Umm, I look at it and I had set to all aria processes to 12 hours, Maybe after all it maybe a good idea to set it for all aria2 processes to a sensible default 🤔 But I think I will do it in the
modules.config
here instead of patching the module, what do you think?
e
I would do it in the general modules.config, definitely. For some reason, my aria2 first tried with 4 hours, failed, and then retried with 8 and gsiled again. Not 12 :(
j
yes, probably some processes need more than 12, I can set it to 20
how much time took at the end in your case?
e
Retesting now, never finished xD
j