This message was deleted.

currently, this isn't supported, because Ploomber needs to store metadata at the folder level. I'm guessing you are declaring folders as outputs because the number of output files is too large? What's the inconvenience with having two folders?

because I have 16 other processes to run like Neurons networks. Each process is 3-5 steps long. Having an output folder for each task is just not the best idea!

ok, how many outputs is each task generating? is it variable or pre-defined?

It’s variable depending on the task. Can be 2 to 9 outputs per task

in that case, you'd have to declare each file as a separate product in your

pipeline.yaml

if you want to put all outputs in the same folder. otherwise, they'd need to be in separate folders. can you open an issue? this is great feedback, I think we should support this

sure! Will do that