This message was deleted.

Is this a case where I should make a second pipeline for calculating the statistics for filter_website_content?

so if I understood correctly, you have.

get_website_content -> filter_website_content

now, if

website_statistics

only needs one of the initial tasks, what about using it two times, one will process

get_website_content

and another one

filter_website_content

:

# make upstream=['get_website_content']
- source: scripts/website_statistics.py
  name: stats-1

# make upstream=['filter_website_content']
- source: scripts/website_statistics.py
  name: stats-2

does this work?

Ah perfect! Exactly what I was looking for, I will try it. Thank you! 🙏🙌👍

sure! don't hesitate to send any other questions 🙂