Hi team, I have a few recipes that are scheduled, for the ingestion process, at the same time (E.g. -

0 0 * * *

) Does it make sense that if they run simultaneously, they’ll fail? Also - can I kill a running process?

I don’t think so, I have several ingestion running at the same time

15 1 * * *

. and so far, it running work well.

@gifted-knife-16120 - What is the size of your cluster? Mine is almost 3 TB

Hi @powerful-cat-68806, i don’t believe you can cancel ingestion via the UI. Are you seeing failures here? Could you post logs if so

@bulky-electrician-72362 @gifted-knife-16120

@powerful-cat-68806 'pending' status happened to me as well. for me it was not enough memory, and worked well afterwards. I do think that's because a number of big ingestions are running in the same time (but you can wait for someone with more knowledge about it). If your ingestions include profiling, you could try using

profiling.max_workers

configuration on ingestions, so less profiling workers will run in the same time, and maybe it will work better.

@brainy-piano-85560 10x, I’ll take a look at this flag But, I need to know how to kill a running execution

Hi @powerful-cat-68806, I was wrong about the UI here- you can cancel via the ingesiton panel https://datahubproject.io/docs/ui-ingestion/#cancelling-an-ingestion-run

@astonishing-answer-96712 I have no cancel option in the UI It’s taking way too long from your side to provide a solution 😞

Hi @powerful-cat-68806, I answered in the other thread. Please be patient with us as we’re supporting a large community! We’d love contributions here if you’d like to submit a PR

@astonishing-answer-96712 hi 🙂 DO you mean - FR(Feature Request)?

We’re open source, so we accept community contributions as well! It takes a village 🙂