In Apache Druid, I need a separate ingestion task ...
# general
a
In Apache Druid, I need a separate ingestion task queue for a specific datasource. For example, I have 10 middle managers (mm_1 through mm_10) and 2 datasources, ds_1 and ds_2. All ingesion slots are always bussy by ingestion data to ds_1, and new task of ds_2 goes to the end of the big queue. I need the tasks to ingest ds_2 to start immediately (or as soon as possible), and I want to reserve mm_10 exclusively for ds_2. How can I achieve this?
k
Have a look at Overlord dynamic configuration - with this you can set affinities etc. https://druid.apache.org/docs/latest/configuration/#overlord-dynamic-configuration
🙌 1
a
Thank you very much. Stategy fillCapacity looks like what I searched for