This message was deleted.
# generals
Slackbot
09/18/2023, 10:53 AMThis message was deleted.
s
Sergio Ferragut
09/18/2023, 5:10 PMWhat throughput are you trying to ingest?
What is your streaming job spec? how many tasks are you using?
What is your cluster deployment? MMs? MM resource limits? Historicals?
w
W G
09/18/2023, 11:47 PMTasks: 2 Running and 1 in a Pending state
W G
09/18/2023, 11:52 PMSingle node and I am injesting netflow data at approximayely 5mbps
s
Sergio Ferragut
09/19/2023, 1:53 PMThe task in a pending state is means that you do not have enough worker slots in the Middle Managers to run them concurrently. You can reduce the number of tasks or increase the capacity (druid.worker.capacity) in the Middle Managers. It is usually configured to (vcpus-1) if the middle manager is running on its own or less if it shares resources with another process.