is there a way to configure `ConcurrentTasksPerWor...
# general
c
is there a way to configure
ConcurrentTasksPerWorker
for running multi tasks in parallel in minion worker?
figured out, we need to configure
<TASK>.numConcurrentTasksPerInstance
through controller API, e.g. make a post request to
http(s)://<CONTROLLER>/cluster/configs
:
Copy code
curl --header "Content-Type: application/json" \
     --request POST \
     --data '{"SegmentGenerationAndPushTask.numConcurrentTasksPerInstance":"2"}' \
     https://<CONTROLLER>/cluster/configs
this will allow 2 parallel sub-tasks in a minion worker see: https://docs.pinot.apache.org/basics/concepts/components/cluster/minion#enable-tasks
🙏 1