This message was deleted.
# general
s
This message was deleted.
b
As per https://druid.apache.org/docs/latest/development/extensions-core/kinesis-ingestion.html fetchThreads means `Size of the pool of threads fetching data from Kinesis. There is no benefit in having more threads than Kinesis shards. Default is (cores -1)
a
It is per task
👍 1
j
Thanks @Brandon Tan @Amatya Avadhanula so is the "Size of the pool of threads" referenced in Brandon's commend defined as "fetchThreads * taskcount" or is it just "fetchThreads"? Basically im trying to see if I should set fetchThreads to = my number of kinesis shards or my number of kinesis shards / # of kinesis tasks
b
This is what I could gather:
Copy code
`taskCount` determines the number of `taskGroup`s each of which consumes a disjoint set of kinesis shards. `fetchThreads` shouldn't be greater than the number of shards assigned to a taskGroup. For example, given 20 shards and 10 `taskCount`, each taskGroup will be assigned 2 shards and thus `fetchThreads` should be set to 2.
j
thanks @Brandon Tan!