Hi. All , If my kafka topic has 32 partitions, can...
# general
c
Hi. All , If my kafka topic has 32 partitions, can we control pinot consuming threads self
m
What do you mean by controlling the consuming threads?
c
@Mayank I means, when kafka topic has 32 partitions, pinot will start 32 threads to consuming this topic, can we control this consuming threads such like i can config to 12?
m
Not at the moment. You could play with number of servers though. For example if you add 4 servers then each will read 8 partitions, and if you add 8 then each will read 4 partitions.
Curious what's the intention here? Is it because you have less number of cores and also don't want to add more servers?
c
Year, I think if one topic have 32 partitions but don’t have too much logs, I think we can config less threads to consuming this topic
m
Any chance you can reduce number of partitions? At any rate, this does seems like a legit ask. Mind filing an issue (with reasoning above) so we can see if this makes sense to support in future?
c
Thx @Mayank another question, Can we delete or truncate one day’s data in pinot by commends like mysql does?
m
Deletion is supported at segment level, not at record or time-boundary. If you can find segments for the day, threre is api's to delete (check swagger api)
c
ok, thx for your replay🙂
👍 1