Hi Folks, Is any one using Upserts with Kinesis in...
# troubleshooting
a
Hi Folks, Is any one using Upserts with Kinesis in pinot? I have tried with a sample table and upserts are working I think this will break if we split shards, so my plan is to only use fixed number of shards (no autoscaling) and delete/recreate the realtime table pointing to new stream with increased number of shards (if we need more shards) Does this logic sounds good?
k
yes. as long as you ensure that key -> parition mapping stays consistent, I should work. @Jackie WDYT
👍 1
m
You can slightly over provision also to avoid frequent discussions
a
Thanks for the answers Yes, will over provision