Hi <@U011R2VMS4S> / <@UDQU92KBK> I was going throu...
# troubleshooting
m
Hi @Kartik Khare / @Mayank I was going through instance_assignment doc and it seems for LLC ideal config is one to one mapping of stream partition to pinot table partition. Is my understanding correct. My tables are upsert (partial & full both). In case of non upsert balance segment strategy should be fine. What do we in situation where some tables of high ingestion rate?
Agenda : We are trying to standardise table configuration
m
Yes number of partitions in Kafka and Pinot will be same. May be don’t standardized across upsert and non upsert tables, they will have slightly different settings
m
I could not understand the last statement you mean upsert and non upsert have different behavior when it comes to consumption so instance assignment could vary?
And What do we in situation where some tables of high ingestion rate?
m
They will need different configs so you cannot use same configs. Also for high ingestion rate need to have more partitions in Kafka and Pinot
m
Hi @Mayank Would you suggest default setting for upsert tables for segment Assignment? Can you recommend what it is? Is it balanced segment Assignment or partition replica assignment with 1 numPartition
Hi @Mayank Can you let me know here?
Hi @Mayank
And instance assignment should be replica-group based, as in the example
m
Hi @Mayank I went through this and it does not mentioned what is the default for upsert tables. It just says default behavior is balanced segment strategy
m
You need to set replica groups explicitly - check the table config example for instance assignment strategy section