Hi team, We have a realtime table in Pinot cluste...
# troubleshooting
a
Hi team, We have a realtime table in Pinot cluster. We want to migrate the realtime data to another Pinot cluster. is it possible to load the COMPLETED segments into new cluster somehow? Pinot version: 1.0
m
You will need to write a script to call the upload api and push the new segments
a
are you referring to this?
m
Yes
a
@Mayank @Xiang Fu, one more doubt, do we need to keep the no. of kafka topic partition same in new cluster?
also how to make sure that the CONSUMING segment and the uploaded segment is part of the same server. Since real time table requires topic partition to server mapping to be maintained.
m
Is this upsert enabled?
You can push segments to upsert enabled table, it will maintain the upsert guarantees needed.
a
yeah, this is upsert enabled table
x
Then you should keep all the partitions same for kafka and pinot table
a
thanks