What is the recommended way to migrate a pinot clu...
# generalz
Zsolt Takacs
08/11/2021, 9:19 PMWhat is the recommended way to migrate a pinot cluster to a different s3 bucket?
m
Mayank
08/11/2021, 9:29 PM
Is this for an offline or realtime table? Also, do you have to do this without downtime?
z
Zsolt Takacs
08/12/2021, 6:07 AMAll of our tables are hybrid with RealtimeToOffline task configured. For now we can live with downtime but I'd be interested in both scenarios for later.
m
Mayank
08/12/2021, 1:32 PM
There are multiple options: but easiest/safest would be to create a new table, bootstrap and migrate (no downtime either).
Mayank
08/12/2021, 1:34 PM
More involved options might look like copying the data to new location, repushing for offline, along with config change and restart (for offline). More advanced might require changing download url in ZK metadata
Mayank
08/12/2021, 1:34 PM
But this is a good feature ask for Pinot to automatically handle this
Mayank
08/12/2021, 1:35 PM
And we can/should take this up as a enhancement request
👍 1
3 Views