Hey team , I have some realtime tables ( totally 1...
# getting-startede
Eaugene Thomas
04/12/2023, 6:22 AMHey team , I have some realtime tables ( totally 1.3TB ) in Cluster A . Is there any way I can copy them to different pinot cluster B ?
b
Barkha Herman
04/12/2023, 1:32 PMcopy or move?
e
Eaugene Thomas
04/12/2023, 6:33 PMCopy
b
Barkha Herman
04/13/2023, 1:21 PM@Mark Needham rote something on copying segments. Not sure if this is a valid solution for your needs based on size: https://www.markhneedham.com/blog/2021/12/06/apache-pinot-copy-segment-new-table/
m
Mark Needham
04/13/2023, 1:36 PMI wonder whether there might be a way to do that without having to copy all the segments
Mark Needham
04/13/2023, 1:36 PMif we can point cluster B at cluster A’s deep store
Mark Needham
04/13/2023, 1:37 PMwe should be able to get it to pull down the segments
e
Eaugene Thomas
04/13/2023, 1:40 PM@Mark Needham , Thats how I did it . I copied ZK states across the clusters .
In my case the naming convention & count of server nodes in server tenants of the table was same in both the cluster , so it worked . I’ll try to write down my learnings & how I did it in , share some scripts used . Happy to contribute !
m
Mark Needham
04/13/2023, 1:40 PMneat. And yeh if you share how you did it I can write it all up