Does anyone have experience with migrating from DataTableVersion V3 -> V4? Since it is a cluster level config, the change feels risky, especially for large clusters with many tables.
Could have been more manageable if there was a way to migrate per table, but not sure if this is possible.
balci
06/21/2023, 6:40 PM
@Xiang Fu@Mayank maybe have some experience?
m
Mayank
06/21/2023, 8:35 PM
@Rong R ^^
r
Rong R
06/21/2023, 8:37 PM
major change between data table v3 and v4 is the null bitmap support.
broker should be able to handle both v3 and v4 format during upgrade. see: DataTableSerDeTest#testV3V4Compatibility
b
balci
06/21/2023, 8:53 PM
Thanks for the reply @Rong R. Do you know if v2 -> v4 would also be compatible change?
r
Rong R
06/21/2023, 8:53 PM
that's what I am not 100% sure. you can definitely set the cluster config to v2->v3 first. restart all components in normal upgrade fashion, then do the same from v3->v4