Hi team, can I change a column’s partialUpsertStrategy, like from IGNORE to OVERWRITE. I made the change but didn’t see the effect of OVERWRITE. The result is still from IGNORE.

@Huaqiang He I think you should be able to update the partialUpsertStrategy. How did you verify that the change was not effective? And did you reload segments after the config change?

Thank you, Navina, for answering my question. I think it might be because the current consuming segment hasn’t completed. The flush time is 12h, still some hours to go. I updated one column’s partialUpsertStrategy from IGNORE to OVERWRITE. I know the update hasn’t taken effect because I see there are upserts with

option(skipUpsert=true)

. After the strategy update the column’s value is supposed to change but remains unchanged. I’m using 0.11.

After such changes, you need to reload all segments or restart servers. All the upsert metadata needs to get updated