This message was deleted.
# generals
Slackbot
07/05/2023, 4:43 PMThis message was deleted.
m
Michael Marshall
07/05/2023, 5:16 PMMy general understanding is that you should be able to update these policies and have it "just work" such that decreasing retention leads to messages getting deleted while increasing retention leads to messages getting stored longer (with the obvious note that already deleted messages will be gone).
Michael Marshall
07/05/2023, 5:16 PMMichael Marshall
07/05/2023, 5:16 PMDid you see these docs yet?
Michael Marshall
07/05/2023, 5:18 PMIf the docs don't answer your questions, I'm happy to grab some code references
a
Andy Walker
07/05/2023, 5:19 PMFor sure. I'm familiar with the broad concepts, how to set them and what they mean, but I was more curious about what happens when they're changed and how long that takes, whether there's a concern with accidentally changing them again while the change is ongoing, whether or not that matters or might lead to orphaned ledgers. Best practices stuff like that. The admin API makes it super easy to set these policies and get super granular
👍 1
Andy Walker
07/05/2023, 5:21 PMbut it's not clear what could go wrong and how to know what to do if it does
Andy Walker
07/05/2023, 5:23 PMlike, for example, if I have a retention set only on time and then I convert it to 50% of its former value, only to realize that 80% would be better, can I just issue the change to 80% immediately, or should I wait, and are there any risks and followup steps I need to take after such an action? Or, more broadly, are there checks I can be doing to ensure that retention and backlog are behaving within bounds and not just filling up disk with orphaned stuff?
m
Michael Marshall
07/05/2023, 6:13 PMWhen you update the retention policy, the update is applied to each affected topic (via its managed ledger) in an eventually consistent way. The first update is to the metadata store (zookeeper), and then all of the broker's will get notified of the updated state and will update the managed ledger configuration. The managed ledger then takes the retention policy into consideration by checking once every
retentionCheckIntervalInSeconds👏 1
a
Andy Walker
07/05/2023, 6:26 PMThat's great, thanks, that's a big part of what I was curious about!
2 Views