Hello Everyone , I am new to Flink community . Do ...
# troubleshooting
e
Hello Everyone , I am new to Flink community . Do we have a way in flink to retain only last
x
checkpoints in its checkpoint Directory - instead of manually clearing the older checkpoints from outside , does flink provide any inbuilt solution to this ?
d
Welcome Eaugene! Welcome aboard. As I am sure you are aware one must be careful with anything related to checkpoints due to their impact on recover strategy and memory requirements. Yes, there is a setting for this in flink-conf.yml
Copy code
state.checkpoints.num-retained: 5 # Retain up to 5 checkpoints
it applies globally so it must fit your available storage capacity and recovery strategy.
I am not sure what impact it will have on existing saved checkpoints in the directory however. Perhaps someone here can provide more information on that or how the older checkpoints could be systematically removed if needed. In doing anything like this you would of course want to do a backup just in case.
e
Thanks @D. Draco O'Brien for sharing this , will explore more . Agree on the backup part .