I wanted to ask a bit about state in flink. A bit of context first, I'm building a flink SQL pipeline to streams data from kafka topics to Apache doris. I have table level topics in kafka and in flink I'm performing joins using these topics, and then streaming those finally to my sink tables. I have set state backend type to rocks db. My understanding is that flink will be maintaining the current table state to be whatever events I have received from kafka on a table basis.
If my task manager fails, do i lose that state? is there a way to persist my state indefinitely?