Hi Team! I have implemented a custom connector using the Python CDK and am currently wondering about the persistence of state when syncs fail. Namely, if a sync fails, is the state still persistent and used in the next sync? I've been trying to find an answer myself and came across https://github.com/airbytehq/airbyte/issues/2627, where it seems mid+stream persistence has been implemented (?), but I can't find details about what changed. In my case, it's okay if the state is not to persistet if a sync fails, because I can handle duplciate records after re-triggering the sync in the destination. However, I'm not sure what is the default behavior right now. I also read about the section Checkpointing state section in the docs, which seem to be for persisting state mid-stream, but I have not implemented any of the two methods. Am I correct that state is only persistent at the end of a successful sync, if I haven't used one of the two checkpointing state methods?

loading...

Ref to discourse forum entry: https://discuss.airbyte.io/t/clarification-on-default-behavior-for-incremental-append-sync/433