How is the state storage used? Would there be a problem with in-process jobs when upgrading a kubernetes deployment when using the pre-configured Minio state storage instead of S3 storage? The instructions have you delete the the instances and recreate them. I’m wondering if there is some temporary job information stored in Minio/S3 that would affect in-process or other jobs with an upgrade. Regarding this: STATE_STORAGE_MINIO_ACCESS_KEY=minio STATE_STORAGE_MINIO_SECRET_ACCESS_KEY=minio123

Hey Minio is used to store the logs information and not the state info

So is this STATE_STORAGE_* naming left over from before state was moved to the DB or something?

We store state also in the DB now if you are using the latest version you will find a table for it. @Marcos Marx (Airbyte) correct me if I am wrong