Hi everyone ! Say I have an incremental migration...
# replication-troubleshooting
e
Hi everyone ! Say I have an incremental migration that is base on the
end_date
column of a postgres table. For some reason there's been a bug and I have one row that was inserted with an
end_date
in the future and was migrated by airbyte. So airbyte considers that every row that's inserted in that table with a date anterior to that date in the future is already migrated and won't migrate it. I would like to fix the date that's in the future and remigrate the rows inserted in the meanwhile. I'm wondering if deleting the rows in the destination table until the date it want to start over the migration from will do the trick (or break everything instead 😱)?
a
Deleting the row in the destination would not fix your issue. The cursor is stored internally in airbyte in an internal postgres database. This is discussed in this article: https://airbyte.com/tutorials/incremental-data-synchronization — see: “How and where are cursors persisted”
🙏 1