Is this your first time deploying Airbyte
No
OS Version / Instance
Alpine Linux
Memory / Disk
8GB / 32GB
Deployment
Docker
Airbyte Version
0.35.47-alpha
Source name/version
MySQL / 0.5.6
Destination name/version
BigQuery / 0.6.11
Step
Incremental | Append
Description
I'm using the incremental sync on an auto-incremental integer ID for a few tables, and this is usually fine. However, there was an instance where Airbyte failed to run a job on the first attempt, then succeeded on the second. Unfortunately, this has created some duplicate entries in the BigQuery dataset, and I'm not sure why this has happened. What's the normal best practice for making sure this doesn't occur again? I'm thinking of switching to using the Deduped write mode, but it seems like this issue shouldn't happen with an incremental run in the first place.