kananindzya
03/18/2022, 5:10 AMSync mode
.
After data synchronization, I migrate from Destination S3 bucket1 to another bucket2.
So, my question:
How does arbyte support incremental data loading, if the data in destination s3 bucket 1 is moved, then how will it understand that the file has already been downloaded?Augustin Lafanechere (Airbyte)
03/18/2022, 1:59 PMHow does arbyte support incremental data loading, if the data in destination s3 bucket 1 is moved, then how will it understand that the file has already been downloaded?Airbyte stores what was already downloaded in its database, in what we call the state object. Removing files from your destination bucket will not affect how the source is incrementally synced.
kananindzya
03/18/2022, 6:01 PM