Hello everyone,
I would like to know if there is a configuration in airbyte that allows sending exported source data to the destination sooner during a sync.
For example I notice in the logs that the job has collected lets say 1,000,000 records. However when I check my destination, it still says that there are 0 records inserted until the final step of that job.
I’d like to ship the source records in batches of 10,000 or any arbitrary number.
Is there a way to force airbyte to do this.