https://linen.dev logo
j

Jeffery Powell

02/14/2022, 1:29 AM
When incremental append is selected and there are no new records to add we should have the option of not writing out a file. Right now Airbyte will write out a 0 record avro file to the S3 bucket when syncing on incremental append and no new records exist. There should be an option to prevent file writes to s3 if there is no new data to write.
a

Arvi

02/14/2022, 5:18 AM
Hey we have an issue created for this https://github.com/airbytehq/airbyte/issues/7587 you can follow that. Also would suggest to comment there/ give +1
3 Views