Has anyone using the azure blob storage destinatio...
# replication-troubleshootingj
Jordan Fox
12/05/2022, 8:13 PMHas anyone using the azure blob storage destination updated the connector so an Incremental Append sync doesn't create a 0 byte blob if there's no new data? I'm currently scanning in the evening and removing any 0 byte blobs.
For context, running an incremental append every 5 minutes will create 105,120 blobs/year, pointless if they're 0 bytes.
n
Nataly Merezhuk (Airbyte)
12/05/2022, 8:20 PMHi Jordan! Could you please give me bit more info:
1. Airbyte version
2. Connector versions
3. Any sync logs
Thanks!
j
Jordan Fox
12/05/2022, 8:23 PMAirbyte version - 0.40.22
Connector version - 0.1.6
Sync log attached
Jordan Fox
12/05/2022, 8:24 PMCan notice in stream stats that SPECIAL_EXCHANGE_RATES isn't mentioned, but I have a ton of 0 byte blobs for it
n
Nataly Merezhuk (Airbyte)
12/20/2022, 6:16 PMHey Jordan! Sorry for the wait - could you please create a GitHub issue for this?
j
Jordan Fox
12/28/2022, 7:34 PMn
Nataly Merezhuk (Airbyte)
12/28/2022, 8:14 PMThanks! Triaged it to the appropriate team.
3 Views