@kapa.ai I set Azure Blob Storage Target Blob Size (MB) equal to 50, and when I launch a sync it starts to upload csv files to 200 MB until it splits

Based on the knowledge sources, there is a relevant note about this behavior in the Azure Blob Storage destination migration guide: > The "Azure Blob Storage file spill size" option has been renamed to "file split size". It also now takes effect on CSV files, which previously ignored the option entirely. [Azure Blob Storage Migration Guide] This suggests that in older versions of the Azure Blob Storage destination connector (prior to version 1.0.0), the spill/split size setting was ignored for CSV files entirely. If you are running a version older than 1.0.0, that would explain why your 50 MB setting is not being respected and files are growing to ~200 MB before splitting. Recommended action: Upgrade your Azure Blob Storage destination connector to version 1.0.0 or later, where the file split size setting is properly applied to CSV files. The knowledge sources do not contain further details about what specifically causes the 200 MB threshold you're observing on your current version, so if upgrading the connector does not resolve the issue, I'd recommend checking the connector version you're running and opening a support ticket or GitHub issue with Airbyte for further investigation. 👍 0 button 👎 0 button ℹ️ Tip: Mention @kapa.ai in the thread for follow-ups or DM the app for 1-to-1 help.

@kapa.ai im on connector version 1.1.6

message has been deleted