@kapa.ai I want to have a airbyte syncs from mongo to azure data blob storage, but I want to change the destination mid run, so see I want after a full refresh, I want the new files to go to a different folder instead of the old. folder, this is all to avoid having the history data in a folder

Thinking completed I am sorry, but the provided knowledge sources do not mention any feature or mechanism to dynamically change the destination output path mid-run or redirect files to a different folder specifically after a full refresh. Based on the available documentation: 1. Fixed Path Structure: The Azure Blob Storage destination connector generates paths using a hardcoded pattern:

<stream_namespace>/<stream_name>/yyyy_mm_dd_<unix_epoch>_<part_number>.<file_extension>

[Azure Blob Storage; AzureBlobStorageConfiguration.kt]. The path pattern and file name structure are not currently exposed as user-configurable options [AzureBlobStorageConfiguration.kt]. 2. Namespace Routing: You can influence the path folder by configuring the stream namespace in connection settings, as the namespace is part of the output path [Azure Blob Storage; Azure Blob Storage Migration Guide]. However, this must be updated manually at the connection level between syncs, not dynamically mid-run. 3. Overwrite Mode: To avoid retaining historical data in the same location, the destination supports the Full Refresh - Overwrite sync mode [Azure Blob Storage]. 👍 0 button 👎 0 button ℹ️ Tip: Mention @kapa.ai in the thread for follow-ups or DM the app for 1-to-1 help.