Airbyte is an open-source data integration engine that helps you consolidate your data in your data warehouses, lakes and databases.

Airbyte

Hi all,  I'm trying to get things setup so that my destination files are saved in folders specific to the connection.  I'm loading into Azure Blob Storage.  I've looked at this document but it seems to only explain custom naming of the files.  <https://docs.airbyte.com/understanding-airbyte/namespaces#custom-format>  Anyone know how I can update my connection settings to put the extract files into a folder?

Hi <@U01TE15MP34>, could you try using `/` in your namespace, this will probably create a blob in the folder you expect:
`my_connection/${SOURCE_NAMESPACE}`

Thanks for the suggestion <@U02JJ554F2T>. I've tried that, but in double quotes similar to how the documentation shows filename customization. It doesn't appear to work without the double quotes either. Going to fiddle around with it a little more.

<@U02JJ554F2T>, I added the directory to the table prefix and it created the new folder.   I'm trying to consider airbyte as an integration tool to load into a possible data lake.  My current plan is to load into a file structure that resembles "/datasource/tenantid/tableorsourcename"   I'd like to be able to do this programatically at some point.  Do you have any advice on where I might be able to find some documentation or a blog about how I might be able to use a parameter or even data in the extract to create the second level "tenantid" folder?  Thanks so much for your help!

Will probably you can achieve this using the Airbyte API; but I don’t know any blogs about it