https://linen.dev logo
#ask-community-for-troubleshooting
Title
# ask-community-for-troubleshooting
w

Will Skelton

01/10/2022, 4:18 PM
Hi all, I'm trying to get things setup so that my destination files are saved in folders specific to the connection. I'm loading into Azure Blob Storage. I've looked at this document but it seems to only explain custom naming of the files. https://docs.airbyte.com/understanding-airbyte/namespaces#custom-format Anyone know how I can update my connection settings to put the extract files into a folder?
👀 1
u

[DEPRECATED] Augustin Lafanechere

01/10/2022, 5:17 PM
Hi @Will Skelton, could you try using
/
in your namespace, this will probably create a blob in the folder you expect:
my_connection/${SOURCE_NAMESPACE}
w

Will Skelton

01/10/2022, 5:27 PM
Thanks for the suggestion @[DEPRECATED] Augustin Lafanechere. I've tried that, but in double quotes similar to how the documentation shows filename customization. It doesn't appear to work without the double quotes either. Going to fiddle around with it a little more.
@[DEPRECATED] Augustin Lafanechere, I added the directory to the table prefix and it created the new folder. I'm trying to consider airbyte as an integration tool to load into a possible data lake. My current plan is to load into a file structure that resembles "/datasource/tenantid/tableorsourcename" I'd like to be able to do this programatically at some point. Do you have any advice on where I might be able to find some documentation or a blog about how I might be able to use a parameter or even data in the extract to create the second level "tenantid" folder? Thanks so much for your help!
u

[DEPRECATED] Marcos Marx

01/10/2022, 11:41 PM
Will probably you can achieve this using the Airbyte API; but I don’t know any blogs about it
👍 1
2 Views