Hi, we are on metaplay managed servers and we would like to setup an ELT flow to visualize & analyze our data by using snowflake and a bi tool. I created a S3 integration to Snowflake which I can manually trigger to get the new or all data with my credentials. However, my credentials have an expiration time and I need to create a new one before I re-trigger the integration. In order to utilize ELT, i need a stable accesss credentials but i couldn’t find a way to do it. How can I create it?

Hi, I forwarded the question to the relevant people, however have you considered creating an analytics sink that directly uploads to snowflake instead of using s3 as a middle man?

Hi, thanks for fast reply. We haven’t tried the custom sink yet, we are using the built-in s3 sink.

Generally the way we should do this is to make a machine user (in the portal), then use that machine user to invoke

metaplay-auth get-aws-credentials

. However from a quick look at snowflake's documentation, it seems that this might not be possible. as such it would be better to create a dedicated snowflake sink.

Okay, got it. Our only option is to do a custom sink then, thank you!