Hello! Anyone here ingesting data from redshift via the UI using temporary credentials? I am unsure how to set this up, because I don’t have a fixed password. Rather, the password for a given user get’s automatically generated whenever I make the request to redshift. Anyone has a similar setup?

I’m still a bit unclear on how this setup works - is this part of AWS role assumption, or something else?

Hello @gray-shoe-75895, it is related to this: https://docs.aws.amazon.com/redshift/latest/mgmt/generating-iam-credentials-role-permissions.html. Basically, the role that executes the ingestion process has this

redshift:GetClusterCredentials

permission. What this means is that, we don’t have a fixed password to supply in the recipe. Rather, we would like the ingestion pipeline to run this GetCredentials command (via de cli or boto3), and obtain the password. Is there a nice way to achieve this via de UI? Thank you! 🙂

Thanks this info is helpful. We don’t have support for it right now, but I’ve created an issue here https://github.com/datahub-project/datahub/issues/6098

@gifted-diamond-19544 I know it was a long time ago, but I think with the new Redshift source you should be able to set this. See my comment on the github issue - > https://github.com/datahub-project/datahub/issues/6098#issuecomment-1600303363

Thanks a lot! When I get the chance I will test it and then let you know 🙂