Hello, I am trying to deploy in AWS, We are using MSK (Kafka). Is there any recommended environment configs for

datahub-actions

for IAM Role based access?

can you elaborate on your use case a little further? are you looking to apply RBAC over the kafka assets in datahub via datahub actions?

My use case(s), • to push schemas from different internal sources to one single place as first step. • Tagging, data lineage • Integrate in pipelines.

I would look at adding transformers to your ingestion recipes- make sure owners and domain are applied to each source as a first step https://datahubproject.io/docs/metadata-ingestion/docs/transformer/intro/ Datahub actions could do this as well btw, but the out of the box transformers or custom transformers will enrich each MCP as they are ingested.

I was able build my own sources and recipe, it all works in my local non aws env (dockers), When i tried to apply to AWS env, we are seeing MSK config problems, I did see some python support for https://github.com/aws/aws-msk-iam-auth , we were not able to bring up `datahub action`s container, it is breaking with connectivity. so I was thinking i am missing some configs for MSK

so you ran through these instructions and you're seeing datahub-actions pod in a crashloop?

it was not in EKS its standalone containers

It would help us help you if you could share 1) the configuration that you are using 2) the actual error messages

hey @billions-tailor-78534, @rapid-ocean-29344 and I were able to huddle around use cases and potential troubleshooting in their environment.