Hi, We want to connect to AWS MSK from pinot using IAM authentication. For this to work, this library must be added to classpath. Is there an easy way to do so? https://github.com/aws/aws-msk-iam-auth

@Navina ^^

@piby iiuc, it says you have to include the pre-built uber jar in the classpath. So, you would need to include it in the classpath of the pinot server and controller. How do you deploy your pinot cluster components?

@Navina We have deployed Pinot on EKS using helm chart. I have provided MSK access to Pinot Service Account using IRSA role so now all Pinot components can access MSK. We want to connect realtime tables with MSK

Would it be possible to add it somewhere in values.yaml in helm chart or in my table config?

I don't think it is as simple as this. This jar must be accessible to the JVM which only looks at the jars found in the classpath.

Or do I have to build a custom pinot image to download this jar?

yes. You can build a custom pinot docker image that includes this jar. add it to pinot's lib directory which is already included in the classpath. Alternative would be to write a custom init-container script that copies the jar into the classpath.

ok thanks. I'll try

Cool. Let us know how it goes. If it works for you, then we can document the steps in the Pinot website 🙂