Hello!
We are using flink on AWS EKS, deployed with the kubernetes flink operator. Flink version 16, java 11, Flink table api. We have created a service account for the flink jobs that assumes an IAM with the permissions required to read from an s3 bucket. When we shell into the flink pod, install awscli, we are able to read the object.
However, when the flink job runs, it gets a permission denied error. It works fine if the AWS tokens are exported as environment variables.
Is there flink configuration that needs set to use the aws creds that are set by a service account?