Hello everyone, I am trying to authenticate s3 via...
# troubleshooting
m
Hello everyone, I am trying to authenticate s3 via service account. I create a service account which name is “flink”. I created IAM Role in AWS like “s3 full access”. I added role arn as a annotation in “jobServiceAccount” part inside of values.yaml ( I am using flink-k8s-operator ). I also added
Copy code
fs.s3a.aws.credentials.provider: com.amazonaws.auth.WebIdentityTokenCredentialsProvider
fs.s3a.path.style.access: 'true'
fs.s3a.endpoint: s3.<region>.<http://amazonaws.com|amazonaws.com>
Note: I enabled HA. But i am getting following errors;
Copy code
-> Caused by: org.apache.flink.util.FlinkException: Could not create the ha services from the instantiated HighAvailabilityServicesFactory org.apache.flink.kubernetes.highavailability.KubernetesHaServicesFactory.

-> Caused by: java.nio.file.AccessDeniedException: s3://<bucket_name>/flink/recovery/test/blob: org.apache.hadoop.fs.s3a.auth.NoAuthWithAWSException: No AWS Credentials provided by WebIdentityTokenCredentialsProvider : com.amazonaws.SdkClientException: Unable to execute HTTP request: sts.<region>.<http://amazonaws.com|amazonaws.com>
What should i do ? (Flink version is 1.16.0)
p
Did you manage to make it work?
m
I couldnt