Yusuf Ganiyu
07/27/2024, 6:23 PMstockStream.addSink(StreamingFileSink
.forRowFormat(new Path("<s3a://aws-s3-path/>"),
new SimpleStringEncoder<Stock>("UTF-8"))
.withBucketAssigner(new DateTimeBucketAssigner<>(partitionFormat))
.build()).name("S3 Sink");
Caused by: org.apache.hadoop.fs.s3a.auth.NoAuthWithAWSException: No AWS Credentials provided by DynamicTemporaryAWSCredentialsProvider TemporaryAWSCredentialsProvider SimpleAWSCredentialsProvider EnvironmentVariableCredentialsProvider IAMInstanceCredentialsProvider : com.amazonaws.SdkClientException: Unable to load AWS credentials from environment variables (AWS_ACCESS_KEY_ID (or AWS_ACCESS_KEY) and AWS_SECRET_KEY (or AWS_SECRET_ACCESS_KEY))
my pom.xml
has this dependency too:
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-aws</artifactId>
<version>3.2.4</version>
</dependency>
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-s3-fs-hadoop</artifactId>
<version>1.19.1</version>
</dependency>
Sricharan
07/27/2024, 6:33 PM'fs.s3a.aws.credentials.provider': 'com.amazonaws.auth.WebIdentityTokenCredentialsProvider'
Yusuf Ganiyu
07/27/2024, 6:34 PMConfiguration
in the code or the resources section? I'm unclear pleaseSricharan
07/27/2024, 10:00 PM