Lennert Rienau
02/18/2022, 2:58 PMParquet it seems not to support instanceprofile. Do I get it right that S3ParquetWriter is using SimpleAWSCredentialsProvider in any case?Madhu Prabhakara
02/18/2022, 11:45 PMMuhammad Imtiaz
02/21/2022, 8:45 AMMuhammad Imtiaz
02/21/2022, 9:05 AMOfek Katriel
02/21/2022, 2:11 PMjava.nio.file.AccessDeniedException: my-bucket-name: org.apache.hadoop.fs.s3a.auth.NoAwsCredentialsException: SimpleAWSCredentialsProvider: No AWS credentials in the Hadoop configuration
when we try to sync into parquet s3 destination using InstanceProfile while for jsonl and avro it works fine.
These are the versions of airbyte and s3 destination we use:
Airbyte Version: 0.35.30-alpha
Source: Salesforce (0.1.23)
Destination: S3 (0.2.7)
Is there any special environment variable or any other setting we should define in order to make it work?