@kapa.ai trying to set up a S3 source but I get this error

Traceback (most recent call last): File "/usr/local/lib/python3.13/site-packages/airbyte_cdk/sources/file_based/availability_strategy/default_file_based_availability_strategy.py", line 79, in check_availability_and_parsability file = self._check_list_files(stream) File "/usr/local/lib/python3.13/site-packages/airbyte_cdk/sources/file_based/availability_strategy/default_file_based_availability_strategy.py", line 106, in _check_list_files raise CheckAvailabilityError( FileBasedSourceError.ERROR_LISTING_FILES, stream=stream.name ) from exc airbyte_cdk.sources.file_based.exceptions.CheckAvailabilityError: Error listing files. Please check the credentials provided in the config and verify that they provide permission to list files. Contact Support if you need assistance. stream=all

The error

CheckAvailabilityError: Error listing files. Please check the credentials provided in the config and verify that they provide permission to list files

indicates that Airbyte cannot access your S3 bucket, most likely due to a credentials or permissions issue. Here are the things to check: 1. Verify Your Credentials • AWS Access Key ID and Secret Access Key: Make sure there are no typos, extra spaces, or characters. Confirm the key is Active (not deactivated or deleted) in the AWS Console → IAM → Users → Security credentials tab. [S3 troubleshooting] • You can test your credentials locally by running:export AWS_ACCESS_KEY_ID=your-access-key export AWS_SECRET_ACCESS_KEY=your-secret-key aws sts get-caller-identity 2. Check IAM Permissions Your IAM user or role must have both bucket-level and object-level permissions. Object-level permissions alone are not sufficient. Attach a policy like this to your IAM user: [S3 setup guide]

{
  "Version": "2012-10-17",
  "Statement": [
    {
      "Effect": "Allow",
      "Action": [
        "s3:GetObject",
        "s3:ListBucket"
      ],
      "Resource": [
        "arn:aws:s3:::{your-bucket-name}/*",
        "arn:aws:s3:::{your-bucket-name}"
      ]
    }
  ]
}

3. Note on IAM Role Authentication • If you are trying to use an IAM Role (Role ARN) instead of an IAM user, be aware that this is not supported on Airbyte OSS. It must be enabled by the Airbyte team and is only available on Airbyte Cloud. [S3 setup guide] • If you are on Airbyte Cloud and want to use an IAM Role, you need to contact the Airbyte Sales team. In summary, for Airbyte OSS, use an IAM User with an Access Key ID and Secret Access Key, and ensure the policy includes both

s3:GetObject

and

s3:ListBucket

permissions on your bucket. 👍 0 button 👎 0 button ℹ️ Tip: Mention @kapa.ai in the thread for follow-ups or DM the app for 1-to-1 help.