@kapa.ai I'm using Airbyte Cloud. Is it possible to set up an S3 bucket as a source and authenticate using an IAM role with the AWS role ARN?

Thinking completed Yes, it is possible to authenticate an S3 bucket source in Airbyte Cloud using an IAM Role and AWS Role ARN [S3 Source Setup]. However, please note that IAM role authentication must be enabled by a member of the Airbyte team before you can use it [S3 Source Setup]. If you wish to use this feature, you will need to contact the Airbyte Sales team to have it activated [S3 Source Setup]. Once enabled, you set it up through the following process: 1. Create a Policy in AWS IAM Create an IAM policy that provides read and list access to your bucket:

{
  "Version": "2012-10-17",
  "Statement": [
    {
      "Effect": "Allow",
      "Action": [
        "s3:GetObject",
        "s3:ListBucket"
      ],
      "Resource": [
        "arn:aws:s3:::{your-bucket-name}/*",
        "arn:aws:s3:::{your-bucket-name}"
      ]
    }
  ]
}

(Both object-level and bucket-level permissions are required [S3 Source Setup].) 2. Create the IAM Role 1. In the AWS IAM dashboard, navigate to Roles > Create role and choose the AWS account trusted entity type [S3 Source Setup]. 2. Set up the trust relationship to allow Airbyte Cloud to assume the role. You must supply your Airbyte Workspace ID (found in your Airbyte Cloud workspace URL) as the

sts:ExternalId

to prevent the confused deputy problem:

{
  "Version": "2012-10-17",
  "Statement": [
    {
      "Effect": "Allow",
      "Principal": {
        "AWS": "arn:aws:iam::094410056844:user/delegated_access_user"
      },
      "Action": "sts:AssumeRole",
      "Condition": {
        "StringEquals": {
          "sts:ExternalId": "{your-airbyte-workspace-id}"
        }
      }
    }
  ]
}

3. Attach the policy you created in step 1 to this role and copy the Role ARN [S3 Source Setup]. 3. Configure in Airbyte Cloud When adding the S3 source connector in Airbyte Cloud, configure your stream and bucket details, and enter your copied ARN into the AWS Role ARN field [S3 Source Setup]. 👍 0 button 👎 0 button ℹ️ Tip: Mention @kapa.ai in the thread for follow-ups or DM the app for 1-to-1 help.