How can we configure GCS instead of MInio?

To configure Google Cloud Storage (GCS) instead of Minio for your Airbyte deployment, you need to follow these steps: 1. Set up the source in Airbyte UI: - Paste the service account JSON key to

service_account

. - Enter your GCS bucket name to

gcs_bucket

. - Enter the path to your file(s) to

gcs_path

. Source: [Airbyte GCS Source Setup](https://docs.airbyte.com/integrations/sources/gcs) 2. Configure the environment variables for logging: -

GCS_LOG_BUCKET

- Define the GCS bucket to store logs. -

S3_BUCKET

- Define the S3 bucket to store logs (leave empty if not using S3). -

S3_RREGION

- Define the S3 region the S3 log bucket is in (leave empty if not using S3). -

S3_AWS_KEY

- Define the key used to access the S3 log bucket (leave empty if not using S3). -

S3_AWS_SECRET

- Define the secret used to access the S3 log bucket (leave empty if not using S3). -

S3_MINIO_ENDPOINT

- Define the url Minio is hosted at so Airbyte can use Minio to store logs (leave empty if not using Minio). -

S3_PATH_STYLE_ACCESS

- Set to

true

if using Minio to store logs. Empty otherwise. Source: [Airbyte Logging Configuration](https://docs.airbyte.com/operator-guides/configuring-airbyte) 3. If you are using Kubernetes, you can find more information on configuring Kubernetes logging [here](https://docs.airbyte.com/deploying-airbyte/on-kubernetes-via-helm#configure-logs). Please note that Airbyte does not support logging to separate Cloud Storage providers. You can only choose one storage provider for logging. Remember to ensure that your GCS bucket is accessible from the machine running Airbyte. This depends on your networking setup. The easiest way to verify if Airbyte is able to connect to your GCS bucket is via the check connection tool in the UI.

global: database: secretName: "airbyte-1password" secretValue: "DATABASE_PASSWORD" state: storage: type: "GCS" logs: storage: type: "GCS" minio: enabled: false s3: enabled: false bucket: "" bucketRegion: "" gcs: bucket: "nonprod-airbyte-logs" credentials: "/gcs/gcs-credentials.json" minio: enabled: false