Hi Team Going For Production using Airbyte Facing problem in Airbyte #ask-ai

Hi Team, Going For Production using Airbyte Facing...

Rishikesh Srinivas

05/16/2023, 8:51 AM

Hi Team, Going For Production using Airbyte Facing problem in Audit since airbyte-db is not encrypted im using external postgres db i have deployed using kube and helm Please Help me on this , is there any setting in airbyte where it can be enabled for encryption any workaround is appreciated. Thanks, Rishikesh

kapa.ai

05/16/2023, 8:51 AM

A message from kapa.ai

kapa.ai

05/16/2023, 8:53 AM

Hi Rishikesh, To enable encryption for your external Postgres database when using Airbyte with Kubernetes and Helm, you can follow these steps: 1. Make sure your external Postgres database is encrypted. For example, if you're using AWS RDS, you can enable encryption using the AWS RDS specific encryption with the AES-256 encryption algorithm. [Source: Slack](https://airbytehq.slack.com/archives/C021JANJ6TY/p1656940950468159) 2. Configure Airbyte to connect to your encrypted external Postgres database by editing the environment variables in your Kubernetes configuration. Set the

DATABASE_URL

and

CONFIG_DATABASE_URL

(if you have a separate config database) to include the correct host, port, and database, along with any extra parameters required for SSL encryption. For example:

Copy code

DATABASE_URL=jdbc:postgresql://<host>:<port>/<database>?ssl=true&sslmode=require CONFIG_DATABASE_URL=jdbc:postgresql://<host>:<port>/<database>?ssl=true&sslmode=require

[Source: Configuring Airbyte Database](https://docs.airbyte.com/operator-guides/configuring-airbyte-db) 3. When setting up the Postgres source in Airbyte, make sure to select the appropriate SSL mode for encrypted communication between Airbyte and the source. You can choose from options like

require

verify-ca

, or

verify-full

. [Source: Postgres Source Setup](https://docs.airbyte.com/integrations/sources/postgres) Please note that some of the information provided is from Slack conversations and might not be officially documented. However, these steps should help you enable encryption for your external Postgres database when using Airbyte with Kubernetes and Helm. If you need further assistance, feel free to ask. Thanks, kapa.ai

Rishikesh Srinivas

05/16/2023, 12:03 PM

myy question was about airbyte-db encrpytion

Ramkumar Vaidyanathan

05/16/2023, 10:39 PM

@Rishikesh Srinivas let me know if you found out how to do this? I am also trying to see how I can point airbyte to my own RDS instance

Rishikesh Srinivas

05/25/2023, 8:01 AM

@Ramkumar Vaidyanathan Just coment out the database section from values.yaml in the global section just pass the rds postgres values you will be able to connect. Use ACRA Server which sits as sql proxy between the airbyte external db and airbyte application which will solve the encrpytion part

Rishikesh Srinivas

05/25/2023, 8:04 AM

@Ramkumar Vaidyanathan database: DATABASE_PASSWORD: "" DATABASE_USER: "" host: "" port: "" use this part in values.yaml

Ramkumar Vaidyanathan

05/25/2023, 8:13 PM

cool got it to working.. actually there is a much easier way

Copy code

global:
  database:
    host: <your db host>
    user: <db user>
    secretName: database
    secretValue: password
    database: airbyte
    port: 5432
postgresql:
  enabled: false
externalDatabase:
  host: <your db host>
  user: <db user>
  existingSecret: database
  existingSecretPasswordKey: password
  database: airbyte
  port: 5432

And used it in my helm chart.

Ramkumar Vaidyanathan

05/25/2023, 8:13 PM

@Rishikesh Srinivas ^^

Open in Slack

Previous Next