Airbyte is an open-source data integration engine that helps you consolidate your data in your data warehouses, lakes and databases.

Airbyte

Helm/K8s question: What is the difference between the <https://github.com/airbytehq/airbyte/blob/master/charts/airbyte/values.yaml#L1226|externalDatabase> and the <https://github.com/airbytehq/airbyte/blob/master/charts/airbyte/values.yaml#L18|database> objects in the values?

database used for local db deployment(statefulset) external is used for non local deployment(i.e your own db server)

If you’re deploying for testing purposes or to learn airbyte I recommend using leave database config as is, if prod deploy then set database.enabled to false to disable statefulset from rendering and configure connection in externaldatabase object

is the key `database.enabled` available?? Seems that based on <https://github.com/airbytehq/airbyte/blob/master/charts/airbyte/templates/_helpers.tpl#L117-L127|this> I need to use `postgresql.enabled` to disable the db creation as stateful set.

My bad, this one is used by some subcharts, but afair only when they’re deployed separately from the umbrella(airbyte) chart

If you going to deploy airbyte then use externaldatabase

If only one component(e.g worker then use global.database)

But don’t forget to disable postgres.enabled(set to false)

So to recap postgres.enabled to false (it disables the postgres statefulset) then externalDatabase section setup with my instance configs

If you’re deploying airbyte chart(not airbyte/worker or airbyte/temporal, etc), then use database object
Otherwise use externalDatabase


I’m deploying the airbyte chart to have the all setup, as it is suppose to be a prod env I will use an rds instance as external db.

Still the database object in the main chart is incomplete , as does not let me specify the user/database.

Edit:
I saw that the user can be specified via secrets. But in temporal for example, I don’t find a way to specify the db name.

<@U01MMSDJGC9> turned this thread into Zendesk ticket <https://airbyte7538.zendesk.com/agent/tickets/2675 | 2675> to ensure timely resolution!

<@U03KNEJ44JU> I setup in the end both objects:
• global.database
• externalDatabase
• postgresql.enable to false
Also I used the default values for user and db (airbyte) and it worked

Nice one, sorry that I wasn’t able to respond in time, we had a massive air strike today in my city(which led to outages in whole city area).

I’ll make sure that this process will be simplified and documented when the charts will be prod ready

Thanks for the great question Nicola and Dustin and thanks for the answer Kyryl!

<@U03KNEJ44JU> Thanks for your previous replies, but still not really clear what to use when. Think my  case is similar to Nicola. I'm setting up a production environment on GKE (using the Helm chart) and and external database (Postgres on CloudSQL). What should I configure in values.yaml?

- The global.Database object
*and/or??*
- externalDatabase

_it's clear that I should set postgresql.enable to false._