Hello! I am trying to deploy Airbyte using the Hel...
# ask-ai
l
Hello! I am trying to deploy Airbyte using the Helm chart on Kubernetes. I disabled the airbyte/postgres
postgresql.enabled: false
in order to configure my own CloudSQL database, but I am having a hard time understanding the difference between the
global.database
and
externalDatabase
values? Would you have any documentation explaining it ? Thank you by advance and have a nice day !
k
A message from kapa.ai
New message text here
l
It seems
database.enabled
doesn’t exists 😞
a
@kapa.ai I'm trying to deploy entire Airbyte chart and only configuring the
externalDatabase
section. I've marked
database.enabled
to
false
. I'm not providing
global.database
.
Copy code
externalDatabase:
  host: <http://abcd.us-west-2.rds.amazonaws.com|abcd.us-west-2.rds.amazonaws.com>
  existingSecret: airbyte-nonprod-secrets
  existingSecretPasswordKey: DATABASE_PASSWORD
  database: airbyte_db
I see this error while deploying
Copy code
Error: couldn't find key DATABASE_PASSWORD in Secret airbyte-nonprod/airbyte-nonprod-airbyte-secrets
When I also configure
global.database
(same as
externalDatabase
), I'm able to deploy Airbyte successfully. Why can't I deploy without configuring
global.database
?
k
A message from kapa.ai
It seems that you are facing an issue with the secrets configuration when deploying Airbyte using Helm. Based on the information provided in the extracts, you should configure the
global.database
section in your
values.yaml
file when using external DB secrets. Here's the format:
Copy code
yaml global:   database:     secretName: "myOctaviaSecret"     secretValue: "postgresql-password"     host: "<http://example.com|example.com>"     port: "5432"
And then upgrade the chart by running:
Copy code
shell helm upgrade -f path/to/values.yaml %release_name% airbyte/airbyte
(Source: [Slack Support Conversation](https://airbytehq.slack.com/archives/C021JANJ6TY/p1676022958892609)) However, if you still face issues, it's recommended to open a Github issue to report the problem and get further assistance from the Airbyte team.
a
@kapa.ai you mentioned earlier that
global.database
doesn't need to be configured if deploying entire Airbyte chart. Why do I need to define it then?
Copy code
For your use case, since you're deploying the entire Airbyte chart and want to use an external CloudSQL database, you should configure the externalDatabase section in your values.yaml file
k
A message from kapa.ai
Apologies for the confusion earlier. Based on the information provided in the extracts, when deploying the entire Airbyte chart, you should configure the
externalDatabase
section in your
values.yaml
file. Here's the format:
Copy code
yaml externalDatabase:   host: "<http://example.com|example.com>"   user: "db_user"   password: "db_password"   database: "db_name"   port: "5432"
Additionally, set
postgresql.enabled
to `false`:
Copy code
yaml postgresql:   enabled: false
(Source: [Forum Discussion](https://discuss.airbyte.io/t/2914)) However, if you still face issues with the secrets configuration, it's recommended to open a Github issue to report the problem and get further assistance from the Airbyte team.