Hi I want to upgrade to airbyte version 2.0.0 but ...
# ask-community-for-troubleshooting
j
Hi I want to upgrade to airbyte version 2.0.0 but still using helm v1. So the chart version pointing to
version          = "1.8.5"
Then in values.yaml, should I change the global.version to "2.0.0" and also put the image name and tag in global.image.tag? I dont want to change to helm v2 because it will required some effort, and if I force it it will give error like
Copy code
Message: Could not resolve placeholder ${AIRBYTE_URL}
Copy code
Message: Could not resolve placeholder ${STORAGE_BUCKET_AUDIT_LOGGING}
k
Based on the knowledge sources, I need to inform you that Airbyte version 2.0.0 is the final version that supports Helm chart V1. According to the [release notes](https://docs.airbyte.com/release_notes/v-2.0#final-version-with-helm-chart-v1-support): > Version 2.0 is the final version of Airbyte that supports Helm chart V1. In versions 2.1 and later, Airbyte will only support Helm Chart V2. To answer your specific question about upgrading to version 2.0.0 with Helm V1: Yes, you can upgrade to Airbyte 2.0.0 while still using Helm chart V1 (version 1.8.5). To do this: 1. Keep your Helm chart version at
1.8.5
2. Update
global.version
to
"2.0.0"
in your values.yaml 3. Set
global.image.tag
to
"2.0.0"
as well This approach should work for version 2.0.0 specifically, as it's the last version with Helm V1 support. However, I must emphasize that this is only a temporary solution. The documentation strongly encourages migrating to Helm chart V2 as soon as practical, as you won't be able to upgrade beyond version 2.0.0 without it. The errors you're seeing (
${AIRBYTE_URL}
and
${STORAGE_BUCKET_AUDIT_LOGGING}
placeholders) are related to the configuration changes in Helm V2, which uses a different structure for the values.yaml file. For future upgrades beyond 2.0.0, you will need to migrate to Helm chart V2. The [migration guide for Core](https://docs.airbyte.com/platform/deploying-airbyte/chart-v2-community) provides detailed instructions on how to update your values.yaml file to the new format.
j
@kapa.ai how about global.image.registry"? Can I leave that blank?
k
A message from kapa.ai
Based on the knowledge sources, yes, you can leave
global.image.registry
blank
if you want to use Airbyte's default public Docker repository. According to the [custom image registry documentation](https://docs.airbyte.com/platform/1.8/deploying-airbyte/integrations/custom-image-registries#step-1-customize-airbyte-to-use-your-image-registry), the
global.image.registry
configuration is only needed when you want to pull images from a custom image registry rather than Airbyte's public Docker repository. The documentation shows that to use a custom registry, you would add:
Copy code
yaml global:   image:     registry: <http://ghcr.io/NAMESPACE|ghcr.io/NAMESPACE>
If you don't specify this configuration (or leave it blank), Airbyte will default to pulling images from [Airbyte's public Docker repository](https://hub.docker.com/u/airbyte), which is the standard behavior. So for your Helm V1 upgrade to version 2.0.0, you only need to set: -
global.version: "2.0.0"
-
global.image.tag: "2.0.0"
And you can omit or leave
global.image.registry
blank to use the default public registry.
j
@kapa.ai Now it has different error "Error: couldn't find key CONNECTOR_REGISTRY_SEED_PROVIDER in ConfigMap airbyte/airbyte-airbyte-env". I didnt get this error previously, only after updating the airbyte version. How to solve this
k
A message from kapa.ai
Based on the knowledge sources, this error is a known issue that occurs when upgrading Airbyte versions with Helm charts. The error
couldn't find key CONNECTOR_REGISTRY_SEED_PROVIDER in ConfigMap
indicates that a required configuration key is missing from the ConfigMap. This is similar to other ConfigMap key issues documented in the knowledge sources, such as the [
JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_SECRET
issue](https://github.com/airbytehq/airbyte/issues/52034) and the [
JOB_KUBE_CONNECTOR_IMAGE_REGISTRY
issue](https://github.com/airbytehq/airbyte/issues/53215) that occurred in earlier version upgrades. ## Solution To resolve this issue, you need to explicitly add the
CONNECTOR_REGISTRY_SEED_PROVIDER
configuration to your values.yaml file. Based on the [environment variable list](https://github.com/airbytehq/airbyte/issues/65129), this variable should be included in the ConfigMap. Add the following to your values.yaml under the appropriate section (likely under
env_vars
or similar, depending on your Helm V1 configuration):
Copy code
yaml env_vars:   CONNECTOR_REGISTRY_SEED_PROVIDER: "cloud"  # or your preferred value
The typical value for
CONNECTOR_REGISTRY_SEED_PROVIDER
is
"cloud"
for standard deployments, which tells Airbyte to use the cloud-based connector registry. Important note: This type of issue highlights why Airbyte is moving to Helm chart V2. As mentioned in the [Helm V2 upgrade documentation](https://docs.airbyte.com/platform/deploying-airbyte/chart-v2-community): > The new Helm chart has broader and more detailed options to customize your deployment. In most cases, it's no longer necessary to specify environment variables in your
values.yaml
file because the chart offers a more detailed interface for customization. Since you're on version 2.0.0 (the last version supporting Helm V1), you may encounter more of these missing key issues. I strongly recommend planning your migration to Helm chart V2 soon to avoid these configuration problems in future upgrades.
j
@kapa.ai Ok. Upgrading to helm v2 tutorial mentioned about using new namespace airbyte-v2. But if we still not utilizing airbyte heavily, is it okay to upgrade to helm v2 with using the "airbyte" namespace?
k
A message from kapa.ai
Based on the knowledge sources, yes, you can upgrade to Helm chart V2 using your existing "airbyte" namespace instead of creating a new "airbyte-v2" namespace. The documentation explicitly addresses this scenario. According to the [Helm V2 upgrade guide](https://docs.airbyte.com/platform/deploying-airbyte/chart-v2-community#how-to-upgrade), the recommendation to use a new namespace depends on whether you're using an external database: ## If you're using Airbyte's internal Postgres database: The documentation states: > If you're not using an external database, skip this step. At deployment time, you will reinstall Airbyte in your existing namespace. In this case, you would: 1. Uninstall Airbyte from your existing namespace (but do not delete the namespace) 2. Reinstall Airbyte with Helm V2 into the same namespace The [deployment instructions](https://docs.airbyte.com/platform/deploying-airbyte/chart-v2-community#deploy-airbyte) show this approach:
Copy code
bash # Uninstall from existing namespace helm uninstall airbyte -n airbyte  # Reinstall with Helm V2 in the same namespace helm install airbyte airbyte-v2/airbyte \   --namespace airbyte \          # Same namespace as before   --values ./values.yaml \   --version 2.0.3 \   --set global.image.tag=1.7.0
## If you're using an external database: The documentation recommends using a new namespace to make troubleshooting easier, but it's not strictly required. The guide states: > It is possible to do a straight upgrade, but different Airbyte users have different and sometimes complex configurations that could produce unique and unexpected situations during the upgrade. By doing a fresh install, you create a separate environment that's easier to troubleshoot. Since you mentioned you're not utilizing Airbyte heavily, using your existing "airbyte" namespace should be fine, especially if you're using the internal database. Just make sure to backup your database first before proceeding with the upgrade.
j
@kapa.ai Im still insisting to use chart 1.8.5 and airbyte 2.0.0. Now it has this error
Copy code
Message: Could not resolve placeholder ${AIRBYTE_URL}
Message: Could not resolve placeholder ${STORAGE_BUCKET_AUDIT_LOGGING}
Message: Could not resolve placeholder ${STORAGE_BUCKET_AUDIT_LOGGING}
What are the values for these variables if I deploy community version, and only accesisble using cluster IP
k
A message from kapa.ai
Based on the knowledge sources, these errors are occurring because you're trying to use Airbyte 2.0.0 with Helm chart V1 (1.8.5), and certain environment variables that are expected in version 2.0.0 are not being set properly in your Helm V1 configuration. Here are the values you need to add to your
values.yaml
file for a community version deployment accessible only via cluster IP: ## Required Environment Variables Add these to your
values.yaml
under the
env_vars
section:
Copy code
yaml env_vars:   AIRBYTE_URL: "<http://airbyte-airbyte-server-svc:8001>"  # Internal cluster service URL   STORAGE_BUCKET_AUDIT_LOGGING: ""  # Can be empty for community version
### Explanation: 1.
AIRBYTE_URL
: For cluster IP access only, this should point to your internal Kubernetes service. The default service name format is
airbyte-airbyte-server-svc
on port
8001
. If you're only accessing Airbyte within the cluster, this internal service URL is sufficient. 2.
STORAGE_BUCKET_AUDIT_LOGGING
: According to the [GitHub issue discussion](https://github.com/airbytehq/airbyte/issues/68136), users have successfully resolved this error by setting this variable. For the community version without audit logging enabled, you can either: - Set it to an empty string:
""
- Set it to your existing storage bucket if you're using external storage (e.g.,
"my-bucket"
or
"my-bucket/audit-logging"
) As one user in the [GitHub issue](https://github.com/airbytehq/airbyte/issues/68136) mentioned: > I solved this problem today! [...] I included the variable at the global level: >
Copy code
yaml > global: >   env_vars: >     STORAGE_BUCKET_AUDIT_LOGGING: "my-bucket/audit-logging" >
Important: These workarounds are necessary because Helm chart V1 wasn't designed for Airbyte 2.0.0's configuration requirements. As I mentioned earlier, version 2.0.0 is the final version supporting Helm V1, and you're encountering these issues because the configuration structure has evolved. I strongly recommend planning your migration to Helm chart V2 to avoid these compatibility issues.