<@U04SE163WC8> Im trying to install airbyte (Helm ...
# ask-ai
j
@kapa.ai Im trying to install airbyte (Helm chart 0.634.3) on EKS with S3 external storage/logging following the installation guide (https://docs.airbyte.com/deploying-airbyte/integrations/storage) but im getting the following error, any ideas on how to fix this?
Copy code
Deployment.apps "airbyte-worker" is invalid: [spec.template.spec.containers[0].env[42].valueFrom.secretKeyRef.name: Invalid value: "":
u
The error message you're seeing suggests that the
valueFrom.secretKeyRef.name
field in your Kubernetes deployment is invalid. This field is typically used to reference a Kubernetes Secret that stores sensitive data, such as AWS credentials for S3 storage. Based on the [Airbyte documentation](https://docs.airbyte.com/deploying-airbyte/on-kubernetes-via-helm#external-logs-with-s3), you need to add extra environment variables to the
worker
and
server
blocks in your Helm values file. These environment variables reference a Secret named
airbyte-logs-secrets
that should contain your AWS credentials and other S3 configuration details. Here's an example of what the
worker
block might look like:
Copy code
yaml worker:     extraEnv:       - name: AWS_ACCESS_KEY_ID         valueFrom:           secretKeyRef:             name: airbyte-logs-secrets             key: AWS_KEY       - name: AWS_SECRET_ACCESS_KEY         valueFrom:           secretKeyRef:             name: airbyte-logs-secrets             key: AWS_SECRET_KEY       - name: STATE_STORAGE_S3_ACCESS_KEY         valueFrom:           secretKeyRef:             name: airbyte-logs-secrets             key: AWS_KEY       - name: STATE_STORAGE_S3_SECRET_ACCESS_KEY         valueFrom:           secretKeyRef:             name: airbyte-logs-secrets             key: AWS_SECRET_KEY       - name: STATE_STORAGE_S3_BUCKET_NAME         valueFrom:           secretKeyRef:             name: airbyte-logs-secrets             key: S3_LOG_BUCKET       - name: STATE_STORAGE_S3_REGION         valueFrom:           secretKeyRef:             name: airbyte-logs-secrets             key: S3_LOG_BUCKET_REGION
Please ensure that the
airbyte-logs-secrets
Secret exists in your Kubernetes cluster and contains the necessary keys (
AWS_KEY
,
AWS_SECRET_KEY
,
S3_LOG_BUCKET
,
S3_LOG_BUCKET_REGION
). If this Secret doesn't exist or is misconfigured, you'll need to create or update it with the correct data. After updating your Helm values file and ensuring the Secret is correctly configured, you can try to install the Airbyte Helm chart again with the command:
Copy code
bash helm upgrade --install %RELEASE_NAME% airbyte/airbyte -n <NAMESPACE> --values /path/to/values.yaml --version 0.50.13
Please replace
%RELEASE_NAME%
with the release name you want to use,
<NAMESPACE>
with the Kubernetes namespace where you want to install Airbyte, and
/path/to/values.yaml
with the path to your updated Helm values file.