João Pedro Gianfaldoni de Andrade
09/23/2024, 7:37 PMDeployment.apps "airbyte-worker" is invalid: [spec.template.spec.containers[0].env[42].valueFrom.secretKeyRef.name: Invalid value: "":
user
09/23/2024, 7:38 PMvalueFrom.secretKeyRef.name
field in your Kubernetes deployment is invalid. This field is typically used to reference a Kubernetes Secret that stores sensitive data, such as AWS credentials for S3 storage. Based on the [Airbyte documentation](https://docs.airbyte.com/deploying-airbyte/on-kubernetes-via-helm#external-logs-with-s3), you need to add extra environment variables to the worker
and server
blocks in your Helm values file. These environment variables reference a Secret named airbyte-logs-secrets
that should contain your AWS credentials and other S3 configuration details. Here's an example of what the worker
block might look like: yaml worker: extraEnv: - name: AWS_ACCESS_KEY_ID valueFrom: secretKeyRef: name: airbyte-logs-secrets key: AWS_KEY - name: AWS_SECRET_ACCESS_KEY valueFrom: secretKeyRef: name: airbyte-logs-secrets key: AWS_SECRET_KEY - name: STATE_STORAGE_S3_ACCESS_KEY valueFrom: secretKeyRef: name: airbyte-logs-secrets key: AWS_KEY - name: STATE_STORAGE_S3_SECRET_ACCESS_KEY valueFrom: secretKeyRef: name: airbyte-logs-secrets key: AWS_SECRET_KEY - name: STATE_STORAGE_S3_BUCKET_NAME valueFrom: secretKeyRef: name: airbyte-logs-secrets key: S3_LOG_BUCKET - name: STATE_STORAGE_S3_REGION valueFrom: secretKeyRef: name: airbyte-logs-secrets key: S3_LOG_BUCKET_REGION
Please ensure that the airbyte-logs-secrets
Secret exists in your Kubernetes cluster and contains the necessary keys (AWS_KEY
, AWS_SECRET_KEY
, S3_LOG_BUCKET
, S3_LOG_BUCKET_REGION
). If this Secret doesn't exist or is misconfigured, you'll need to create or update it with the correct data. After updating your Helm values file and ensuring the Secret is correctly configured, you can try to install the Airbyte Helm chart again with the command: bash helm upgrade --install %RELEASE_NAME% airbyte/airbyte -n <NAMESPACE> --values /path/to/values.yaml --version 0.50.13
Please replace %RELEASE_NAME%
with the release name you want to use, <NAMESPACE>
with the Kubernetes namespace where you want to install Airbyte, and /path/to/values.yaml
with the path to your updated Helm values file.