Gabriel Levine
10/28/2023, 9:27 PM2023-10-28 15:07:09.619 CST
at io.airbyte.config.storage.DefaultGcsClientFactory.validate(DefaultGcsClientFactory.java:32) ~[io.airbyte.airbyte-config-config-models-0.50.33.jar:?]
2023-10-28 15:07:09.619 CST
at io.airbyte.config.storage.DefaultGcsClientFactory.<init>(DefaultGcsClientFactory.java:27) ~[io.airbyte.airbyte-config-config-models-0.50.33.jar:?]
2023-10-28 15:07:09.619 CST
at io.airbyte.workers.storage.GcsDocumentStoreClient.create(GcsDocumentStoreClient.java:34) ~[io.airbyte-airbyte-commons-worker-0.50.33.jar:?]
2023-10-28 15:07:09.619 CST
at io.airbyte.workers.storage.StateClients.create(StateClients.java:33) ~[io.airbyte-airbyte-commons-worker-0.50.33.jar:?]
2023-10-28 15:07:09.619 CST
at io.airbyte.workers.config.ContainerOrchestratorConfigBeanFactory.kubernetesContainerOrchestratorConfig(ContainerOrchestratorConfigBeanFactory.java:91) ~[io.airbyte-airbyte-workers-0.50.33.jar:?]
2023-10-28 15:07:09.619 CST
at io.airbyte.workers.config.$ContainerOrchestratorConfigBeanFactory$KubernetesContainerOrchestratorConfig0$Definition.build(Unknown Source) ~[io.airbyte-airbyte-workers-0.50.33.jar:?]
2023-10-28 15:07:09.619 CST
at io.micronaut.context.DefaultBeanContext.resolveByBeanFactory(DefaultBeanContext.java:2354) ~[micronaut-inject-3.10.1.jar:3.10.
The check indicates that the bucket name is blank. However, I’m supplying it in the relevant section of my values.yml for my Helm deploy:
global:
state:
storage:
type: GCS
logs:
storage:
type: GCS
gcs:
bucket: airbyte-prod-logging
credentialsJson: <credentials>
Here is their reference file for comparison: https://raw.githubusercontent.com/airbytehq/airbyte-platform/0.50.33/charts/airbyte/values.yaml
And I can see that the GCS_LOG_BUCKET variable is appropriately set in my kubernetes config map, which you can see is used to source the variable in worker: https://raw.githubusercontent.com/airbytehq/airbyte-platform/main/charts/airbyte-worker/templates/deployment.yaml.
Here’s a link to the airbyte repo: https://github.com/airbytehq/airbyte-platform/tree/0.50.33kapa.ai
10/28/2023, 9:27 PM