https://datahubproject.io logo
Title
l

lemon-scooter-69730

05/25/2023, 11:04 AM
We are trying to deploy an ingest cron and this is our values for envFromSecrets Here are our assumptions:
envFromSecrets:
  BIGQUERY_PRIVATE_KEY: <--- environment variable
    key: some-privatekey <-- the key in the k8s-secret data file
    secret: k8s-secret <--- the name of the k8s-secret
  BIGQUERY_PRIVATE_KEY_ID:
    key: ...
    secret: k8s-secret
We also use a configmap for the recipe where we then specify
source:
      type: bigquery
      config:
          include_table_lineage: true
          include_usage_statistics: true
          include_tables: true
          include_views: true
          profiling:
              enabled: true
              profile_table_level_only: false
          stateful_ingestion:
              enabled: true
          credential:
              project_id: project_id
              private_key: ${BIGQUERY_PRIVATE_KEY}
              private_key_id: ${BIGQUERY_PRIVATE_KEY_ID}
              ...
When the pod runs we get
UnboundVariable: 'BIGQUERY_PRIVATE_KEY: unbound variable'
Can someone who knows more about this than myself advice or if you have set something like this up before any advice is welcome
a

astonishing-answer-96712

05/31/2023, 9:34 PM
Hi, what version of DH are you? Could you confirm that the key itself still exists and wasn’t somehow wiped?
@orange-night-91387 may be able to give you some additional help here though!
l

lemon-scooter-69730

06/01/2023, 11:03 AM
Hi I found what the issue was The envFromSecrets did not have the right indentation so it got ignored