Airbyte is an open-source data integration engine that helps you consolidate your data in your data warehouses, lakes and databases.

Airbyte

Hello, how can specify the credentials json bigquery on octavia-cli ?

Use the <https://github.com/airbytehq/airbyte/tree/master/octavia-cli#secret-management|secrets management feature> :smile: Then add that into your connector config

<@U03U8FSNURX> this is fine for a normal string but not clear with a json file

Hey <@U047CMHLV5Z>, I ran `octavia generate source` for BigQuery and came up with this config:

```sunny@SanahFaCQY6DK7W testing-folder % cat sources/bigquery/configuration.yaml
# Configuration for airbyte/source-bigquery
# Documentation about this connector can be found at <https://docs.airbyte.io/integrations/sources/bigquery>
resource_name: "BigQuery"
definition_type: source
definition_id: bfd1ddf8-ae8a-4620-b1d7-55597d2ba08c
definition_image: airbyte/source-bigquery
definition_version: 0.2.2

# EDIT THE CONFIGURATION BELOW!
configuration:
  dataset_id: # OPTIONAL | string | The dataset ID to search for tables and views. If you are only loading data from one dataset, setting this option could result in much faster schema discovery.
  project_id: # REQUIRED | string | The GCP project ID for the project containing the target BigQuery dataset.
  credentials_json: ${CREDENTIALS_JSON} # SECRET (please store in environment variables) | REQUIRED | string | The contents of your Service Account Key JSON file. See the &lt;a href="<https://docs.airbyte.io/integrations/sources/bigquery#setup-the-bigquery-source-in-airbyte>"&gt;docs&lt;/a&gt; for more information on how to obtain this key.```
It looks like you should be storing the full contents as an environment variable. Can you try that and let me know if it worked?

For example, if you're running locally you can set it in the ~/.octavia file

did you ever figure out how to store a json as an environment variable? I tried minimizing it, adding \\\ before any quotation marks, removing spaces, putting the whole object in double quotations `CREDENTIALS="{\\\"type\\\":\\\"service-account\\\", ...}"` , I tried double escaping new-line characters `\\n`

nothing is working, perhaps it is just a strange combination of these efforts I haven’t tried yet.

I am also facing the same problem here. I have tried all combination of escaping characters where needed, passing as string to the octavia CLI and nothing worked. <@U04K565L3CN> did you happen to find out the solution to this?