Bruno
12/13/2021, 2:41 PMaws_secret_access_key
Is there anywhere in the docs, or Airbyte's repos, where we could find a list of the hidden (and non-hidden) fields for the different connectors? Finding them out by trial and error, taking into account the vast number of connectors available, is extremely difficult.user
12/13/2021, 4:18 PMairbyte_secret
boolean attribute that will help you identify these fields.Bruno
12/13/2021, 4:20 PMuser
12/13/2021, 5:33 PMuser
12/13/2021, 5:43 PMcurl -X POST "<http://localhost:8000/api/v1/source_definition_specifications/get>" \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-d '{"sourceDefinitionId":"decd338e-5647-4c0b-adf4-da0e75f5a750"}'
user
12/13/2021, 5:44 PM"password": {
"type": "string",
"order": 4,
"title": "Password",
"description": "Password associated with the username.",
"airbyte_secret": true
}
Manav
12/15/2021, 5:28 PMairbyte_secret: true
are only for UI 'hiding'? Doesn't the API hide the information too? In some sources/destinations (like Postgres) we get the '*******' values (as expected for those with airbyte_secret enabled), but others like S3 won't do so.
I've read a bit about Octavia and it looks really promising.user
12/15/2021, 5:31 PMuser
12/15/2021, 8:42 PMairbyte_secret:true
fields should be ********
in the API response? I was about to create an issue in Githubuser
12/16/2021, 2:00 PMuser
12/16/2021, 2:02 PMmaskSecrets
method that need to be improved in this file: airbyte-config/persistence/src/main/java/io/airbyte/config/persistence/split_secrets/JsonSecretsProcessor.java
user
12/16/2021, 2:03 PMuser
12/16/2021, 2:05 PMJsonSecretsProcessor
.
That issue states the following: As of #6114 we will have a more complete template for parsing JsonSchema configs/objects which could likely be adapted.
And that #6114 was merged into 0.29.22-alpha #6450Davin Chia (Airbyte)
"aws_access_key_id": {
"title": "Aws Access Key Id",
"description": "In order to [...],
"airbyte_secret": true,
"type": "string"
}
"aws_secret_access_key": {
"title": "Aws Secret Access Key",
"description": "In order to [...]",
"airbyte_secret": true,
"type": "string"
},
But when retrieving a S3 source from the API, those fields are plain-text 😞provider
property and are non-oneof. The comment about fixing the maskSecrets
was added in the #6114 PR, so it's probably still a todo. @Jared Rhizor (Airbyte) do you confirm? 😄user
12/16/2021, 7:06 PMDavin Chia (Airbyte)