Join Slack
Powered by
Hi everyone! Can we use environment variables in y...
# ingestion
c
curved-truck-53235
02/02/2022, 6:56 AM
Hi everyone! Can we use environment variables in yaml? I know about datahub.ingestion.run.pipeline but yaml is more preferrable for us
b
better-orange-49102
02/02/2022, 6:57 AM
Handling sensitive information in recipes
We automatically expand environment variables in the config (e.g.
`${MSSQL_PASSWORD}`), similar to variable substitution in GNU bash or in docker-compose files. For details, see
https://docs.docker.com/compose/compose-file/compose-file-v2/#variable-substitution
. This environment variable substitution should be used to mask sensitive information in recipe files. As long as you can get env variables securely to the ingestion process there would not be any need to store sensitive information in recipes.
c
curved-truck-53235
02/02/2022, 7:18 AM
Sounds great, thanks!
3
Views
Open in Slack
Previous
Next