Hi everyone! Can we use environment variables in y...
# ingestion
c
Hi everyone! Can we use environment variables in yaml? I know about datahub.ingestion.run.pipeline but yaml is more preferrable for us
b
Handling sensitive information in recipes We automatically expand environment variables in the config (e.g. `${MSSQL_PASSWORD}`), similar to variable substitution in GNU bash or in docker-compose files. For details, see https://docs.docker.com/compose/compose-file/compose-file-v2/#variable-substitution. This environment variable substitution should be used to mask sensitive information in recipe files. As long as you can get env variables securely to the ingestion process there would not be any need to store sensitive information in recipes.
c
Sounds great, thanks!