numerous-holiday-52504
03/02/2022, 5:31 PMhost_port
piece but I can't figure out what is wrong. Whenever I connect with Python I seem to have to provide azure credentials as part of the connection string.
source:
type: snowflake
config:
host_port: [snowflakeaccount].[azure-region].<http://azure.snowflakecomputing.com|azure.snowflakecomputing.com>
warehouse: *****
username: *****
password: *****
role: ****
sink:
type: datahub-rest
config:
server: '<http://localhost:9002/api/gms>'
few-air-56117
03/02/2022, 6:12 PMnumerous-holiday-52504
03/02/2022, 6:30 PMsource:
type: snowflake
config:
host_port: [snowflakeaccount].[azure-region].<http://azure.snowflakecomputing.com|azure.snowflakecomputing.com>
warehouse: *****
username: *****
password: *****
role: ****
sink:
type: datahub-rest
config:
server: '<http://localhost:8080>'
This failed with a "connection refused" error./little-megabyte-1074
.[azure-region].<http://azure.snowflakecomputing.com|azure.snowflakecomputing.com>
and only pass
host_port: [snowflakeaccount]
little-megabyte-1074
numerous-holiday-52504
03/02/2022, 8:26 PMnumerous-holiday-52504
03/02/2022, 9:02 PMmodern-artist-55754
03/02/2022, 11:01 PM<snowflake_account>.ap-southeast-2
modern-artist-55754
07/04/2022, 3:13 AMdatahub --debug ingest -c <recipe>
to see what sort of details datahub send to the host.gray-river-37120
07/07/2022, 3:00 PM{datahub.entrypoints:165} - snowflake is disabled; try running: pip install 'acryl-datahub[snowflake]'
Trying that install also produces an error. But it seems odd to me that this would be the case when doing it through the datahub UI works up until the authentication (which would imply to me that snowflake
is, in fact, enabled.modern-artist-55754
07/07/2022, 11:41 PMacryl-datahub[snowflake]
python package, it makes sense that it works up till the authentication, because that’s when it try to use the snowflake library. You need to get into the datahub-action pod (if you run k8s) and install the package. I run my own datahub container with all the packages installed