Hi guys can you pls send me working config example...
# ingestion
f
Hi guys can you pls send me working config example for snowflake ingestion, I did everything but still getting an error faild to execute datahub ingest
d
What is the error you get and how your config looks like?
f
Here is the error "ConnectionError: HTTPConnectionPool(host='localhost', port=8080): Max retries exceeded with url: /config (Caused by " "NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f228783c640>: Failed to establish a new connection: [Errno 111] " "Connection refused'))\n", "2022-03-25 102204.861241 [exec_id=acc7f1e9-6b4c-4ee8-bb27-4e13232dafa3] INFO: Failed to execute 'datahub ingest'", '2022-03-25 102204.862570 [exec_id=acc7f1e9-6b4c-4ee8-bb27-4e13232dafa3] INFO: Caught exception EXECUTING
d
Do you run ingestion from the command line with
datahub ingest
or using managed ingestion? This seems like it can’t communicate with the gms server
Which should run locally from docker if you use the quickstart
f
And here is the config source: type: snowflake config: host_port: -----.eu-west-1.snowflakecomputing.com warehouse: COMPUTE_WH username: --- password: ---- role: accountadmin sink: type: datahub-rest config: server: 'http://localhost:8080'
I am running from UI, but the thing is that gms server is up and running
d
ahh, ok, if you run from the ui then the sink should be the following:
Copy code
sink:
    type: datahub-rest
    config:
        server: '<http://datahub-gms:8080>'
f
@dazzling-judge-80093 oh I see, probably it works cause now I got other error which is account must be specified but I am not sure what it means, which account ?:)
m
@few-grass-66826 host_port: is actually the account, for us we only use the string up to aws region, i.e. remove
<http://snowflakecomputing.com|snowflakecomputing.com>
f
Thank you very much guys 🙏