https://datahubproject.io logo
Join Slack
Powered by
I got error when ingest data from UI (<http://loca...
# ingestion
n
I got error when ingest data from UI (http://localhost:9002) while ingest from CLI (datahub ingest -c example/psql.yml) or SDK is successful
b
For ui
n
Tks for your reply. I got same error :(
s
Where is this running? Quickstart or Kubernetes?
n
I use quickstart
s
Can you please post error log again? There might be some difference you might be missing in the stacktrace
n
s
Did you click on the execute button after making the change? You have sent the same URL as earlier https://datahubspace.slack.com/archives/CUMUWQU66/p1655724750054169
You need to run the ingestion again after making the change
Maybe refresh your page and ensure there is another execution
n
When I edit ingestion source, I always click button "Execute". There is only 1 execution running
s
Can you please share screenshot of the list of executions?
Because the one you sent after this change and before this change are exact same URLs. So the logs are of the old run
n
Dashboard:
s
This is the old error log: https://pastebin.com/6ij6xpEc Can you please post the error log of the new run?
n
This is last error log: https://pastecode.io/s/4zfm9s30
s
Copy code
OperationalError: (psycopg2.OperationalError) connection to server at "localhost" (127.0.0.1), port 5432 failed: Connection refused
See this is a different error which is saying connection refused
to postgres
Have you added correct credentials in there?
n
From CLI, I already login. Why error log show "connection refuse" from UI?
b
if you're running in UI, postgres is unlikely to be running in localhost.
n
What should I do to ingest data by UI?
b
im not sure if the command is correct, postgres should be host.docker.internal:5432
rather than localhost:5432
n
I ingest data from postgres. Postgres is not in docker containers of datahub 😄
s
Do you have a postgres on a different machine like a server (or a different machine) and try with the hostname of that database instead? Basically the process is running in a container and it needs to resolve the hostname correctly. That is causing the issue.
n
Is there any way to check datahub UI connect to postgres?
s
Go inside the actions docker container and try to connect from inside that container
DataHub UI based ingestion is trying to connect from inside the actions pod
n
I enter "datahub-action" container. Which command to check?
s
The usual bash commands to connect to postgres
n
Container miss many commands in linux (psql, telnet). Could you show me command to check? Thanks
After change config of postgres, I ingest successfully. Thanks Aseem, xL
s
Can you please share what the change was? It would help the rest of the community too?
n
s
So you created another postgres db. Got it.
n
After, I change line "host_port" from "localhost:5432" to ip of host
4 Views
Open in Slack
PreviousNext
Powered by