I keep getting this error -

I ran 'pip install 'acryl-datahub[mysql]'' successsfully. but still I am getting the above error.

Hi Team ,

does this need to be

dbo.Base_Data

for Great Expectation validations to work? Will greatly appreciate any help on this!

Hello all! @hundreds-photographer-13496 was able to pin point the issue that was causing Great Expectations assertions to not link with DataHub. It seems it was do with how I was ingesting from MSSQL source. In my recipe, I did not specify a

database

and hence the urn generated was not the same as the one from GE. urn in DataHub

… dbo.table_name …

urn from GE assertion

… database_name.dbo.table_name …

not specifying a

database

allowed me to ingest ALL tables from my MSSQL source. Current behaviour - when database is included in recipe - only one database is ingested, database name is included in dataset urn when database is not included in recipe - all databases are ingested, but database name is not included in dataset urn Expect behaviour - ingest all tables with correct urn PS: is creating a separate recipe for each database the correct way to ingest?

Is it possible to ingest data sources from azure or other clouds to datahub ?

Is there an feature that allows us to set a header to bypass some authentication we have setup on our edge? We use cloudflares zero trust and need to define a header to get around sso

Any one face this issue:2022/05/31 074139 Connected to tcp://mysql:3306 2022/05/31 074139 Connected to tcp://broker:29092 2022/05/31 074209 Problem with request: Get "http://elasticsearch:9200": proxyconnect tcp: dial tcp 116.62.81.17380 i/o timeout. Sleeping 1s 2022/05/31 074209 Problem with request: Get "http://neo4j:7474": proxyconnect tcp: dial tcp 116.62.81.17380 i/o timeout. Sleeping 1s 2022/05/31 074240 Problem with request: Get "http://neo4j:7474": proxyconnect tcp: dial tcp 116.62.81.17380 i/o timeout. Sleeping 1s 2022/05/31 074240 Problem with request: Get "http://elasticsearch:9200": proxyconnect tcp: dial tcp 116.62.81.17380 i/o timeout. Sleeping 1s

I don'n know why go to 116.62.81.173:80

Neo4j is up

image.png

bump^

Hi team! I'm trying to use UI Ingestion from Glue, but doens't work. When I execute I don't receive any message, but doens't work. Attached image of recipe config. It's wrong? I glad if someone help me.

Hello. I try use datahub for discovery platform. Could you please help me to answer questions? I want to integrate kafka stream in datahub. But, I can’t find kafka streams metadata integration. Then, I crate custom data platform of ‘kafka-streams’ (reference this guide - https://datahubproject.io/docs/how/add-custom-data-platform) How can I add custom dataset using rest api OR datahub cli recipes? Can not find reference. Could you help on this?

image.png,image.png

@big-carpet-38439

KILL

signals are being generated for the

dataHubExecutionRequestSignal

aspect but the process doesn't respond looks like... Alternative i found was to delete the whole ingestion job and create it again, let me know if there is a better approach?

IMG_20220610_205112.jpg

image.png

hello ereyone,A magical thing happened. The following command was executed successfully

python3 -m datahub ingest -c oracle_recipe.yaml

The UI always fails, and the Oracle client is also installed,Thanks in advance for your help!

python3 -m pip install cx_Oracle --upgrade

python3 -m pip install cx_Oracle --upgrade --user

Hello, We deployed our datahub project via quickstart script, and our manager ask us if the mysql can be replace with our company's mssql or oracle? (The red line), Thanks for the help!

image.png

This is my code:

@mammoth-bear-12532 is there anything else you can suggest I check on my side?

Bump

ohoh, my datahub-gms is down

Hello While profiling a hive table the datahub job fails with out of memory error. What could be the cause and what can be done to reduce the memory footprint?

Any help with this?