Hi team, I found that the lineage is not automatically generated between different sources, such as Snowflake and PowerBI. Do we have any option to create the lineage automatically? Thanks

I am trying to run the Datahub docker quickstart, and upon typing

datahub docker quickstart

in my windows terminal, I get a ton of Docker output that looks like this... It continues to run for a long time - over an hour - and doesn't seem to ever complete. Anyone have any feedback?

Hello Team, I am trying to deploy GMS in our AWS stack for a POC. My setup will have a GMS service configured with MySql and ElasticSearch clusters. Can we deploy GMS without the kafka and broker configuration?

Hello,all, I'm studing datahub now. Do SSO support other oidc product?, such as DingTalk and wechat? I see that the official documents do not mention it (doc mention google,okta,azure...). thank you!

Hello, im trying to figure out if datahub supports to ingest groups when using OIDC against Azure AD, the documentation does not explicity says so but i have some memories that i have read somewhere thats its supported

Hi there! Let's say I have a table A and a table B. Table A is documented but table B is not. If I declare manualy within datahub that the lineage is A -> B, shouldn't B inherit the descriptions of table A in those columns that have in common table A and B?

Hi team, I am creating Data Product entity by CLI:

datahub dataproduct upsert -f data_product.yaml

, but got

Error: No such command 'dataproduct'

, how could I fix this?

Hi #getting-started i am standing up a POC for my team with Datahub. Can anyone tell me if it is bidirectional? We are interested in establishing metadata continuity across all platforms, including back to the warehouse.

Hello, how is this feature going along https://feature-requests.datahubproject.io/p/collaboration-within-datahub-ui?

Hello Team, I am new to Datahub. After I installed the Docker, Python and Datahub. When I try to run the

datahub docker quickstart

command I am getting below error every time. I have tried by rebooting the laptop but still getting same error. I am getting error in broker container or in mysql container or in both. I have installed the below versions: Python 3.11.4 Docker version 24.0.2, build cb74dfc DataHub CLI version: 0.10.3.1 Can someone please help?

Hello! I installed the quickstart docker for Datahub on AWS EC2 Ubuntu instance, and it runs ok. Anyone knows how to make the instance to automatically start Datahub after restarting the instance?

Hello team, thank you for creating this remarkable project. We have been using datahub for the past few weeks and now we are considering taking it to the production. However, prior to proceeding, it is mandatory for us to conduct a security evaluation within our organization. Can someone kindly assist me in identifying the appropriate point of contact who can provide guidance on security matters? Thank you.

Hey, I don't exactly understand the behavior when running the command

datahub docker quickstart

. It is slightly different than running plain

docker-compose.yml

with

docker-compose up

command. I mean with the first process keep restarting until all containers end up healthy, and with the other process ending after one iteration with the message that "dependency failed to start: container broker is unhealthy". How to make them work in a similar way? (I need to change the port for the frontend container to 80, so I need to modify

docker-compose.yml

file.

I tried running datahub using k8s. Followed following steps: helm repo add datahub https://helm.datahubproject.io/ helm install prerequisites datahub/datahub-prerequisites But when I am trying to run below command: helm install prerequisites datahub/datahub-prerequisites --values <<path-to-values-file>> getting an error Error: INSTALLATION FAILED: YAML parse error on datahub/templates/datahub-upgrade/datahub-cleanup-job-template.yml: error converting YAML to JSON: yaml: line 98: did not find expected '-' indicator

Can anyone help me with this?

Hi i have a question, can i get a realtime update from metabase to datahub? Any idea how to do that?

Hi there! I was wondering if there is any plan to support adding documentation to a dataset with the GraphQL API

How can I add a "hello world" dataset to a custom dataplatform? I've managed to add a custom dataplatform, but I can't figure out what to do next. I've tried the CLI approach with file ingestion, but that just fails extremely cryptically and I can't find a simple example anywhere. Spent a lot of time searching through Slack here, as well as github issues and code. Help?

#328 fix: Fixed indentation in datahub-cleanup-job-template.yml - when will be this PR will get merged?

Hi. Looking for Graph QL samples to get the Glossary Term’s properties like Owner Name, Links etc., . Thanks!

Hello! I am working on a PoC for my team, and I was wondering if, apart from all the integrations provided, we could add metadata of some research repositories we have around. For example, stating that repository

dvicente/random-repository

reads from

foo

and

bar

in BigQuery and creates table

result

- it would suffice to include a URL to the repository, or the documentation. Is there a way to do it, or is there a more “correct” way to model such information? Thanks in advance!

I tried running datahub using k8s. Followed following steps: helm repo add datahub https://helm.datahubproject.io/ helm install prerequisites datahub/datahub-prerequisites But when I am trying to run below command: helm install prerequisites datahub/datahub-prerequisites --values <<path-to-values-file>> getting an error Error: INSTALLATION FAILED: YAML parse error on datahub/templates/datahub-upgrade/datahub-cleanup-job-template.yml: error converting YAML to JSON: yaml: line 98: did not find expected '-' indicator Still getting this error?

Hi team, Can someone point me to the github code to the following? - 1. kafka-setup-job 2. elasticsearch-setup-job 3. mysql-setup-job

Hi I am working on a PoC for my team, I need to integrate AD and hive with datahub. Is there any document or steps?

Hey team, just want to confirm if there is any managed version hosts in AWS ap-southeast-2? Thanks

Hi i have a question, can i get a realtime update from metabase to datahub? Any idea how to do that?

Hello, We are looking into adopting DataHub among other alternatives such as OpenMetadata. Does anyone have a link to a good comparison between DataHub and OpenMetadata?

Hi guys, I’m new in datahub and I would like to know the meaning about this message bellow:

Hi I am new in Data hub and i would like to know if there is a possibility to create a metadata dictionary without using a docker or docker compose

Hi, I am trying to setup datahub in GCP by referencing this documentation. However, I get the following error at installing prerequisites

helm install prerequisites datahub/datahub-prerequisites

helm.go:84: [debug] 1 error occurred:
        * admission webhook "<http://gkepolicy.common-webhooks.networking.gke.io|gkepolicy.common-webhooks.networking.gke.io>" denied the request: GKE Warden rejected the request because it violates one or more constraints.
Violations details: {"[denied by autogke-disallow-privilege]":["container configure-sysctl is privileged; not allowed in Autopilot"]}

Can anyone please suggest what the error is and how to fix it? TIA