Hi, I am trying to assign a domain to several dataset, is It possible to use mutation to assign the domain? As possible input I see nothing about it. Is it correct?

Hello Everyone, is there any detailed guide about how to work with lineage in datahub? In the project (https://datahubproject.io/docs/lineage/sample_code) I can only find a video 101 and sample codes, but there is nothing more specific than that?

Hi folks! Is there an example (a recipe?) to associate a specific value to a glossary term associated to my dataset? — please let me know if this is not the correct channel to ask this

Hi, Is there any example of kafka topics being used to monitor the metadata changes ? https://github.com/datahub-project/datahub/tree/master/metadata-jobs

i happen come across this pic on datahub 2019, why ACL Access is not available now?

Hello everyone, for the listener “datahub.spark.DatahubSparkListener” in spark , RDD does not appear to be supported, unless the Spark SQL engine is used . Is there a solution ?

Hello guys, Is there any feature request that enables table data preview? For my use case, this functionality is mandatory.

Can someone confirm the docker image image: confluentinc/cp-kafka:5.4.0 --- Has log4j Vulnerabilities please ? This is the version that the latest datahub installation uses. I had a previos installation where info sec team in my company raised red flag about log4j vulnerabilities .

how can we addd lineage in our own metadata

Hi how can we access datahub API , does anyone have a postman collection

how to query domain by restful API

Hey guys, I am having trouble creating the lineages. I want to create a lineage between my S3 tables and my Redshift tables which have the same name. Do you guys have an example of how I could do that ? The dataset-dataset lineage example they give on Git is too simple... I can't make it work. Thank you so much!

Hey guys, I am jinay shah and I am having trouble in removing unwanted dataset from my meta data so how can I do that

Hi everyone, I want to deploy datahub as a container on the ECS+fargate. Any documentation/help link for the same would really help. (NOTE: i saw there is one for EKS but that is not an option due to some limitations on the EKS availability at the org)

How do i customize helm chart for datahub ? i am trying to modify kafka pre req image version, where do i need to do?

Hi everyone, if I want to emit the lineage betweent local files by the datahub python client, how can I make a valid urn for the local file path? I use

builder.make_dataset_urn("local", "%2Fmnt%2Ftdr%2F20220422%2Finput%2Fbank%2Fenterprise")

and

builder.make_dataset_urn("local", "/mnt/tdr/20220422/input/bank/enterprise")

but it does not works well .

Hi everyone, I want to push lineages from AWS Airflow (MWAA) to datahub. It has some configure limitations to use recommended way. What the best way to push datasets and datajobs from airflow to datahub without changing lineage backend in airflow?

hi everyone, when I use OIDC authentication but it always redirect to a error Url, http://localhost:9002/authenticate?redirect_uri=%2F

Hi, any idea if these features are made available in the latest helm chart? If not, any tentative timeline? https://datahubspace.slack.com/archives/CUMV92XRQ/p1653505814937089?thread_ts=1653505814.937089&cid=CUMV92XRQ

hello, when I run

helm upgrade --install datahub datahub/datahub --values values.yaml --debug

(following https://datahubproject.io/docs/deploy/kubernetes/). I get

history.go:56: [debug] getting history for release datahub
upgrade.go:142: [debug] preparing upgrade for datahub
upgrade.go:150: [debug] performing update for datahub
upgrade.go:322: [debug] creating upgraded release for datahub
client.go:299: [debug] Starting delete for "datahub-elasticsearch-setup-job" Job
client.go:128: [debug] creating 1 resource(s)
client.go:529: [debug] Watching for changes to Job datahub-elasticsearch-setup-job with timeout of 5m0s
client.go:557: [debug] Add/Modify event for datahub-elasticsearch-setup-job: ADDED
client.go:596: [debug] datahub-elasticsearch-setup-job: Jobs active: 0, jobs failed: 0, jobs succeeded: 0
client.go:557: [debug] Add/Modify event for datahub-elasticsearch-setup-job: MODIFIED
client.go:596: [debug] datahub-elasticsearch-setup-job: Jobs active: 1, jobs failed: 0, jobs succeeded: 0
client.go:557: [debug] Add/Modify event for datahub-elasticsearch-setup-job: MODIFIED
client.go:596: [debug] datahub-elasticsearch-setup-job: Jobs active: 1, jobs failed: 1, jobs succeeded: 0
^CRelease datahub has been cancelled.
upgrade.go:431: [debug] warning: Upgrade "datahub" failed: context canceled
Error: UPGRADE FAILED: context canceled
helm.go:84: [debug] context canceled
UPGRADE FAILED
main.newUpgradeCmd.func2
	<http://helm.sh/helm/v3/cmd/helm/upgrade.go:199|helm.sh/helm/v3/cmd/helm/upgrade.go:199>
<http://github.com/spf13/cobra.(*Command).execute|github.com/spf13/cobra.(*Command).execute>
	<http://github.com/spf13/cobra@v1.3.0/command.go:856|github.com/spf13/cobra@v1.3.0/command.go:856>
<http://github.com/spf13/cobra.(*Command).ExecuteC|github.com/spf13/cobra.(*Command).ExecuteC>
	<http://github.com/spf13/cobra@v1.3.0/command.go:974|github.com/spf13/cobra@v1.3.0/command.go:974>
<http://github.com/spf13/cobra.(*Command).Execute|github.com/spf13/cobra.(*Command).Execute>
	<http://github.com/spf13/cobra@v1.3.0/command.go:902|github.com/spf13/cobra@v1.3.0/command.go:902>
main.main
	<http://helm.sh/helm/v3/cmd/helm/helm.go:83|helm.sh/helm/v3/cmd/helm/helm.go:83>
runtime.main
	runtime/proc.go:250
runtime.goexit
	runtime/asm_amd64.s:1571

It seems like the

datahub-elasticsearch-setup-job

failed. Does anyone know why?

Hello, everyone. :) Do you have any guide for internet-less environment to develop, build and test DataHub? Or could you suggest references related it? Thanks all.

How can i add Contains or Inherits when creating a new Glossary Term in UI? Also how to change properties in UI?

Hi team, I am cloning building datahub https://github.com/datahub-project/datahub.git tag = v0.8.34 in a CentOS7 VM. While building metadata-ingestion, I am getting the following error - ERROR: Failed building wheel for python-ldap

Tried installing "pip install python-ldap" but no use. Python version used = 3.8.12 ... Tried with Python 3.9.6 also, but still no use, same issue. Please help

Hi team, I have a question, DataHub platform is all versión Alpha or Beta, or we have a release GA?

Hello Team, how do I find an existing dataset using URN from Python SDK? Appreciate your help. Thanks!

Hello All, i am trying to deploy datahub on to AWS EKS.. But i want to use our company provided docker images for Kafka and Zookeeper. I see helm charts provided by datahub as part of their repo, but where do we customize and explicitly mention these images ? Any help on this would be greatly appreciated

Hi team, I'm trying to implement Multi-tenancy support into DataHub. for this I have to pass tenant object to each method. Let me know if there is any other good approach to full fill this requirement.

Hi I have a question about making a new entity Browserable.

Hi team, I am running datahub Kubernetes Services(AKS) using Helm chart. I can access the UI but I am not able to ingest the data. How do I find out REST endpoint for ingestion? My gms pod and service are up and running. As per documentation DataHub REST endpoint is http://localhost:8080 but I am running in pod. Any help to debug? Thanks.