Hi, I am currently using datahub quicksight version 0.10.4.0 for my PoC. However, I keep getting the error "Unable to login (invalid/expired credentials or missing permissions)" when trying to ingest Tableau metadata. Is this an expected issue since Tableau Server is an installed version and not cloud? Is there anything else I should be looking at to troubleshoot? Test Condition: - Tableau Server version: 2021.4.5 (20214.22.0314.1536) 64-bit Linux - Enable the Tableau Metadata API - Tableau Credentials (Username/Password or Personal Access Token) - Site Administrator Explorer permission

This message was deleted.

Hi team, I have integrated oidc with my datahub self hosted site. It is working as expected. I want to know where these user details are stored in datahub. Also where I can view these user details from code or db Not from UI?

Hey, on the demo page, we have a HDFS platform. how do we connect HDFS to the datahub, what is the ingestion procedure, someone provide me with the recipe

Hi, we are currently running datahub in our kubernetes cluster and were wondering if it is possible to run gms and the frontend components with multiple replicas?

Hi, is it possible that Datahub Helm Chart contains errors ? If Datahub values metadata_service_authentication is enabled, the datahub-datahub-system-update-job is deployed with env attributes which are relevant for metadata_service_authentication. - name: DATAHUB_SYSTEM_CLIENT_ID value: __datahub_system - name: DATAHUB_SYSTEM_CLIENT_SECRET valueFrom: secretKeyRef: key: system_client_secret name: datahub-auth-secrets the service is deployed and started before secret (datahub-auth-secrets) is created. datahub-datahub-system-update-job use helm hook pre-install, pre-upgrade. Secret datahub-auth-secrets.yaml was defined without helm hook, so will be executed afterwards.

Hi - I am running the datahub quickstart version on my local. The default host name for my localhost is picked as 0.0.0.0 for elasticsearch. How can I change it to 127.0.0.1 in my docker-compose.yml file ?

Hi team, I am interested in re-build datahub components image with Dockerfile in your official github, but it seems those Dockerfile cannot find some .jar or .war file for COPY task, is there any extra step to use those Dockerfile

I am trying to build datahub metadata service image locally using ./gradlew metadata servicewar:build. But getting an error

Task li utilsgenerateDataTemplate FAILED

There are 34 data schema input files. Using input root folder: D:\Nuodata\datahub\li-utils\src\main\pegasus FAILURE: Build failed with an exception. * What went wrong: Execution failed for task 'li utilsgenerateDataTemplate'.

'other' has different root

Can some please help me here?

Hi team, I want to know if we can update the metadata of a business glossary via datahub APIs? I was trying the Python Emitter and it worked well with the the datasets documentation updates, I need to replicate the same in Business Glossary object.

Hello team, our organisation is currently in the process of implementing Datahub as our data-catalog tool. In order to successfully complete our security assessment, we require a recent Soc2/ISO27001 audit report. Would it be possible for anyone of you to kindly guide me in the right direction to obtain this report?

Hi guys. At the moment we are working on few new features in DataHub which will require some changes in UI. So we got a question - is there a design system for DataHub? So we can make UI changes look more organic

Hi, Trying to use APIs in Datahub for the first time. I get the following error on executing the query -

curl -v --user <admin username>:<admin password> --location --request POST 'http://<domain url>/api/graphql' \
--header 'Content-Type: application/json' \
--data-raw '{ "query": "mutation createDomain { createDomain(input: { name: \"lol\", description: \"nothing\" }) }", "variables":{}}'

Can you tell me what I am missing? Error

* Mark bundle as not supporting multiuse
< HTTP/1.1 401 Unauthorized
< Date: Mon, 26 Jun 2023 07:33:08 GMT

Are there any definitions specified on the metrics within the analytics page? We have a few question on them which we can't find answers for. For example are the weekly monthly active users unique? Or will I be counted twice if I for log in on both Monday and Tuesday?

Hello team, I want to ingest csv file to datahub. I was trying to configure the recipe: https://datahubproject.io/docs/generated/ingestion/sources/csv/ Here I want to use the URL of file. So can someone tell what kind of URL? I have 3 csv files

Hi Team, I saw in the Feb 2023 town hall, it shows a really cool and useful feature -- notification, but my setting page don't have that notification tab, anyone know if the feature has been release or not? the values version I use is v0.10.4.

Hi, I am looking to find out how to keep different instances of Datahub in sync (non-prod and prod). We are running two instances of Datahub. The non-prod instance is obviously ahead of the prod instance. However, since the entities and datasets on both the instances are just the same, how can we keep the two in sync? For example, we do not want to be adding description on some table A on the non-prod Datahub and then after 3 months when table A is released in production, go on to manually add the description again on the prod Datahub

Hi Team, I'm looking for some inputs on datahub capabilities to extract and harvest the lineage from Avro nested schema. Airflow will be the orchestrator in this case and I'd like to understand will I be able to extract the table level, column level and computation level granularity from the extracted lineage to establish data observability and traceability ?

I backed up the data before nuke, and then I imported it using the restore command, but datahub's ui didn't see any data,how can i do

Hello Team, can this kafka sink (datahub-kafka) be used without schema_registry_url ? since, in recent datahub versions schema registry was removed.

Hi, I was experimenting with

datahub cli

and wanted to understand if we can create Domains and Tags with it?

Good morning you guys, I am a working student and I'm currently in my first Data Science project. For most of us, its our first 'real' Project, so most of my team lacks experience in some areas. 🙂 We're working with Azure and are storing our data in a Parquet and CSV format. I am tasked with researching and implementing the possibilities of a data catalog and have been recommended the Datahub project. I was wondering if it's possible to integrate datahub into our Pipeline, given our infrastructure. When going through the documentation I sadly couldn't find much about how to work with parquet data or integrating it with Azure. I would be super thankful if anyone could link me a resource for our use case so that I can get started. Thank you very much in advance ! :)

Hi team, Can you tell me what is difference between

type: INTERNAL

and

type:KAFKA

in cp-schema registry and which one to be used under what circumstances?

Hi team, does SSO support CAS?

hi team! How to solve the problem in datahub: elasticsearch unauthorized access vulnerability？

Hi team. I have recently deployed datahub to onsite kubernetes using helm chart and now i would like to try and integrate with AD using custom jaas.conf file. How do i "mount" the custom jaas.conf file to k8s pod deployed using helm? I know i need to setup a volume and volume mount. I just have no idea how.

Hi team, We're currently considering using datahub. I have played with the demo and searched through the docs (mostly the

Dataset

docs) but I can't find much regarding dataset versioning. 1. Is the same dataset mapped across different environments? E.g. if I have a dataset in dev and prod, are they automatically linked? Or are they treated as entirely different datasets because the URN is different? 2. Is there a versioning concept that allows to track datasets across multiple versions? It looks like schema changes are tracked, but can I tag those versions and use those tags to jump back in time to look at the definition of a table? 3. If it is possible to track versions: Is it possible to track a dataset when its table name changed? In major versions we might sometimes rename tables or move them to more fitting schemas. I've read somewhere that only non-breaking changes are supported, would a table rename be considered a breaking change?

when I try ./gradlew quickstart or ./gradlew quickstartDebug thr kafka broker container start faild with : The Cluster ID z2hW0NRNSXG-U5P1ksnw_Q doesn’t match stored clusterId Some(Bptu0FjkQDOQqD85wd8law) in meta.properties. The broker is trying to join the wrong cluster. Configured zookeeper.connect may be wrong. How can I fix this problem.

Hi team, Is there support to create assertions via GraphQL apis? I see that there is a query

assertion(urn: String!)

to fetch existing assertion and a mutation

deleteAssertion(urn: String!)

to delete assertion. But couldn't find a mutation to create a new one. Is it part of some other mutation ? TIA

Hi Maggie, Can we prioritize column level lineage for Snowflake between View to view? This is one of the pain point we have in our organization to use Datahub