DataHub #getting-started

microscopic-tailor-94417

10/10/2022, 1:50 PM

Hello team, Is there column level lineage or a way to see column history in DataHub?

full-chef-85630

10/10/2022, 5:01 PM

Hi all, Upgrade from v0.8.41 to v0.8.45, and build an image through “DOCKER_BUILDKIT=1 docker build --no-cache -t xavier-web -f ./docker/datahub-frontend/Dockerfile .” Only the logo is modified, Exception occurred during deployment

Copy code

UI error:
Validation error (FieldUndefined@[analyticsChart/rows/cells/linkParams/searchParams/filters/value]) : Field 'value' in type 'Filter' is undefined
Validation error (FieldUndefined@[listRecommendations/modules/content/params/searchParams/filters/value]) : Field 'value' in type 'Filter' is undefined (code undefined)

Fornt error:
00:53:21 [application-akka.actor.default-dispatcher-25] ERROR controllers.TrackingController - Failed to emit product analytics event. actor: urn:li:corpuser:datahub, event: {"title":"Conviva Schema Center","url":"<http://xxxx/>","path":"/","hash":"","search":"","width":656,"height":971,"referrer":"<http://xxxx/>","prevPathname":"/login","type":"PageViewEvent","actorUrn":"urn:li:corpuser:datahub","timestamp":1665276799567,"date":"Sun Oct 09 2022 08:53:19 GMT+0800 (中国标准时间)","userAgent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36","browserId":"96726d31-fc24-47fd-98ff-6fa14864c04e"}

salmon-afternoon-92550

10/11/2022, 12:04 AM

Hi! I'm looking to modernize data ingestion, transformation, and metadata management. I'm curious and looking to connect quickly anyone who evaluated or adopted the stack of NiFi (Processing), Airflow (Orchestration), and DataHub (Governance)?

better-orange-49102

10/12/2022, 1:14 AM

is there a way to delete a specific datasetprofile using cli? I'm currently directly deleting from ES, but wanted to see if i missed out anything

ambitious-magazine-36012

10/12/2022, 2:25 AM

Hello 👋, I recently started looking at datahub to solve a use case around tracking external data that we purchase from vendors - there are 3 separate entities - vendors, datasets and topics (we might have additional ones around use cases, requests etc.), has anybody done something similar ?

dazzling-alarm-64985

10/12/2022, 6:18 AM

Hi, is it possible to create an "empty" dataset, and then afterwards use kafka schema-registry ingestion to add a schema to this dataset?

average-dinner-25106

10/12/2022, 9:23 AM

Hello. I found the error while running "datahub docker quickstart" command. As the first image says, pulling images is not done correctly. Therefore, I do "datahub docker check". The message says : "quickstart.sh or dev.sh is not running". How can I solve this problem? For your information, I attached one more figure including datahub/python version.

calm-garage-18868

10/12/2022, 12:46 PM

Hi everyone! Is there a way to query for datasets, that are deprecated? I cannot figure it out, since the

filters

argument in the GraphQL

search

operation requires the

value

to be a string. I had hoped I could do the following:

Copy code

search(input: {
    type:DATASET,
    query:"*",
    start:0,
    count:10,
    filters: [
      {
      	field: "deprecated"
      	value: true
    	}
...

glamorous-football-7431

10/12/2022, 12:51 PM

Hi all! Want to try out Datahub so I am trying to set up the local docker on windows. I have followed the quickstart guide and when it comes time to run the

datahub docker quickstart

command I get the below error.. I ran

docker ps

and my docker instance is running.. Any help would be awesome? 😄

Copy code

Unable to run quickstart:
- Docker doesn't seem to be running. Did you start it?

microscopic-tailor-94417

10/12/2022, 1:25 PM

Hi team, is there a document where I can find different features of Managed DataHub than Self-Managed DataHub?

plus1 2

bland-orange-13353

10/12/2022, 1:25 PM

Acryl Data delivers an easy to consume DataHub platform for the enterprise - sign up here: https://www.acryldata.io/sign-up

bright-motherboard-35257

10/12/2022, 1:55 PM

I already have Kafka, MySQL, and Elasticsearch running for other purposes. Can anyone guide me on how to install Datahub using docker (or otherwise) and have it connect to these existing instances? I tried modding my docker-compose file; but keep running into an issue mentioned here without much success. So, I'm trying another route hoping for assistance.

famous-kite-14798

10/12/2022, 3:06 PM

Hi is Credentials Project ID this one ?

dazzling-alarm-64985

10/12/2022, 4:01 PM

Why cant i see Goverence tab on my datahub?

thankful-kite-1198

10/12/2022, 4:31 PM

hi everyone! can anyone share yml file (example) for glossary load to data hub via cli?

ambitious-flower-8331

10/12/2022, 5:40 PM

Hi everyone, is it possible to retrieve all entities with all aspects from http://localhost:8080 via python? Does DatahubRestEmitter class have any functionality related to this task? thank you

gifted-queen-80042

10/12/2022, 8:08 PM

~~Hello team!~~ ~~I just forked the Datahub repo and I am trying to build the module for metadata ingestion. However I run into the following issue and was wondering if I could get some help getting unblocked.~~

Copy code

> Task :metadata-ingestion:installDev FAILED
:metadata-ingestion:installDev (Thread[Execution worker for ':' Thread 2,5,main]) completed. Took 1 mins 29.42 secs.

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':metadata-ingestion:installDev'.
> Process 'command 'bash'' finished with non-zero exit value 1

The command I run is
./gradlew :metadata-ingestion:installDev --info
_updated_: Resolved the issue by installing cargo.

ambitious-magazine-36012

10/12/2022, 9:34 PM

Is the no-code way to adding entities enabled? Do we have to have a dataset to navigate other entities?

salmon-rose-54694

10/13/2022, 3:44 AM

Is there an airtable integration in datahub?

average-dinner-25106

10/13/2022, 6:58 AM

Hello. I am now observing the ui page of datahub quickstart. I wonder several functions exist in datahub ui (Actually I can't find). 1. Where can user make his/her own query from the table ingested by datahub? Does datahub only provide metadata? Can't we type a query to extract several info or store a query like DBeaver? 2. I want to find the communication or chatting from the table. For example, if companion from other departments see the table 'A' first, he may have a lot of questions from that table. (All of them may not be solved by data lineage, tag, glossary terms.) Then, he wants to leave a comment from that table page. However, I can't find this. Does this function not exist? 3. If the change of tables/columns occurs (adding/deleting new columns, modifying the contents of tables...), can we track this 'change histories' via datahub ui?

microscopic-tailor-94417

10/13/2022, 7:23 AM

Hello Team, I am trying to ingest (UI) metadata from bigquery ad getting error " extra fields not permitted (type=value_error.extra)'.\n". How can we solve this problem?

brave-tomato-16287

10/13/2022, 9:16 AM

Hello all. Is it possible to add UI editable custom properties to the fields, like

max_length

microscopic-tailor-94417

10/13/2022, 3:03 PM

Hi all, can we set the domain name as a parameter in the recipe file we use for ingestion?

calm-student-43079

10/13/2022, 5:21 PM

Hi all, I am planning to deploy the data hub with integrates to HUDI and delta on Azure ADLS Gen2 are there any quick start documentation which can help me for the same?

salmon-jackal-36326

10/13/2022, 6:56 PM

Hello @witty-plumber-82249. Is it possible to login SSO via Azure AD with the containerized application?

brave-farmer-39785

10/13/2022, 11:20 PM

Hi all, has anyone tried "A Custom Metadata Model" gradle project from Github in Windows environment? I have the datahub Quickstart instance deployed to Docker in my Windows laptop and have successfully built the custom metadata model jar and deployed it with the command: "..\gradlew -PprojVersion=0.01 install". I can see that the jar file is under C:\Users\<my name>\.datahub\plugins\models\mycompany-dq-model\0.01. I have restarted everything in Docker. When I tried to see if the model is loaded using "curl -s http://localhost:8080/config" and the model is empty: "{ "models" : { }, ... }". Any help will be appreciated? Thanks!

wonderful-egg-79350

10/14/2022, 4:23 AM

I don't want to distinguish between uppercase and lowercase letters. What should I do?

microscopic-tailor-94417

10/14/2022, 5:33 AM

Hey team, I want use Impact Analysis feature on DataHub, but couldn't find the Impact Analysis button on Lineage tab. How can activate this feature? Is it available in Self-Managed DataHub?

bland-orange-13353

10/14/2022, 5:33 AM

Acryl Data delivers an easy to consume DataHub platform for the enterprise - sign up here: https://www.acryldata.io/sign-up

wonderful-egg-79350

10/14/2022, 7:31 AM

Hello All. Is there a setting function where I can see the entire contents from the beginning? I don't want to press 'read more'