Is there any support in Datahub that lets you capture and view the change log. Information like what was changed and who changed it?

Hi everyone, quick question Regarding datahub actions framework Looks, like supported event sources is only for kafka Is this expected or applicable for other souce types (MySQL, postgre...etc) ? Cc @astonishing-answer-96712 @delightful-ram-75848 @billions-baker-82097 @better-orange-49102 @delightful-ram-75848 @hundreds-photographer-13496 @orange-gpu-90973

Hi all, anyone has ever tried sending datahub usage metrics to GoogleAnalytics/Mixpanel using this guide? Need some clue on how to do this. Do I have to learn to rebuild the react web or just change the configuration. https://datahubproject.io/docs/datahub-web-react/src/app/analytics/

Hey everybody, I've just registered and joined the community. Currently, in my company, we are considering the usage of DataHub as our Data Catalog. We are having a lot of geometry columns/tables in our DB. Does DataHub handle correctly these types of columns/tables?

Hi datahub developers I'm facing build issue, could you please help me ? Steps to reproduce: Clone datahub repository Command prompt ./gradlew metadata servicewar:build (Attached screenshos) 🧵 Cc @modern-artist-55754 @astonishing-answer-96712 @delightful-ram-75848 @billions-baker-82097 @better-orange-49102 @delightful-ram-75848 @hundreds-photographer-13496 @orange-gpu-90973

Hello Datahub! Is there a functionality where you can create and manage system users with their own PAT like normal users?

Is it possible to automate ingestion through graphql or OpenAPI?

Where do I find all the fields required for a recipe . I want to know what I can and cannot put in the reporting config

Hi Datahub developers/Devops We are building datahub-gms image using Docker file https://github.com/datahub-project/datahub/blob/master/docker/datahub-gms/Dockerfile We have copy pasted same content of Dockerfile from the above link and facing below issue. Could you please suggest me ? 🧵

Hi folks! Is there a way to enable user requests through the Datahub UI? I mean, the user doesn't have access to edit the description of a table, but he wants to open a request for the Owners to review it. The idea is to send the request to the Owners to review the description of the entity. Another use case for this feature would be to request the owners to insert the descriptions if they don't exist.

Hello, Im new to Datahub wanted to deploy datahub snowflake ingestion inside lambda in AWS but dependencies for snowflake is more than 500 MB , is there other way round to do this?

Hi all, I want to build a slackbot to search datahub using slack, do I use GraphQL API? is GraphQL available in the open source version of datahub?

How do you share assets/entity on datahub, do we share the link or there is share button?

Hi all, does someone know how to get the tags on field with GraphQL api, I tried as below which does not work:

query { dataset(urn:"urnlidataset:(urnlidataPlatform:mysql,dlink.dlink_alert_group.name,PROD)") { tags { tags { tag { urn properties { name description colorHex } } } } } }

Any docs on auto horizontal scaling datahub on kubernetes?

Hi is anyone facing issue like this ... I am using docker way of Installing datahub. Can anyone help me ?

Hi, how is Datahub scheduling ingestion internally? Is this a cron job or something else entirely

Hi all, how can we enable Prometheus monitoring on datahub i already tired to enable in values.yaml

monitoring:
      enablePrometheus: true

Like this but is there any docs that how we can setup whole monitoring process of enabling in datahub

Hello All, How can I get metadata of all the datasets from ingested redshift platform? I've tried with datahub's openAPI to get dataset in which URN of dataset has to pass as param which works as search. But I want to fetch for all the datasets at one time. Also after ingesting metadata from redshift, I am unable to see information for constraints like primary key and foreign key in schema part of dataset. Is there anything specific while ingesting data from redshift? Can anyone suggest anything in this?

Hey very dumb question but what does ‘last observed’ mean?

#advice-metadata-modeling Can anyone guide me on how to make a custom entity? there is no documentation in the datahub for the same. There is documentation for the custom aspect ( https://datahubproject.io/docs/metadata-models-custom/) but there is no similar steps mentioned for the custom entity.

I am building datahub on an ec2 instance. the schema registry keeps error anytime we want to create a container. The error randomly happens with mysql. Is anyone else experiencing this issue? This used to work fine a couple of days ago

Hi! Is there a way to configure the number of MAE and MCE consumers or does it automatically match the number of partitions on the topic?

for the command

python3.9 -m datahub docker quickstart --zk-port 2182 --elastic-port 9201 --mysql-port 3307 --schema-registry-port 8082 --kafka-broker-port 9093  --dump-logs-on-failure

i have noticed that even though i specified the port numbers, the services don't bind to these numbers but to their respective default ports

INFO clientPortAddress is 0.0.0.0:2181 (org.apache.zookeeper.server.quorum.QuorumPeerConfig) 

........

INFO binding to port 0.0.0.0/0.0.0.0:2181 (org.apache.zookeeper.server.NIOServerCnxnFactory)

here i specified the --zk-port 2182 but it keeps binding to 2181, hence it fails since zookeeper is already running for me in my hadoop node. After a error flashes with the zookeeper container, the process keeps on running indefinitely, it does not fail, nor does it keeps me cancel it via CNTRL + C, also no logs are generated (using the last parameter i passed to the command) because the process never gets failed. i always have to force remove it via the kill -9 process_id command. Similiar case happens with my Mysql and sometimes with broker containers too. Also i tried removing the docker images and containers but it didn't help much. If anyone have ever faced similiar issues, please do help

Is there any resource/tutorial for provisioning datahub in AWS using terraform?

Hi, I have DataHub on a Linux VM and managed to get the frontend, when I have tried to run a dbt ingestion I am recieving the below error

Have tried giving permission to the folder but an struggling to get past this permission issue if anyone could help please

Hi team, Can you tell me how to view audit trail of activities in Datahub? Is it possible to view it through logs or any other method?