I have a some question for user and group authenticatetion I user a SSO with google login but i want to know 1.Can we scope some user for login such as my org have 5 people (a,b,c,d,e) but i want a and b to login c,d,e shouldn’t use datahub 2.Can we auto set group to a,b with a reader at first time login (Group not role)

Hi

if I may know like we extract entity from DataHub. is there a way to grab pushed values into the validation tab

Hi! I am looking into the data hub's action framework and wondering if anyone has come across the action framework's UI part. Is there any place where the actions that we run are logged, or any way to monitor the success or failure rates using the UI or API?

We love the lineage feature of DataHub! One thing my team is confused about is how the Compress Lineage checkbox works! Specifically, we’d like for the Uncompress action to showcase more of the lineage if the user chooses. We have some lineage graphs with 15-20 nodes and we want it to shine visually ⭐ What are we missing? Is this a bug, something we can contribute to, or a setting we’re missing? 🤔

Hey all, we’re trying to associate datasets with our

mlModel

- according to the docs, we’ve updated

mlModelEvaluationData

, we’ve updated it with this metadata

{
  "evaluationData": [
    {
      "dataset": "urn:li:dataset:(urn:li:dataPlatform:delta-lake,general_test.dim_calender_spark,DEV)"
    }
  ]
}

and it does being returned by

datahub get --urn 'urn...'

:

"mlModelEvaluationData": {
    "evaluationData": [
      {
        "dataset": "urn:li:dataset:(urn:li:dataPlatform:delta-lake,general_test.dim_calender_spark,DEV)"
      }
    ]
  }

but I can’t find no representation for this in the UI, not under lineage or any of the other tabs, am I missing something?

Good morning all, I'm facing an issue with the display of tables in the datahub homepage since we updated to the datahub newest version. We are ingesting BigQuery tables. We have 589 BigQuery datasets ingested but then when we navigate through the dataset object in the homapage, the view is filtered with only part of datasets (116). Can someone help me with this ? We are not using datahub views and here is the bigquery recipe :

source:
    type: bigquery
    config:
        include_table_lineage: true
        include_usage_statistics: true
        include_tables: true
        include_views: true
        profiling:
            enabled: true
            profile_table_level_only: false
        stateful_ingestion:
            enabled: true
        credential:
            project_id: '${projectid}'
            client_id: '${clientid}'
            private_key: '${privatekey}'
            private_key_id: '${privatekeyid}'
            client_email: '${clientemail}'

Hi! I am trying to add ownership information to datasets in DataHub through GraphQL API. We have datasets created through regular ingestion(recipe) pipelines. But we do(can) not have all the users in the organisation to log onto DataHub in order to populate the user info in DataHub. So we thought of pre-populating DataHub with potential `corpUser`s so that we can run

addOwners

mutation to assign ownership info to the datasets. What is the recommended way to ingest user info into DataHub?

Hello, team! I wonder, if it's possible to hide some datasets from getting shown up in the search results for a particular user groups? I have some datasets which contain private information and I want to keep their structure in secret from people who's not responsible for these assets.

X-post. https://datahubspace.slack.com/archives/C029A3M079U/p1680165992042219. (Sorry for the spam but I am not sure what was the best channel)

Hello all, I hope your doing all well. We’re trying to show more “Sample Values” in the Stats of Datasets. It’s only printed 3 rows of top of query limit. I’ve adjusted configuration of field sample values limit in Profiling option when ingested data from source. But it’s not changed in UI. We just wanna print more rows of sample values on web UI. Is there option or configuration for that on UI? Or Is that need to modify to source code? Please shot any advise or clue on me. Thanks ya!

Hello, I watched the sneak peek of the new search filters. I was wondering since you started adding advanced search, if you would make it possible to find elements without any tags or owners etc? Is that something that is planned or is already coming? https://datahubspace.slack.com/archives/CV2UXSE9L/p1661521443604199

Hi everyone. We're making a poc of datahub and we already know we'll have to add some sections and customize some parts of UI to satisfy business requests. I've came across the page which helps in the decision of choosing whether to fork the project or not. But before going straight in choosing the fork way I was wondering if someone has integrated any customization by using a federated micro-frontend approach. Has anyone tried it? Thanks in advance! 🙂

reposting this question from several months ago, is externalUrl for assertions live? @plain-gpu-59850 did you ever figure it out?

Hi Guys, I am using Datahub 0.10.1 version. I have made some changes in datahub frontend like changing the logo and trying to build docker images. For that from the root folder, I am executing the command ./gradlew datahub frontenddocker. It is not proceeding further beyond yarnQuickBuild as shown in SS. It is executing even for 6 to 7 hours. It is not showing any error. And even I increased Node memory to 8 GB. Thank you in advance for any approaches or suggestions around this.

Hello all! I have noticed a weird graph in the analytics plot. The searches last week plot only shows a few days, and not all the week, see the picture below. Is this a UI bug or some error on our side?

we need to capture all the MCP events that are directly consumed by gms or anything directly coming to gms not to Kafka. Can we do that ?

Hi Folks! New to Datahub. Wanted to know if Datahub supports Auto tagging and PHI Metadata Auto Masking. If yes can you share How?

Hey everyone! Is there a way to make tables look better? It would be nice to edit the column width

is it possible to show the database name in each of the related entity in the Lineage Visualization screen? right now it's just showing the data source name and table name.

Hey Datahubbers! 👋 We’re on Datahub v0.10.1 and currently we are shown the last page we were on when we re-open datahub (instead of the homepage), which many users are finding very confusing. Is this configurable at all? 🤔

Hi! Can anybody know how to search datasets with owners and its role ?

Hi, is there a way to download a lineage as a picture (or like an ERD)?

hi i am getting => ERROR [base 3/3] RUN apk --no-cache --update-cache --available upgrade && apk --no-cache add curl && apk --no-cache add openjdk11-jre --repository=http://dl-cdn.alpinelinux.org/alpine/edge/community 2.9s ------ > [base 3/3] RUN apk --no-cache --update-cache --available upgrade && apk --no-cache add curl && apk --no-cache add openjdk11-jre --repository=http://dl-cdn.alpinelinux.org/alpine/edge/community: #7 0.903 fetch https://dl-cdn.alpinelinux.org/alpine/v3.17/main/x86_64/APKINDEX.tar.gz #7 1.680 484B5AE5F47F0000error0A000086:SSL routinestls post process server certificatecertificate verify failedssl/statem/statem clnt.c1889: #7 1.686 WARNING: Ignoring https://dl-cdn.alpinelinux.org/alpine/v3.17/main: Permission denied #7 1.686 fetch https://dl-cdn.alpinelinux.org/alpine/v3.17/community/x86_64/APKINDEX.tar.gz #7 2.150 484B5AE5F47F0000error0A000086:SSL routinestls post process server certificatecertificate verify failedssl/statem/statem clnt.c1889: #7 2.155 WARNING: Ignoring https://dl-cdn.alpinelinux.org/alpine/v3.17/community: Permission denied #7 2.156 (1/1) Purging ssl_client (1.35.0-r29) #7 2.157 Executing busybox-1.35.0-r29.trigger #7 2.170 OK: 7 MiB in 14 packages #7 2.198 fetch https://dl-cdn.alpinelinux.org/alpine/v3.17/main/x86_64/APKINDEX.tar.gz #7 2.546 480BD2DD127F0000error0A000086:SSL routinestls post process server certificatecertificate verify failedssl/statem/statem clnt.c1889: #7 2.551 WARNING: Ignoring https://dl-cdn.alpinelinux.org/alpine/v3.17/main: Permission denied #7 2.551 fetch https://dl-cdn.alpinelinux.org/alpine/v3.17/community/x86_64/APKINDEX.tar.gz #7 2.867 480BD2DD127F0000error0A000086:SSL routinestls post process server certificatecertificate verify failedssl/statem/statem clnt.c1889: #7 2.877 WARNING: Ignoring https://dl-cdn.alpinelinux.org/alpine/v3.17/community: Permission denied #7 2.878 ERROR: unable to select packages: #7 2.885 curl (no such package): #7 2.885 required by: world[curl] ------ executor failed running [/bin/sh -c apk --no-cache --update-cache --available upgrade && apk --no-cache add curl && apk --no-cache add openjdk11-jre --repository=http://dl-cdn.alpinelinux.org/alpine/edge/community]: exit code: 1 ERROR: Service 'datahub-frontend-react' failed to build : Build failed

Hello, I have a few questions about the UI tab of the table schema. 1. queries Is 'queries' tab a section about frequently used queries that refer to the table? Is it correct that there is no separate function for executing queries? 2. stats According to the datahub docs, https://datahubproject.io/docs/how/ui-tabs-guide/ it seems that the "stats" tab can only be used with Snowflake and BigQuery sources. Is it correct that it can only be used with these two sources? 3. validation I understand that the "validation" tab shows information about the elements that need to be checked when collecting data sources. Could you provide more information about its exact function? Thank you in advance.

hello Team , my glue source given me error that

Failed to resolve secret with name AWS_ACCESS_KEY_ID

but secrets is already exist earlier it was running fine please give me some suggestion. thanks

Hi. I've notices something that might be a UI bug, and repeated it on Datathub Demo to illustrate: Screenshot 1 is how a normal Related Terms tab in Glossary Term looks like. Nice and fits the screen. Screenshot 2 - same Tab when there is a connected Term with a long description. The section of the page stretches out beyond my laptop screen and there is no way to make it narrower to fit the screen. In this example the description of the Term is filled with test words, but in reality in our prod instance of Datahub we do have Terms with big descriptions, so we do face this issue. Also I don't think I've seen this ussue with the stretched out section on previous version of Datahub that didn't have "Contained by" and "Inherited by" relationships

Hi all, I am on DataHub 0.10.1 and I am trying to create a filter view on dataset name. I don’t see dataset name property being supported, although more granular properties such as column descriptions are (docs). Is it possible to use the dataset name in the view?

Morning! How can I easily create views for all assets that do not contain something? For example, I want to create a view for my team to show all assets without an owner. Currently, that view has literally every user on the platform attached to a "not in". Is there a way to use * or something?

Is there a way to see a list of all the tags that exist? I’m testing out creating a few tags and already forgot what one was called. I found that I could search for a dataset and it’ll show me the tags used in that dataset, but it wouldn’t be efficient to have to check every dataset to find out all the existing tags.