Hey everyone!, I have a question about the UI of Properties Tab in Dataset Page. When we add dataset that has siblings in it, Then in properties tab it shows both siblings custom properties as well as the custom properties of its own • Why it is doing that? Is there any particular benefits or side effects? ◦ Because If user want to see custom-properties of the sibling then user can simply see by visiting the properties tab through indivisual sibilings i.e inside Composed Of • If we have more then one siblings, then which one will we show in properties tab? Ref PR https://github.com/datahub-project/datahub/pull/5390

Hi Team, In the task run tab, is there anyway we can show the properties of DataProcessInstance? e.g. we plan to add rows_inserted, rows_update, rows_deleted statistic data for each execution of a data job. But I don’t find a way to show them from UI. Exception that, we also want to provide the global query on the task run, e.g. find out which runs are failed recently, Could you show me how to do that from UI?

I noticed that preview in @-links for user groups show what seems to be their urn or something, not the display name. But when I tried to reproduce it on Demo - it worked fine there, the names were displayed. I'm still on 10.1, was it fixed on 10.2 which Demo has? PS. just in case - my group names are written in English, not any other alphabet

Hi team I am trying to create a domain and glossary term from UI but it’s not coming on UI But I am see corresponding logs in gms , mae consumer ad well in Kafka Also MySQL has its entry as well What could be the possible reason I checked the space and everything

Hi. I would like to inquire about the method for calculating the active users of the Analytics UI. I have only created one user. And Iam testing with that user, but why does the UI show 7 or 8 active users? (weekly active users, monthly active users) I would like to know the calculation method. Thank you in advance.

Hi, Is there a way to see a table/view creation command (DDL) in Datahub? like when I select x table in Datahub I want to see its definition:

create table x 
(id int);

or/ and the command that populates the table/ view (DML)? like:

insert into table x
values (1);

Thank you for your help 🙂

It's been a while since I started datahub. I ran datahub with docker, and I want to use it by specifying REACT_APP_LOG_URL in the docker compose file. However, it is not getting the correct path name. Currently, I set it as below, but it does not appear on the screen. datahub-gms: … environment: - REACT_APP_LOGO_URL=/datahub/logos/datahublogo.png volume: - ${HOME}/.datahub/logos:/datahub/logos

Hi Team! I'm currently upgrading our datahub from the simple dataset lineage to the beautiful fine-grained lineage 😄 This works fine for the datasets, however I am having some issues with the datajobs. I'm using the Python SDK to emit the lineage, but the UI displays no indication of column-level relations. Here is an example sql server procedure, with the following metadata-change request:

MetadataChangeProposalWrapper(entityType='dataJob', changeType='UPSERT', entityUrn='urn:li:dataJob:(urn:li:dataFlow:(mssql,default_sql,PROD),bncube.dbo.uspbuildaccountmonthsonbook_1_and_3)', entityKeyAspect=None, auditHeader=None, aspectName='dataJobInputOutput', aspect=DataJobInputOutputClass({'inputDatasets': ['urn:li:dataset:(urn:li:dataPlatform:mssql,bndwh.dbo.accountstatistics,PROD)'], 'inputDatasetEdges': None, 'outputDatasets': ['urn:li:dataset:(urn:li:dataPlatform:mssql,bncube.dbo.account_monthsonbook_1_and_3,PROD)'], 'outputDatasetEdges': None, 'inputDatajobs': None, 'inputDatajobEdges': None, 'inputDatasetFields': ['urn:li:schemaField:(urn:li:dataset:(urn:li:dataPlatform:mssql,bndwh.dbo.accountstatistics,PROD),AccountNumber)'], 'outputDatasetFields': ['urn:li:schemaField:(urn:li:dataset:(urn:li:dataPlatform:mssql,bncube.dbo.account_monthsonbook_1_and_3,PROD),AccountNumber)'], 'fineGrainedLineages': [FineGrainedLineageClass({'upstreamType': 'FIELD_SET', 'upstreams': ['urn:li:schemaField:(urn:li:dataset:(urn:li:dataPlatform:mssql,bndwh.dbo.accountstatistics,PROD),AccountNumber)'], 'downstreamType': 'FIELD', 'downstreams': ['urn:li:schemaField:(urn:li:dataset:(urn:li:dataPlatform:mssql,bncube.dbo.account_monthsonbook_1_and_3,PROD),AccountNumber)'], 'transformOperation': None, 'confidenceScore': 1.0})]}), systemMetadata=None)

Any clever people who can see the issue? I am also not sure what to expect, as I haven't found an example of datajob fine-grained lineage between two datasets. I've followed documentation found at https://datahubproject.io/docs/generated/metamodel/entities/dataset under fine-grained lineage for datajobs. Any help much appreciated 🙂

Hi All, Is there a way to define a template for data catalog objects where we can define the objects or properties once and applied to all or related catalog objects.

Hi Team, Can anyone help me with detail steps I need to follow for below requirement ?? Steps followed: I have used Datahub Helm charts and deployed the application to AKS ref below doc https://datahubproject.io/docs/deploy/kubernetes Requirement : To change the Logo of DataHub Application, referring to below document I see we can change the logo without rebuilding assets by changing ENV variables (REACT_APP_LOGO_URL / REACT_APP_FAVICON_URL) in gms

extraEnvs: 
    - name: REACT_APP_LOGO_URL
      value: ../../ui/logo/datahublogo.png

https://datahubproject.io/docs/datahub-web-react Question : What steps in detail my developer should follow now to update the env variables ?? All I have is Helm charts More information on how the path is actually specified will be helpful. Do we need to clone any application repo ?? if yes, what will be those steps in detail and how can we point to the helm charts I have used ?? Thanks,

Hi All, Is there a way to remove existing

HOME_PAGE_ANNOUNCEMENT

I found GraphQL mutation to deletePost but it requires urn which I don't have. Thanks

Hey team! So I've been trying to figure out why most of the groups aren't showing up on my user's pages. After looking into the React files, I've found that the group page size is actually hard coded to 20 in the UserProfile component. I'm just wondering, is there a reason we can't display all of the groups a user belongs to? Also, if there is a good reason for limiting it to a number like 20, then is there something we can add to make that limit more obvious to the end user? This could potentially be a good feature request or contribution. Thanks!

Are there plans to make Database entity into a filter? For example in my Postgresql ingests I have several Databases - 13 as you can see in Sub Type filter - but I can not filter by Database. The Container filter reflects lower level of postgres organization, i.e. schemas within a database. For example we have schemas with the same name 'public' in several Postgres databases, but from this view I can not see which 'public' schema belongs to which database. I know I can filter by Database, then find the database I need in the list, then click onto it and see its contents. But since database is the most foundational top level in data differentiation, I think it makes sense to make it a basic filter, and it would make browsing data in Datahub more user-friendly

Hi, Is there a way to insert code descriptions to a dataset as a code block option using Graphql? Thanks example:

Hello, I am currently testing the deployment of a data catalog and I would like to know if it is possible to manage the possibility that users can have access to metadata or not and if so how to limit access to people on certain domain thank you

Hey there 👋 I'm The DataHub Community Support bot. I'm here to help make sure the community can best support you with your request. Let's double check a few things first: 1️⃣ There's a lot of good information on our docs site: www.datahubproject.io/docs, Have you searched there for a solution? Yes button 2️⃣ It's not uncommon that someone has run into your exact problem before in the community. Have you searched Slack for similar issues? Yes button

Hi Team, I am doing some customization in UI where I want to rename keyword "Domain" to "Tenant". I am trying to change highlighted keyword "Domain" in Advance filter tab as per below screenshot. Could anyone help to pinpoint the logic in web react source code? Thankyou

Hi, not sure if this is the best place to ask a question about the frontend API - i’m guessing UI is very closely tied to the frontend API. When deploying datahub frontend with postgresql as the backend, does the frontend code use an ORM layer to interact with the postgresql backend?

Hi, is there a way to backup the business glossary created in the ui? In my usecase there is the need to create the glossary terms via the UI and backup them including the assignments to the datasets. Unfortunately I did not find anything (or not clear for me) in the documentation. thanks in advance

Is there an easy way to download the data glossary terms/details into a csv?

In current policies settings the options are either to include certain resources\users\domains, or to have the policies applied to all of them. but is it possible to exclude certain resource\group\domain? Other then check all positions exept some, I mean. Checking whole list is not always possible - in case of resourses for example, but excluding smth is a popular case in governing policies or any types of conditions

Hi everyone, we're super excited to share that we're almost finished integrating a Jira Issue collector call from within DataHub (Version 0.10.1). We're deploying DataHub to AWS using Helm Charts 0.2.161. We've added a new react component in the src/app/entity/shared/sidebar/ section of the UI and made various calls to the new typescript file we keep getting an error toast message on any load of the datahub UI. Here is the console error I see in Edge...

Caught (in promise) Error: Validation error (UnknownType) : Unknown type 'GetQuickFiltersInput'

Validation error (FieldUndefined@[getQuickFilters]) : Field 'getQuickFilters' in type 'Query' is undefined at new t (index.ts605) at QueryManager.ts87439 at n (asyncMap.ts3030) at asyncMap.ts1947 at new Promise (<anonymous>) at Object.then (asyncMap.ts1916) at Object.next (asyncMap.ts3139) at y (Observable.js13518) @mammoth-bear-12532 you asked me to keep you in the loop on this. Here is a screenprint of the button we've added. Thanks! at O (Observable.js1793) at e.value (Observable.js2357) t @ index.ts:60 (anonymous) @ Q We're actively debugging, but have not really found any solution to this. Any help would be appreciated!

Hi team 🙂 Can I monitor the users’ login & usage of the portal?

Hi all, Is there any option to add prefix to tables/views in the "Advanced filter" view, so I will know the cluster of them? see example below - I have 2 redshift clusters added via ingestion, the aggregation of the datasets is based of the clusters, but I don't see the difference here: @powerful-cat-68806

Are there plans to make a filter bar for Dataflow containers, like the one exhisting for Dataset containers? We have some pipelines that include quite a few tasks so it's kinda much needed

Hi team, We have enabled async_ingest_default flag for dbt which is using datahub rest as sink, the rest traffice rerouting as MCP but the problem is this we are replicating these MCP via mirror maker from primary datahub instance to another. All MCP are getting replicated but on UI when I see dbt datasets in secondary instance, aspects are missing I cannot see schema view Defination and other things Only entity getting replicated but aspects are not replicating completely How this asyn_ingest_default flag works ?

Hi team , Does dbt ingestion supports datahub-Kafka as a sink ??

Hello, Is there a way to collapse a lineage graph after it has been expanded? I see the

+

sign to expand the graph but I do not see anything to collapse it after

Hi, Can someone help me on how to enable 'stats' tab. The previous answers suggests doing SQL Profiling, but the link seems to be not found.

Hello all! So after watching the Townhall from yesterday and I got super interested in the presented usecase where they added a button to ask for requests for specific data. We are super interested in this for our organization. My question is, how can customize the UI and add a new button? cc: @careful-garden-46928