And another question (I'm opening a new thread because it's really a different question from the one above, hope you don't feel this is spammy): I observed that all "Edit" buttons (Add Tags, Owners, etc.) are still shown on an entity even if a user doesn't have edit permissions on it. I see there is a call to

getGrantedPrivileges

when accessing the entity, but this only seems to return the VIEW_ related permissions. I wonder if this should include the EDIT_ type permissions, and then the UI could react accordingly? It feels counter-intuitive to show all these buttons only to fail validation on API side if someone tries to use them.

Hey folks, any thoughts on supporting different DAG layouts / the ability to "reformat" the DAG after expanding/repositioning nodes? I think react-flow / dagre support this but looks like there's a lower-level implementation for the DAG layout in the frontend

shoutout to whoever made this mouseover behavior, it rocks

Hey Folks! Can anyone help me out with how to integrate the new ui developed in datahub-web-react folder with docker scripts?

Hello All, I am working on the column level lineage and I not able to see the confidenceScore and, transformOperation in the UI, on the backend I am able to see those values. but not showing up in the UI, is there any other setting am I missing to see them in UI? Thanks Geetha

hi, how can I make the show full title and show columns button default clicked in the lineage view for Datahub for users?

Hey, I am getting a broken image on the welcome screen on the home page at https://demo.datahubproject.io/. I believe it comes from this section. Would it be possible to update this image or url? Thanks

Hi All, I have been facing a issue while I am trying to sign out, when I click on sign out button it brings me back on Home page of datahub and this happens every time. I am not able to sign out anyhow, the only way to sign out and login is to clear the cache and then login. I am using 0.11.0 version of datahub. I have recently enabled Access Tokens but the issue continues. These are the GMS logs we am getting when trying to sign out.

2024-02-04 18:38:17,261 [qtp979294118-38744] WARN  c.d.a.a.AuthenticatorChain - Authentication chain failed to resolve a valid authentication. Errors: [(com.datahub.authentication.authenticator.DataHubSystemAuthenticator,Failed to authenticate inbound request: Authorization header is missing Authorization header.), (com.datahub.authentication.authenticator.DataHubTokenAuthenticator,Failed to authenticate inbound request: Request is missing 'Authorization' header.)]
2024-02-04 18:38:18,698 [qtp979294118-38745] INFO  c.l.m.r.entity.EntityResource - GET urn:li:corpuser:atharv.sharma@paynearby.in
2024-02-04 18:38:18,702 [pool-16-thread-2] INFO  c.l.m.filter.RestliLoggingFilter - GET /entities/urn%3Ali%3Acorpuser%3Aatharv.sharma@paynearby.in - get - 200 - 4ms
2024-02-04 18:38:18,709 [qtp979294118-38744] INFO  c.l.m.r.entity.AspectResource - INGEST PROPOSAL proposal: {aspectName=corpUserStatus, entityUrn=urn:li:corpuser:atharv.sharma@paynearby.in, entityType=corpuser, changeType=UPSERT, aspect={contentType=application/json, value=ByteString(length=100,bytes=7b227374...30367d7d)}}
2024-02-04 18:38:18,737 [pool-16-thread-3] INFO  c.l.m.filter.RestliLoggingFilter - POST /aspects?action=ingestProposal - ingestProposal - 200 - 28ms
2024-02-04 18:38:19,724 [I/O dispatcher 1] INFO  c.l.m.s.e.update.BulkListener - Successfully fed bulk request. Number of events: 1 Took time ms: -1

Any help would be appreciated, I am trying to fix this issue for a while now. @little-megabyte-1074 , @dazzling-judge-80093 need your expertise. Thanks. CC:- @stocky-guitar-68560

Hey. I see the button to add users to Roles, but how do I remove them from Roles? Or Edit the description for the role, or assiciated policies. If I click on a role it doesn't give me any editing options

Hi, is there a way that when inputting passwords in secrets it encrypts it on the page? We currently have a situation where someone needs to input a password but is not admin of datahub so they are inputting via sharing our screen and is good practice to have that encrypted on screen. Is there a way via CLI to set the password encrypted instead?

We have ingested metadata from snowflake and there is a “View in Snowflake” option for all the data assets. How can we disable it?

Hello 👋 I have successfully ingested a couple of different source into my datahub insrance: • Snowflake • dbt • Airflow For my usecase i am trying to explore the lineage between these two dbt models that have a considerable amount of upstream/downstream dependencies each that make expanding the lineage via

Visualize Lineage

pretty difficult. Lets say the models are: • CAMPAIGN_ANALYSIS_ENGAGEMENT_BASE_NF • offers_audience Is there an easy way to show only the lineage between 2 entities via the UI or other means? The closest I got is to go to the models and filter on the

Lineage

tab and verify that they are linked together, but I want to explore all the models in between the two to see what filtering and logic is performed on the data all the way to the downstream model.

Hello i try to deploy datahub but i cannt find out how to deploy datahub frontend with https i get: "WARN akka.actor.ActorSystemImpl Illigel request, responding with ststus code '400 Bad Request' Unsupported method HTTP: the HTTP method started with 0x16 rather than any know http method from <ip> Perhaps this was an HTTPS request send to an HTTP endpoint?" if somone solve that problam it will be real help

Hi everyone, I've noticed there is a slight difference between the results that appear in the search preview (the box that pops up when you type something into the search bar but don't press enter) and those that appear when you press enter and go to the full search page. Often it's just the order of the results that's different, but sometimes new results appear. Can somebody explain the difference between the processes for displaying search results in the search preview window and on the actual search results page? If someone could help direct me to the correct files in the codebase I can do some more looking on my own as well. Thank you!

hi evreyone, how can i customzie datahub-flow-diagram-light.png?

Hi all, sorry for this question as I am still new to datahub. Can someone help me why this is happening? I deleted some metadata via CLI delete command. however the UI still shows deleted containers.. May I know how long deleted containers will stay? Do i need to force refresh the UI or check somewhere else?

Hi, We configured DataHub UI in our EKS cluster with RDS as the backend storage database. Now to start with the application I created an ACCESS_TOKEN and a user. However, I do not see these getting populated in the UI. I can log in using the user I created but the user does not appear in the users list. I could not see any relevant error in the k8s logs as well. Can you please help me what could be going wrong here. We are using the dataHub version 0.12.4

Hi, I have encountered a potential mssql lineage bug regarding column level lineage. I used the sql-queries ingestion to scan a mssql script and when I view it in the datahub lineage graph it does not show a lineage line between columns like in Snowflake. The lineage definitely exists, because in the lineage column view it tells me that the colums are linked together. So something is wrong on visual side on the ui.

Hi, Is it possible to have SSO (Okta) configured on self-hosted DataHub? I am using DataHub version 0.12.4? If so can you please let me know how?

Hi all, I am getting a duplicate option in the dataset type dropdown, using version

v0.12.1

.. anyone also experiencing the same behavior?

Hi, we are using the old version of UI (filter options in the left pane in the UI) and thinking of upgrading to the new UI (filters are on top). However the challenge is; in the new UI everytime I want to use a filter, I need to click on drop down and then select update to apply the filter. 1. Is there anyway we can disable the additional clicks (so comparison to the old UI, a user doesn't have to do two additional clicks). Suggestion could be when you hover-over the drop down will be visible and upon clicking on the checkboxes filters will be applied automatically). 2. If the above is not possible; is there anyway we can enable the new UI for a subset of users? - so we can run an A/B test and gather some user feedback? Any thoughts and if anyone faced similar issues experience sharing is much appreciated. Cheers!

Hi All, For one of the dataset I manually added the one upstream metadata. Now when I am trying to visualize the Data Lineage I do not see any downstream lineage that I was able to see earlier. I am using 0.12.4 as the version. Am I missing any steps for manual adding a data Lineage? Any help is highly appreciated

hello everyone i faceing single sign out issue i configured sso with azure oidc when i click on sign out it redirecting to same page not signing out anybody help on this issue

Hi, I am playing around with extending the metadata model by creating custom aspects on DataHub and am trying to input an array of strings as one of the field/column inputs. I'm able to upload data via the 'datahub put' command, however, any fields that contain an array format data type don't display their corresponding data. The custom model is loaded properly as other data types (e.g. strings, enums, etc) properly display any inputted values. When looking at the stored data via the 'datahub get' command I see that the data is stored on DataHub but for some reason it is not displayed on the UI. Are arrays not natively supported by the DataHub UI?

Hi All, I have the DataHub hosted in our own EKS cluster. The application is behaving a bit erratic. The application got frozen and it gives an error as “Unexpected Error Occur. Something went wrong” can you please provide any steps to debug the issue.

Does Anybody knows where to customize the following description?

I search the text in Datahub-web-react, it seems that there is no description in the Typescript code

Currently trying to change the image and theme for datahub but it looks like the github documentation is out of date. Can someone link me to the guide to do so?

Hi all, I'd like to clarify how Airflow pipelines are shown in the UI.. This is what I have currently, but I am not sure which config maps to "Default" here.. How do we override or change it? I have added a config in my airflow instance with

datahub.cluster = dev

Hi currently we are using the

datahub-frontend

image to run datahub, however in the docs I see

datahub-web-react

- what is the relationship between these two modules? Do we need to choose between them or is one executing another? https://datahubproject.io/docs/datahub-web-react/