Hello everyone, I was testing the datahub version 0.9.6 and now I am trying out v0.10.0. In both versions, secrets value haven’t been evaluated when I’m using UI-based ingestion, I am able to connect whenever I define plain text password, is there any setting that I am missing? thanks in advance

Hi, how can we enable the validations tab without using great expectations and publish some result values of our own, instead of going through declaring expectations; the result of which in turn appears in validation tab.

Hi! Anybody knows why I am having this problem filtering dashboards by urn? (alredy tried it with name and dashboardId fields but didnt work) Thanks!!!!😊

Hi! Is it not more appropriate to show the schedule for ingestion jobs from

datahub-ingestion-cron

component? But it is certainly incorrect to show the schedule as ‘`None`’. Curious what others think of this here 🤔

Hi all. I can't quite understand the Contains\Inherits relationships in Glossary. If add a term A in Contains section for Term B, I would expect the term B to appear in the "Inherits" for the Term A as well. But it doesn't seem to be the case, I have to add both relationships separately. Is there a way to have a link between to terms that works both ways? And what exactly does current relationship contain or inherit for terms?

Similar question to Nadia but regarding combined datasets between sources. Since we have dbt and snowflake sources, we have some entities that are duplicated between them. They are currently grouped together via the UI in a “combined” entity, but we’re worried that entities won’t always be in sync. Was about to ask the same question! My current plan is to create a datahub action that syncs changes in A->B and syncs changes in A->B, but wondering if there’s a better way to do this. We’re just trying to cover the following use case: 1. User searches for an entity 2. User clicks on one of the contained entities (the dbt OR snowflake one rather than the dbt & snowflake entity) 3. User makes change to a tag in the contained entity, this change is not propagated to the combined entity. 4. User comes back later and searches for the entity 5. User is confused why the tag/term they applied has disappeared. An alternative could perhaps be to hide any of the source entities, and only display the combined one via the UI? But that may cause some issues down the line I’m not currently aware of. Has any other team encountered/solved this issue?

cross posting my #ui related issue here, happy to delete if this is not a cool thing to do! 🙏 https://datahubspace.slack.com/archives/C029A3M079U/p1678126677196589

Hoping this isn't a repeat, first timer for Datahub here - I'm using an existing react application and preparing to add datahub to it. It's possible I missed something in the instructions also, but when I start adding any import statements (such as 'import datahub from "datahub-client"') the error is being seen that it cannot resolve ./rx.lite. So I go into the ./node_modules and sure enough it's there along with the rx-lite-aggregates. Any thoughts on what I am missing / going about the wrong way?

Hello! quick question, is there a way to white label? using our own logo?

@astonishing-answer-96712 added a workflow to this channel: *Community Support Bot *.

Hi everyone! I have created a new aspect for the Dataset entity, and I would like to show it on the UI, as a tab in the entity page! I followed the guide (attached a picture), and added the autoRender and renderSpec to the aspect annotation, I have included the new aspect in the registry also. I have redeployed the backend and the frontend. I tried, the new aspect is connected to the Dataset entity/aspect, through the OpenAPI I can modify and retrieve the values within. On the UI, unfortunately, I cannot find it on the UI as an auto renderable tab. Maybe I am missing something or, leaving out some necessary steps. Could you help me understand this autoRender feature, and how to debug the problem? Thanks in advenace! Marcell

Hi Team! On my previous datahub redeployment I have discovered an issue regarding recovering state from the mysql backup. We lose following data ingestion on redeployment: • UI ingestion secrets. The secrets are present but the ingestion pipelines cannot find them (unable to resolve secret with name...) • Usage analytics data. I assume they are stored in elasticsearch which would make sense. My question is how can I prevent these types of data loss on redeployment? My previous redeployment were from v0.10 to same version v0.10

hey y’all! 👋 we encountered a bug where using schema search to filter the fields in a Dataset breaks the scroll “view” for the dataset description when there’s markdown. This squarely feels like a bug (vs intended behavior) b/c it breaks the UI. We’d be happy to submit a PR if core Datahub folks agree 🙂

Hi Team I want to know if we can customize the UI provided by datahub ?

Hello! I have a question regarding tags. Is it possible to expand the list to see all of them when searching? For instance, I see ‘+1’ but can do nothing with it.

is it possible to create a tag via UI - only create without adding it to any entities? In case I as an admin want to create a specific list of empty tags and then data stewards will use them to mark their datasets. So far the only way to create a tag I've seen is from 'add tag' field in a dataset and it's not what I'm looking for

Hey community, would love to see how you customize datahub UI without forking for inspiration and vision 🙂 Thanks !!

Hi everyone, we are working right now on a customization involving Backend and Frontend's effort, we are working in parallel, however having the backend ready represents a blocker for Frontend. I noticed that there is a special way to run React APP with mock data by running

yarn start:mock

. I have been researching and also found that this mode uses Miragejs, which is awesome as the perfect tool to provide mock data to our new feature while the backend is ready. Although I already have the site running in this mode, I only have a couple of entities recreated, and the documentation on this seems to be scarce, can anyone give me some guidance on how I can recreate at least one dataset using this mode?

For Airflow Tasks Datahub has a tab 'Runs' with the list of all task runs with a timestamp. But how can we filter by those runs? For example do a search of tasks that has run for the last time within a certain period

For internal use, is there any legal reasons we need to be aware of for replacing the DataHub logo on the landing page?

Are there plans to enable editing names of links in datasets description? Afaik currently we can only delete the link and then add again if we need to rename it, and it's super inconvenient

Hello everyone, are there plans to create a tree relationship in domains? Why: Create domains that have sub domain.

Hi community!, I'm trying to create a custom entity via custom model approach by following the react-app readme, and the https://datahubproject.io/docs/metadata-modeling/extending-the-metadata-model/ as well, to then be able to fetch the entity data from my react Component, so far I managed to : 1. Create the custom model 2. Define the types on datahub-graphql-core/src/main/resources/entity.graphql 3. Create the component implementing Entity<MyCustomEntity> 4. Provide a path as an entry point However, I'm getting an error when try to access to defined path. Seems to be a permission issue with the new entity. My Custom entity was called ACCESS_REQUEST

{"operationName":"getGrantedPrivileges","variables":{"input":{"actorUrn":"urn:li:corpuser:datahub","resourceSpec":{"resourceType":"ACCESS_REQUEST","resourceUrn":"urn:li:access_request:(urn:li:dataPlatform:hive,logging_events,PROD)"}}},"query":"query getGrantedPrivileges($input: GetGrantedPrivilegesInput!) {\n  getGrantedPrivileges(input: $input) {\n    privileges\n    __typename\n  }\n}\n"}

Response "Variable 'input' has an invalid value: Invalid input for Enum 'EntityType'. No value found for name 'ACCESS_REQUEST'" Any clue on this matter?

Hey Datahub community! We’re on Datahub v0.10 and we tried enabling the histogram feature within data profiling, but we don’t actually see the results anywhere in the UI for a table. Curious what we’re missing? https://datahubproject.io/docs/generated/ingestion/sources/snowflake/#config-details

Hello, everyone. I've noticed i cannot save view as public (only private). Option to change type of view is greyed out. I'm on v0.10.0. In effect i cannot share a filter i've prepared to other users. I have all platform and all metadata privileges.

Hi Team, I am trying to build frontend in my local. I have executed the below two commands: 1. ./gradlew dockerquickstartDebug 2. ./gradlew datahub frontenddist -x yarnTest -x yarnLint Both the command stucked at a same position yarnQuickBuild and the output is below in ss-1. Even I tried the below two commands in datahub-web-react yarn install --ignore-engines yarn start yarn start command stucked as below in ss-2 In order to solve the above issue I executed npx browserslist@latest --update-db command: But unable to solve and the output is below in ss-3 and ss-4. Seeking suggestions from the community in order to solve this and Thank you in advance for your kind suggestions.

When generating the documentation, I noticed that some of the entity pages display the information on the entity keyAspect (e.g. https://datahubproject.io/docs/generated/metamodel/entities/corpuser) but others do not (e.g https://datahubproject.io/docs/generated/metamodel/entities/query) even though both key Aspects appear to be defined and registered in the same way. I noticed this because I also cannot view the keyAspects for the my custom entities in the locally generated documentation, though the rest of their doc pages generates correctly. What am I missing here in order to make the keyAspect documentation appear?

Hi all! have I not found the right setting, or is it really not possible to create a view that filters out objects marked as deprecated?

Hello, I've been testing the integration with Airflow and came across the situation when Datahub does not display a lineage. I configured Airflow plugin according to the documentation. Datasets, tasks, dag were ingested by Datahub ok, however lineage screen does not display a graph with relations. Meanwhile it shows that items do have upstream or downstream and if I click "Edit Upstream (or Downstream)" related item will be in the list. Please advice whether that is an issue of datahub or I was doing something wrong. Thank you

Hi All, I'm puzzled by the default behaviour of the lineage tab since the recent updates. It now shows lineage from 'last 14 days'. I synchronized my data and ingested my lineage again (via rest emitter) but probably because nothing has changed in this lineage recently it is not showing up unless I choose 'all time'. Do I need to do something when ingesting the lineage via rest emitter to show this lineage is 'active'? (like update a timestamp somewhere or something?) I couldn't find any documentation on this behaviour. Also by default only showing downstream seems counterintuitive? Wouldn't you want to know where your data is coming from rather than where it's going to? (dependent on your use case of course...)