Hi Team , I was doing some changes in UI look and feel of datahub. To verify those changes i was trying to build the docker image of datahub-frontend module on running the below command from datahub home folder

sudo docker build -t updated_datahub_frontend_react -f ./docker/datahub-frontend

But this end with the error below

---> Running in 55db64e7685d
/bin/sh: ./gradlew: not found
The command '/bin/sh -c cd datahub-src && ./gradlew :datahub-frontend:dist -PenableEmber=${ENABLE_EMBER} -x test -x yarnTest -x yarnLint     && cp datahub-frontend/build/distributions/datahub-frontend.zip ../datahub-frontend.zip     && cd .. && rm -rf datahub-src && unzip datahub-frontend.zip' returned a non-zero code: 127

Could anyone please help me resolve this issue.

Don’t know where to post is, but checking if the instructions on extending graph and react are still up to date. I’m extending the metadata model to add a new

Experiment

entity. I’m able to successfully interact with the entity, wanted to check before I proceed to the next obvious steps. To start with I’m not able to find

gms.graphql

and

browse.graphql

Maybe stupid question, but we use “env” in all the different sources. Is it possible to add “env” to the search as well?

Hey team, quick question, is it possible to declare a new metadata field on the existing table and populated its data via API? e.g. we would like to emit the calculated metrics to DataHub via API.

Question on Lineage presentation - for this example i see datahub says there are 7 upstreams but then displays only 4.. Am I missing something? Also, for the nodes in this visualization, there are multiple other upstreams and downstream.. When i hover over them, i see a message about that they are hidden.. Is there a way to unhide those?

Hi Team， Do Datahub users currently support access to LDAP user authentication services like Crowd?

hey folks - wondering if you all did an analysis of other options for the lineage graph viz library besides VX. i’m evaluating options for our internal solution at LI and was wondering if you had a doc I could review.

hi team, I’m curious what made you finally choose

@uiw/react-md-editor

as Rich Text Editor lib over other popular ones like

draftjs

. any specific requirements that lead you to that choice?

i would like to clarify the role of OIDC and CorpUsers in datahub: 1. if i intend for users to sso via OIDC (keycloak), i should enable OIDC. If i would like to specify users in policies or ownership in UI, but they havent logged in to Datahub before, I should ingest them as CorpUsers (by querying LDAP and ingesting the output), yes? 2. does searching for people in the search bar only returns CorpUsers in database, or does Datahub also query the OIDC during the search as well? 3. I see that if i change the details of the user at OIDC end, datahub doesnt seem to do any more updates after the initial user creation (is that correct?) 4. assuming there is a corpUser record in mySQL already, Datahub will attempt to match OIDC users by the urn (and not by other details like email or name)? thanks alot in advance 😃

Hi guys, from the top right corner of the datahub UI, we can see the Users&Groups field. I wonder when this feature is enabled, on which release? • From https://demo.datahubproject.io/ , i can see that you have deleted the user types like dataowner, developer etc. • redshift-usage feature is enabled with release 0.8.15 but i can’t upgrade datahub with helm chart since it’s still 0.8.14 in the github repo https://github.com/acryldata/datahub-helm/tree/master/charts/datahub • datasets ui is updated but pipelines module still has old ui version I’ve upgraded datahub to 0.8.14 but i can’t see these changes. What should i do?

Hi team, I wonder what "`schema`" and "`property`" taps are for on Glossary terms UI. I checked the docs and example, but there is no explanation about what are these, or how to define these in yaml file 😞

hey, how does one hide unused items (for example

ML Models

) from the front page? Perhaps there are some env vars that I can set or something equally simple?

@mammoth-bear-12532 Is it possible to establish UpstreamLineage between 2 datasets from the UI (hostname:9002) ? If more than 1 upstream for a Dataset is permitted, then only a validation is needed to prevent cyclic lineage.

Hi team, I have a question regarding /dataset/ page. 1. Is it possible to display the table description directly under the table name? Or is there any attribute to put a shorter version of description under the table name? My use case is my user want to see what is the dataset about in a quick glance. 2. Also, It is possible to move components, e.g the sidebar to the left instead? I think this will make the description be the first thing a user look on the page

Hello everyone, i'm trying to ingest some datasets with ML Model with this example: https://github.com/linkedin/datahub/blob/a121aff6eb2814dc6d15c4406793ad1bd95eed3e/metadata-ingestion/examples/mce_files/bootstrap_mce.json#L1388 . But the thing is i dont get any information in UI lineage, it`s basically the ML model itself and that's it. I aslo checked datahub demo, and there is the same problem - when i press ML Model linage, i see only ML model with no connections. Am i doing smth wrong?

has anyone stress tested the policies... is there a significant lag when say, a few hundred policies are introduced? 😀

General - Quick question - Do we have an authentication mechanism for GMS ? Currently it is open to everyone.

On our home screen, we're only seeing Datasets, Dashboards, and Charts - none of the other asset types (Pipelines, Glossary Terms, etc.). Has anyone experienced this before?

I just noticed after ingesting BigQuery metadata and usage, there's Lineage! 🪄 Is this based on the query log attributes from BigQuery that list upstream and downstream relations?

Hey team, I’ve updated the DataHub to 0.8.16. Whenever I visit the page, the order of entities starts with “_Datasets, Charts, Dashboards_” then it’s re-arranged to “_Datasets, Dashboards, Charts_”. Is it possible to define the ordering before showing any content in the UI? I’ve attached the screenshots.

Hi team, is there any way to put newlines / any other formatting e.g bullet list in glossary terms description? Is markdown support for glossary on the roadmap?

datahub has not rule for normal user or new user (I have setup authen via AD) . Normal user login can view all dataset or dashboard. I think new user donot accept to view it after has been added policy.

Hey, when we are listing datasets, the “name” is actually used as an identifier (which have ugly values on our side). Could we have some extra properties available there, like

title

?

Demo breaks with a white page: https://demo.datahubproject.io/tasks/urn:li:dataJob:(urn:li:dataFlow:(airflow,datahub_an[…]job_lineages_to_snowflake)/Pipeline?is_lineage_mode=false

renderPreview = (_: PreviewType, data: DataFlow) => {
        const platformName = data.orchestrator.charAt(0).toUpperCase() + data.orchestrator.slice(1);
        return (
            <Preview
                urn={data.urn}
                name={data.info?.name || ''}
                description={data.editableProperties?.description || data.info?.description}
                platformName={platformName}
                platformLogo={getLogoFromPlatform(data.orchestrator)}
                owners={data.ownership?.owners}
                globalTags={data.globalTags}
            />
        );
    };

it appears

orchestrator

is undefined.

Hi, team, first, I clicked on the foreign key and it showed the foreign key relationship below, then I clicked on

Edit Description

or

Add Description

and it showed up like this, which looked very strange

Hi team, to customise JAAS configuration for LDAP login, do we have to rebuild the datahub-frontend image? Or is there any way to update the conf via Helm values?

Hey 👋 We are trying to add some features from this project into our project. The way we are trying is: we keep our UI but add calls to DataHub’s GMS (graphql). So far so good. I’m working adding documentation and links to a dataset. In the original UI, there’s a check to make sure there’s an authenticated user. We don’t need that since all our backend call are checking the auth cookie. I just bypass this check. But without that, the link is added by an “unknown” user. Fair enough. What can I do here?

Quick Question - the demo environment present https://demo.datahubproject.io/ is using which version of code

Hi all - wondering if the UI is supposed to show any info related to data freshness for a given dataset, i.e last time this dataset was updated

I'm also wondering how to get an entity to show up under "Related Entities" in the glossary terms page. I added a glossary term to a dataset, but the dataset is not showing up under related entities when i view the glossary term