I see that

ENABLE_EMBER

is removed from dockerfile, is ember app still available?

Hi All, i have a question regarding lineage section on the datahub-UI, i'll provide the detail on this message thread

Hi. A question about theming. As I understand it, in order to customize the theme one needs to rebuild the frontend from source? Is there any way I've missed that one can customize a theme without rebuilding? As in just placing some assets and a config file in some folder? If not, is this something that anyone would find useful. The reason i'm asking is that we are striving to not have to maintain our own fork that has to be kept in sync indefinitely.

Would it make sense to change this line https://github.com/linkedin/datahub/blob/master/datahub-web-react/src/app/entity/dashboard/profile/DashboardHeader.tsx#L39 to

photoUrl: owner.owner.editableInfo?.pictureLink || '',

Same with ChartHeader? Because I’m getting an error in the UI:

Uncaught (in promise) TypeError: Cannot read property 'pictureLink' of null

pointing to that line.

I wonder if there’s a small bug somewhere related to tags. More in thread

Another tag related question. Is the the “Applied to” field in the Tag-view in the UI supposed to take into consideration applications to schema fields? I guess Schema Fields aren’t entities, but….

<!here> the Lineage Graph Explorer is now available in the React app for you to use today! It allows you to visually explore the full graph of relationships between your entities. You can experiment with this feature on the demo site now. Check it out and let us know what you think!

Is it possible to have groups (urnlicorpGroup:X) as dataset owners already? Because I’m having some exceptions.

I’m trying to figure out why some of my datasets are throwing exceptions when rendering in the UI. Most seem to load correctly, but some throw a large series of exceptions, e.g.:

Exception while fetching data (/dataset/upstreamLineage/upstreams[0]/dataset/downstreamLineage/downstreams[1]/dataset) : java.lang.RuntimeException: Failed to retrieve entities of type Dataset

• Assuming my ingest code is correct, all referenced datasets should exist • I am able to query the problematic dataset via the REST API • I am able to load the referenced upstream in the UI (e.g. Loading up the

upstream[0]

dataset) • I checked the

datahub-frontend-react

logs and put the stack trace in the thread 👇 What are some good methods to investigate this?

Datahub doesn't offer the feature to view sample data for the tables, right? Or is this a new feature not mentioned in the Medium blog post?

@microscopic-receptionist-23548 I noticed that in the GMA ElasticSearch DAO we paginate on entities but not on groups: https://github.com/linkedin/datahub-gma/blob/master/dao-impl/elasticsearch-dao-7/src/main/java/com/linkedin/metadata/dao/browse/ESBrowseDAO.java#L72 Curious if you have any context as to why that was done- it forces the UI to handle group pagination in browse which could run into scalability issues for large & complex browse trees. Would it make sense to also pass along the pagination flag when fetching groups?

Hi, my thanks to the Datahub team for providing this software as opensource to the community. I am evaluating this product for my company's use. Using the quick start, I ingested some metadata in json using the rest API and then edited the description of some fields in the dataset. I then looked at the records in MySQL and saw that there were 2 records, EditableSchemaMetadata and SchemaMetadata. I then updated the SchemaMetadata by running a slightly edited version of the original json. I noticed that the UI edits stayed untouched. Does the frontend-UI always prioritize showing UI edits in the EditableSchemaMetadata over that of SchemaMetadata?

Also, I tried to add text and URL to the Documents tab in the UI, but it seems like the edits are not persisted to mySQL? I see no changes in the DB and refreshing the page just erases all the edits I made to Documents.

Can't we edit descriptions of datasets from UI? Also, are descriptions of datasets searchable? Column level descriptions are editable from the UI.

👋 We enabled google auth on our frontend instance. We can access our user pages (

/user/urn:li:corpuser:fredrik

) but can’t find ourselves through search. Is this by design?

Community question with regards to Authentication: Currently we only provide formal guidance for OIDC protocol to authenticate users. Are there other mechanisms that folks would like to see? For example • LDAP • SAML

Is there any plans to support markdown? for instance, column descriptions would look neater if we can split long descriptors into multiline

It would indeed make sense to be able to edit the description of a dataset from the UI, just like field description.

probably a super basic question....but for auth if I wanted to keep it super basic for v1 and have un/pw setup...does anyone have an example implementation of JAAS to set this up that would replace the default dummyloginmodule in jaas.conf? Admittedly java isn't my strong suite :)

Is there a hardcoded length limit on urns? We’re seeing some weird errors when loading datasets in the UI and it seems in the logs like the urns are clipped

I’m seeing odd behavior with v0.7.1 in which the gms is seeing requests that are too long:

2021-05-18 14:59:52.109:WARN:oejh.HttpParser:qtp544724190-13: URI is too large >8192

. This throws a

414

response and causes the frontend to error out:

Caused by: com.linkedin.r2.RemoteInvocationException: com.linkedin.r2.RemoteInvocationException: Received error 414 from server for URI <http://datahub-datahub-gms:8080/datasets>

. I am trying to figure out how to increase the logging to see the actual urls being requested. Any thoughts?

What determines if a dataset appears in the UI? Is it a record in elasticsearch and then lineage data is supplied from neo4j? I’m seeing records appear in the UI but can’t find the corresponding data in neo4j which is odd

Hi We see an intermittent exception in the UI.

Exception while fetching data (/dataset/downstreamLineage) : java.lang.RuntimeException: Failed to retrieve entities of type DownstreamEntityRelationships Exception while fetching data (/dataset/upstreamLineage) : java.lang.RuntimeException: Failed to retrieve entities of type UpstreamEntityRelationships

When browsning to a dataset, the exception pops up sometimes. Upon refreshing the page, the exception is gone and the dataset is shown. The exception originates from GMS, that it suddenly can’t connect to Neo4j.

Response status 500, serviceErrorMessage: org.neo4j.driver.exceptions.ServiceUnavailableException: Connection to the database failed

The default connection properties seems to be reasonable, so we are a bit lost here. Anyone seen this error or can give me a lead?

Hi all, does anyone know of a way to prevent users from adding metadata directly in the UI? Could it be configured somehow?

Hi, are there any plans to enrich the list of datasets (for example this view: https://demo.datahubproject.io/browse/dataset/prod/bigquery/bigquery-public-data/covid19_nyt) with further customizable fields and make them sortable?

Hi guys, what if I get an error while opening the FE on the browser? I use the quickstart. The error:

datahub-frontend-react  | Caused by: com.linkedin.r2.message.rest.RestException: Received error 500 from server for URI <http://datahub-gms:8080/corpUsers>

and few rows later:

datahub-mae-consumer   | Caused by: com.linkedin.r2.message.rest.RestException: Received error 500 from server for URI <http://datahub-gms:8080/corpUsers>

I already tried to nuke and retry. Any suggestion?

Hi guys, I got an error when I tried browsing dataset on UI. It showed nothing even though I have imported some datasets on it I have already nuked and done quickstart many times but still nothing appears P/S: I'm using 0.81 version, thanks for help

Hello everyone. I'm trying to create new categories on the main page of datahub. Would this require me to deploy 

DataHub-web-react

 and make changes there or is there another way? More info on what I'm trying to achieve: https://github.com/linkedin/datahub/issues/2633 Any guidance in the right direction would be very appreciated.

Hello Guys Please help me with a problem while integrating Datahub frontend with enterprise AD using OIDC. I doubt there is some issue with the claim rules. AD: Microsoft Windows 2016 Error:

09:15:41 [application-akka.actor.default-dispatcher-19] ERROR o.p.o.p.creator.OidcProfileCreator - Bad User Info response, error=invalid_token
09:15:41 [application-akka.actor.default-dispatcher-19] ERROR react.auth.AuthModule$2 - Unable to renew the session. The session store may not support this feature
09:15:43 [application-akka.actor.default-dispatcher-19] ERROR o.p.o.p.creator.OidcProfileCreator - Bad User Info response, error=invalid_token
09:15:43 [application-akka.actor.default-dispatcher-19] ERROR react.auth.AuthModule$2 - Unable to renew the session. The session store may not support this feature
09:15:45 [application-akka.actor.default-dispatcher-17] ERROR o.p.o.p.creator.OidcProfileCreator - Bad User Info response, error=invalid_token
09:15:45 [application-akka.actor.default-dispatcher-17] ERROR react.auth.AuthModule$2 - Unable to renew the session. The session store may not support this feature
09:15:47 [application-akka.actor.default-dispatcher-4] ERROR o.p.o.p.creator.OidcProfileCreator - Bad User Info response, error=invalid_token
09:15:47 [application-akka.actor.default-dispatcher-4] ERROR react.auth.AuthModule$2 - Unable to renew the session. The session store may not support this feature
09:15:49 [application-akka.actor.default-dispatcher-3] ERROR o.p.o.p.creator.OidcProfileCreator - Bad User Info response, error=invalid_token
09:15:49 [application-akka.actor.default-dispatcher-3] ERROR react.auth.AuthModule$2 - Unable to renew the session. The session store may not support this feature
09:15:50 [application-akka.actor.default-dispatcher-3] ERROR o.p.o.p.creator.OidcProfileCreator - Bad User Info response, error=invalid_token
09:15:50 [application-akka.actor.default-dispatcher-3] ERROR react.auth.AuthModule$2 - Unable to renew the session. The session store may not support this feature
09:15:52 [application-akka.actor.default-dispatcher-20] ERROR o.p.o.c.extractor.OidcExtractor - Bad authentication response, error=server_error
09:15:52 [application-akka.actor.default-dispatcher-17] ERROR application -
 ->

play.api.UnexpectedException: Unexpected exception[CompletionException: java.lang.RuntimeException: Failed to authenticate current user. Cannot find valid identity provider profile in session]
        at play.api.http.HttpErrorHandlerExceptions$.throwableToUsefulException(HttpErrorHandler.scala:247)
        at play.api.http.DefaultHttpErrorHandler.onServerError(HttpErrorHandler.scala:176)
        at play.core.server.AkkaHttpServer$$anonfun$2.applyOrElse(AkkaHttpServer.scala:363)
        at play.core.server.AkkaHttpServer$$anonfun$2.applyOrElse(AkkaHttpServer.scala:361)
        at scala.concurrent.Future$$anonfun$recoverWith$1.apply(Future.scala:346)
        at scala.concurrent.Future$$anonfun$recoverWith$1.apply(Future.scala:345)
        at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:36)
        at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:55)
        at akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:91)
        at akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply(BatchingExecutor.scala:91)
        at akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply(BatchingExecutor.scala:91)
        at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72)
        at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:90)
        at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:40)
        at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:43)
        at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
        at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
        at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
        at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
Caused by: java.util.concurrent.CompletionException: java.lang.RuntimeException: Failed to authenticate current user. Cannot find valid identity provider profile in session
        at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273)
        at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280)
        at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1592)
        at play.core.j.HttpExecutionContext$$anon$2.run(HttpExecutionContext.scala:56)
        ... 6 common frames omitted
Caused by: java.lang.RuntimeException: Failed to authenticate current user. Cannot find valid identity provider profile in session
        at react.auth.AuthModule.handleOidcCallback(AuthModule.java:154)
        at react.auth.AuthModule.access$100(AuthModule.java:36)
        at react.auth.AuthModule$2.perform(AuthModule.java:86)
        at react.auth.AuthModule$2.perform(AuthModule.java:79)
        at org.pac4j.play.CallbackController.lambda$callback$0(CallbackController.java:56)
        at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1590)
        ... 7 common frames omitted

# Optional OIDC configs
AUTH_OIDC_USER_NAME_CLAIM=SamAccountName
#AUTH_OIDC_USER_NAME_CLAIM_REGEX=([^@]+)
AUTH_OIDC_SCOPE=openid

Hello Guys, i am trying to implement SSO for the UI . while making a request. it makes a get call to the config url. i need it to make a POST call any suggestions ? @green-football-43791