Hey guys waving from afar left I'm trying to consume custom data by defining my own JSONs, based on the sample MCEs and I'm taking a look at them to try to understand how the folder hierarchy work. I'm interested in

ChartSnapshot

, and

DashboardSnapshot

. Is there a way to have multi lever hierarchy folders, similar to

DatasetSnapshot

? In the

DatasetSnapshot

we can define the path as follows

"urn": "urn:li:dataset:(urn:li:dataPlatform:hive,SampleHiveDataset,PROD)",

I'm having trouble doing the same in the

ChartSnapshot

, and

DashboardSnapshot

. The way I'm trying to add sub folders structure is

"urn": "urn:li:dashboard:(metabase,compliance,chart_test)" - fails due to having 3 args

Am I missing something? Is it impossible to add more than two arguments to

urn:li:dashboard:

? Sorry for the dumb question. Thank you in advance 🙂

Hello everyone! Any plans on implementing foreign keys in tables? We're now writing a hyperlink into the column description, but that's not very convenient, a separate column would work better. Or did I miss some way to do it better?

Hi everyone, is there any way to view/query entities that have been manually modified via web ui?

Hello DataHub team, I’m not able to see the inner fields of Hive struct field like we can see the inner records of record in Kafka. You can find the related discussion here that I’ve asked for Kafka (Avro) integration. I think that @green-football-43791 would probably know the issue :)

Hi - can anyone tell me if its possible to embed an html link into the "Properties" field of an object. If i add a link, it simply renders the text on the UI and doesn't recognise it as a link. I also tried embedding <a href=".."> but that didn't work either:

Hi~ I need to resolve this issue https://github.com/linkedin/datahub/issues/3157

Hi! I reported this error when I used nginx to reverse proxy the Datahub UI

08:19:06 [application-akka.actor.default-dispatcher-9705] ERROR application -

! @7kohncad3 - Internal server error, for (GET) [/] -> play.api.UnexpectedException: Unexpected exception[ServerResultException: HTTP 1.0 client does not support chunked response] at play.api.http.HttpErrorHandlerExceptions$.throwableToUsefulException(HttpErrorHandler.scala:247) at play.api.http.DefaultHttpErrorHandler.onServerError(HttpErrorHandler.scala:176) at play.core.server.common.ServerResultUtils.validateResult(ServerResultUtils.scala:64) at play.core.server.akkahttp.AkkaModelConversion$$anonfun$convertResult$1.apply(AkkaModelConversion.scala:199) at play.core.server.akkahttp.AkkaModelConversion$$anonfun$convertResult$1.apply(AkkaModelConversion.scala:196) at play.core.server.common.ServerResultUtils.resultConversionWithErrorHandling(ServerResultUtils.scala:180) at play.core.server.akkahttp.AkkaModelConversion.convertResult(AkkaModelConversion.scala:219) at play.core.server.AkkaHttpServer$$anonfun$15.apply(AkkaHttpServer.scala:367) at play.core.server.AkkaHttpServer$$anonfun$15.apply(AkkaHttpServer.scala:365) at scala.concurrent.Future$$anonfun$flatMap$1.apply(Future.scala:253) at scala.concurrent.Future$$anonfun$flatMap$1.apply(Future.scala:251) at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:36) at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:55) at akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:92) at akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply(BatchingExecutor.scala:92) at akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply(BatchingExecutor.scala:92) at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72) at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:91) at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41) at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:49) at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) Caused by: play.core.server.common.ServerResultException: HTTP 1.0 client does not support chunked response at play.core.server.common.ServerResultUtils.validateResult(ServerResultUtils.scala:63) ... 21 common frames omitted 081906 [application-akka.actor.default-dispatcher-9708] ERROR application - ! @7kohncakc - Internal server error, for (GET) [/favicon.ico] -> play.api.UnexpectedException: Unexpected exception[ServerResultException: HTTP 1.0 client does not support chunked response]

Hi, after upgrading to 0.8.11.0 (ingestion pip library and all servers), Non-alphabetic chars are all displayed as

???

How can I fix it?

do we have a ETA on when the RBAC update will be released? Wanted to merge the updates into my implementation if it is due very soon..

Double click the node.

im using Keycloak OIDC to login, and wanted to try out the JIT provisioning feature. right now, if i enable the groups claim, can i ask if there is any indication in the UI that indicates that it is working as intended? Am i supposed to be able to see the groups of the logged in person or something? im referring to the settings below:

# Optional Provisioning Configs
# AUTH_OIDC_JIT_PROVISIONING_ENABLED=true
# AUTH_OIDC_PRE_PROVISIONING_REQUIRED=false
# AUTH_OIDC_EXTRACT_GROUPS_ENABLED=true
# AUTH_OIDC_GROUPS_CLAIM=groups

Hello everyone. Looks like a new version of UI was just released, I have few questions. 1. I can't see description of the dataset anywhere on the dataset page. Where can I find it? 2. Something is wrong with the description of fields, looks like Markdown is broken. Details in thread.

was a little surprised that in the github PR notes for RBAC M1, it was mentioned that

VIEW_ANALYTICS

can be used to restrict analytics panel to select users. I thought M1 only has edit-related policies. But its a good surprise!🥰

Hello Team , I would like to see all the users that are in datahub instance. where can I see them in UI ?

Would it be possible to implement the ability to use HTTPS in addition to HTTP scheme in https://github.com/linkedin/datahub/blob/master/datahub-frontend/app/controllers/Application.java#L110?

Hello! Are there any plans on implementing markdown for Terms description? Plain text has too many limitations 😞

Also can't find where description of nodes is shown. Can only see the description of terms in the UI

Hi all, After doing a search, there’s the filter button and the user can filter by any facet (platform and origin). But it’s possible to select a combination with no result. In this case, after applying the filter, the user will see no result (obvious) but the filter options are updated, removing the previous selected options and making it impossible to unselect. I can’t reproduce it in the demo because there’s just one origin there. Here’s a recording from our instance. Note that there’s just one result for “Origin: Ei”. I know this only result is a S3, so I filtered by Ei and something else.

Hi community! My colleague is asking if she can attach business glossary terms to fields in the datasets, and I first told her no, but it's ticked in the roadmap so I was wondering if this feature is either already there (and I cannot find it) or on its way?

Hey guys, I am trying to hide some entities from the main screen (e.g. Pipelines, Feature tables, etc..). Could you guide me on how to do this best?

Hello there! Started to play around with Datahub some days ago and so far it seems great! One thing I’m wondering about is the theming, do you all fork, add the themes and then deploy all the docker images to your own registry? It just seems kind of complicated to do some UI customizations. If you do deploy all the docker images yourself, do you use the “docker compose push” and that’s it? Or do you have any examples to make it as slim as possible 🙂 any ideas or examples would be much appreciated. PS: I’ve read the theme thread here in slack, the documentation and been looking at the code before asking here :P

Hi, I have some question What does it mean “Queries Section” ? How to add / ingest to “Queries Section” ? Thanks :)

Hi, is it or will it be possible to see the full lineage for the entire data platform in Datahub? I can imagine it will not be helpful when there’s too many “data products” but for small/medium sized companies I think this is kind of a nice feature.

Hey team, “e” letter seems weird in the brand-new UI. It has some scars inside :)

hey all.. might eb good to make the font size in the profiling responsive:

Hi Guys /browse/dataset on datahub ui v_0_8_12 results in 500 error code. On investigating ES logs got below error.

[SearchRequest{searchType=QUERY_THEN_FETCH, indices=[datasetindex_v2], indicesOptions=IndicesOptions[ignore_unavailable=false, allow_no_indices=true, expand_wildcards_open=true, expand_wildcards_closed=false, allow_aliases_to_multiple_indices=true, forbid_closed_indices=true, ignore_aliases=false, ignore_throttled=true], types=[], routing='null', preference='null', requestCache=null, scroll=null, maxConcurrentShardRequests=5, batchedReduceSize=512, preFilterShardSize=128, allowPartialSearchResults=true, localClusterAlias=null, getOrCreateAbsoluteStartMillis=-1, ccsMinimizeRoundtrips=true, source={"size":0,"query":{"bool":{"filter":[{"range":{"browsePaths.length":{"from":1,"to":null,"include_lower":false,"include_upper":true,"boost":1.0}}}],"must_not":[{"term":{"removed":{"value":"true","boost":1.0}}}],"adjust_pure_negative":true,"boost":1.0}},"aggregations":{"groups":{"terms":{"field":"browsePaths","size":2147483647,"min_doc_count":1,"shard_min_doc_count":0,"show_term_doc_count_error":false,"order":[{"_count":"desc"},{"_key":"asc"}],"include":"/.*","exclude":"/.*/.*"},"aggregations":{"allPaths":{"terms":{"field":"browsePaths","size":2147483647,"min_doc_count":1,"shard_min_doc_count":0,"show_term_doc_count_error":false,"order":[{"_count":"desc"},{"_key":"asc"}]}}}}}}}]
org.elasticsearch.transport.RemoteTransportException: [node-5-dn][:9300][indices:data/read/search[phase/query]]
Caused by: org.elasticsearch.search.aggregations.MultiBucketConsumerService$TooManyBucketsException: Trying to create too many buckets. Must be less than or equal to: [10000] but was [10001]. This limit can be set by changing the [search.max_buckets] cluster level setting.

We have not defined the parameter so the default value is 10000. Please suggest.

Hi community! Having a peculiar problem. It seems like DataHub fails to create groups based on the group claim from Azure AD, and I'm guessing it could be because our users are members of a lot (A LOT!) of groups, some times > 200 and often >150. It seems like (from the logs) that it's the MAE-consumer that cannot keep up in this case so the frontend throws this error. Subsequently it works, but I'm worried this will not scale so I have disabled the group claim in Azure AD temporarily. Have any of you seen this before?

Hello, DataHub community! We’re looking for feedback on how DataHub users typically navigate the search experience. Submit your response with emoji reactions & feel free to add context/notes in the tread! When I enter a search term, I am usually looking for results… • 🅰️ across entity types (Datasets, Pipelines, Dashboards, etc.) • 🅱️ within a single entity type

Is it possible to add OIDC (OKTA) without actually building the images yourself? Like passing the environment variables to the “datahub docker quickstart” command?

Hello everyone, any pointer or help is highly appreciated around cypress automation testing for regression test cases with SSO in place. problem statement - we are developing an automated regression test suit around the datahub implementation, however we are blocked now with sso implementation in higher environment. The organization does not allow grant_type password - hence we could not use it to generate the id_token for an user and set it in local store/cookie ( note sure whether this could be the right approach even, if so is this the only approach). Thanks in advance