One question : Is it possible to observe editing history of descriptiong of one column? For exmaple, db is updated to description 'A' at 00:00. user1 changes it to 'B' at 01:30. user2 changes it to 'C' at 05:00. Then, what I can observe from ui after next update is : description is 'C' and original : 'A'. What I wonder is to track all changing history : not only changing 'C' but alsoo changing 'B' at 01:30 is expected to be observed in ui. Does datahub provide this now?

Hi guys, After applying pinned posts, I think we should do a minor change on the UI. Specifically, two div class of

Pinned Post

and

Domains

overlap each other. My thought is removing

margin-top

in

DomainsRecomendationContainer

config. Does it look good? cc @green-football-43791

const DomainsRecomendationContainer = styled.div`
    margin-top: -48px;
    margin-bottom: 32px;
    max-width: 1000px;
    min-width: 750px;
`;

p/s: added a PR for this case. https://github.com/datahub-project/datahub/pull/6246

Hi! it seems there is a bug in UI (0.9) 1. go to /settings/identities/users 2. try to set roles to users in the right side of the screen (read \ edit \ admin) 3. click on page 2 (in pagination) 4. try to set roles to users (read \ edit \ admin) -- get "no data" instead of roles

Hi All! Is there a way to supress an aspect on the entity display in a low code way? e.g. hide schema or stats aspect for dataset in the display?

Hi there, I’ve just realize a bug on WebUI in ingestion page. The mongodb have correct icon but wrong name (postgres). Here is my screenshot

Hi. Are there any plans to enrich Glossary text formatting capabilities? Ideally we'd like to have tables like in Confluence, there are a very neat way to store information

Hi, How can i delete specific bigquery dataset following guide only show delete all dataset of bigquery https://datahubproject.io/docs/how/delete-metadata/#delete-all-bigquery-datasets-in-the-prod-environment but i want to delete specific dataset

Another question!! Please let me know if there is a setting to soft delete from the data hub when a table or column in BigQuery is deleted.

Hello All, Is there any way to customize the dashboard properties

Good afternoon everyone, so I did an addition of a column to a Hive table via Spark (using beeline inside my Spark container and then connecting to my Hive instance). Everything was executed successfully and the column was added. The thing is that the corresponding task shown in Datahub seem to be a bit bugged. The initial look of the lineage is a bit strange (as 4 tasks appear, 2 before and 2 after the HDFS datasets), but the problem comes when I try to move any element shown (second image).

Hello everyone. Can we see assertions in search results via GUI?

Hi all. Is there a way to see editableDatasetProperties on the UI. I see them in the api call but the UI only shows datasetProperties. Specifically looking for the lastModified to be visible.

Mmm any way to remove role from user from reader role to no role? Reader role is too permissive and I do not want the user to have access to all metadata in datahub

This seems to only happen when I use the Python SDK to emit metadata: There is no left padding for the fields in the UI

image.png

Hi all. Just a quick check. Are we able to add, delete or change linages between datasets via UI? If not, any intention to include it in the near future?

Hi all, how do you remove terms from their current term group, I can’t see an option to do this via the UI?

Hi, are there still plans to enable CSV ingestion via the UI? I can see it in the roadmap - any clues on a delivery date, it is something my data governance colleagues are very keen on to help our business stakeholders engage with DataHub easier.

Hi Team, Is there any possibility to enhance UI changes with Dataset, as per our need and deploy the changes to see runtime details?

Hi guys. Am a able to cancel Scheduling of an exhiting Ingestion that's already on Schedule from the UI? I don't see such option, I'm only seeing changing the schedule, not removing it

Hi @green-football-43791, @mammoth-bear-12532 For one of our business use cases, we would like to display both the default Dataset name (DatasetProperties -> Name field) and its associated display name (EditableDatasetProperties -> Name field) in the Dataset summary page. We would like to follow a priority order as described below in determining which name to display. ◦ When no display name (no EditableDatasetProperties' name field exists), display the DatasetProperties aspect's Name ▪︎ If there is no DatasetProperties aspect's Name, then display URN ◦ When display name exists (EditableDatasetProperties aspect's Name field exists), show both display & DatasetProperties aspect's Name. ◦ We would like to show them in the same dataset title section - beside each other, with display name displayed in the larger font size as today and the DatasetProperties aspect's Name displayed in a slightly smaller font - either below it or to its right. ◦ Please note that that display name will be editable for owners (PR #6171 for this was previously sent and is in review) while DatasetProperties Aspect name will not be editable from the UI. ▪︎ If there is no DatasetProperties aspect's Name, then display URN Enclosing a sample screenshot of this would look like for your review. Would like to seek your thoughts and if the above is agreeable, we could work on implementing it at our end and submit another PR to upstream Datahub. Please advise. Please let me know if there are any questions. @rhythmic-agent-54913

Hi, we are currently testing the Great Expectations DataHub Integration for one of our use cases and were wondering what and how to populate the subtab Tests in the DataHub UI. Can someone elaborate on this? We are using DataHub v0.8.43

Hello Team, did anybody enconter this before, when running yarn run start. 'BROWSER' is not recognized as an internal or external command,

Hello we would like to use oidc in the frontend. We receive the following error message after we want to perform the login:

13:45:19 [application-akka.actor.default-dispatcher-20] ERROR controllers.AuthenticationController - Caught exception while attempting to redirect to SSO identity provider! It's likely that SSO integration is mis-configured
org.pac4j.core.exception.TechnicalException: java.net.SocketTimeoutException: connect timed out
	at org.pac4j.oidc.config.OidcConfiguration.internalInit(OidcConfiguration.java:136)
	at org.pac4j.core.util.InitializableObject.init(InitializableObject.java:20)
	at auth.sso.oidc.custom.CustomOidcClient.clientInit(CustomOidcClient.java:21)
	at org.pac4j.core.client.IndirectClient.internalInit(IndirectClient.java:58)
	at org.pac4j.core.util.InitializableObject.init(InitializableObject.java:20)
	at org.pac4j.core.client.IndirectClient.getRedirectAction(IndirectClient.java:93)
	at org.pac4j.core.client.IndirectClient.redirect(IndirectClient.java:79)
	at controllers.AuthenticationController.redirectToIdentityProvider(AuthenticationController.java:253)
	at controllers.AuthenticationController.authenticate(AuthenticationController.java:87)
	at router.Routes$$anonfun$routes$1.$anonfun$applyOrElse$9(Routes.scala:500)
	at play.core.routing.HandlerInvokerFactory$$anon$8.resultCall(HandlerInvoker.scala:147)
	at play.core.routing.HandlerInvokerFactory$$anon$8.resultCall(HandlerInvoker.scala:146)
	at play.core.routing.HandlerInvokerFactory$JavaActionInvokerFactory$$anon$3$$anon$4$$anon$5.invocation(HandlerInvoker.scala:112)
	at play.core.j.JavaAction$$anon$1.call(JavaAction.scala:128)
	at play.mvc.Action.lambda$call$0(Action.java:89)
	at java.base/java.util.Optional.map(Optional.java:265)
	at play.mvc.Action.call(Action.java:81)
	at play.http.DefaultActionCreator$1.call(DefaultActionCreator.java:33)
	at play.core.j.JavaAction.$anonfun$apply$8(JavaAction.scala:188)
	at scala.concurrent.Future$.$anonfun$apply$1(Future.scala:659)
	at scala.util.Success.$anonfun$map$1(Try.scala:255)
	at scala.util.Success.map(Try.scala:213)
	at scala.concurrent.Future.$anonfun$map$1(Future.scala:292)
	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:33)
	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:33)
	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:64)
	at play.core.j.HttpExecutionContext$$anon$2.run(HttpExecutionContext.scala:77)
	at play.api.libs.streams.Execution$trampoline$.execute(Execution.scala:70)
	at play.core.j.HttpExecutionContext.execute(HttpExecutionContext.scala:69)
	at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:72)
	at scala.concurrent.impl.Promise$KeptPromise$Kept.onComplete(Promise.scala:372)
	at scala.concurrent.impl.Promise$KeptPromise$Kept.onComplete$(Promise.scala:371)
	at scala.concurrent.impl.Promise$KeptPromise$Successful.onComplete(Promise.scala:379)
	at scala.concurrent.impl.Promise.transform(Promise.scala:33)
	at scala.concurrent.impl.Promise.transform$(Promise.scala:31)
	at scala.concurrent.impl.Promise$KeptPromise$Successful.transform(Promise.scala:379)
	at scala.concurrent.Future.map(Future.scala:292)
	at scala.concurrent.Future.map$(Future.scala:292)
	at scala.concurrent.impl.Promise$KeptPromise$Successful.map(Promise.scala:379)
	at scala.concurrent.Future$.apply(Future.scala:659)
	at play.core.j.JavaAction.apply(JavaAction.scala:189)
	at play.api.mvc.Action.$anonfun$apply$2(Action.scala:95)
	at play.api.libs.streams.StrictAccumulator.$anonfun$mapFuture$4(Accumulator.scala:181)
	at scala.util.Try$.apply(Try.scala:213)
	at play.api.libs.streams.StrictAccumulator.$anonfun$mapFuture$3(Accumulator.scala:181)
	at scala.Function1.$anonfun$andThen$1(Function1.scala:57)
	at play.api.libs.streams.StrictAccumulator.run(Accumulator.scala:216)
	at play.core.server.AkkaHttpServer.$anonfun$runAction$4(AkkaHttpServer.scala:436)
	at akka.http.scaladsl.util.FastFuture$.strictTransform$1(FastFuture.scala:41)
	at akka.http.scaladsl.util.FastFuture$.$anonfun$transformWith$3(FastFuture.scala:51)
	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:64)
	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:55)
	at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:92)
	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:85)
	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:92)
	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41)
	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:49)
	at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
	at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
	at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
	at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
Caused by: java.net.SocketTimeoutException: connect timed out
	at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
	at java.base/java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:412)
	at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:255)
	at java.base/java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:237)
	at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
	at java.base/java.net.Socket.connect(Socket.java:609)
	at java.base/sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:305)
	at java.base/sun.net.NetworkClient.doConnect(NetworkClient.java:177)
	at java.base/sun.net.www.http.HttpClient.openServer(HttpClient.java:508)
	at java.base/sun.net.www.http.HttpClient.openServer(HttpClient.java:603)
	at java.base/sun.net.www.protocol.https.HttpsClient.<init>(HttpsClient.java:266)
	at java.base/sun.net.www.protocol.https.HttpsClient.New(HttpsClient.java:373)
	at java.base/sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.getNewHttpClient(AbstractDelegateHttpsURLConnection.java:207)
	at java.base/sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1187)
	at java.base/sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1081)
	at java.base/sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:193)
	at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1592)
	at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1520)
	at java.base/sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:250)
	at com.nimbusds.jose.util.DefaultResourceRetriever.getInputStream(DefaultResourceRetriever.java:249)
	at com.nimbusds.jose.util.DefaultResourceRetriever.retrieveResource(DefaultResourceRetriever.java:201)
	at org.pac4j.oidc.config.OidcConfiguration.internalInit(OidcConfiguration.java:133)
	... 61 common frames omitted

The pod reaches azure to invoke the OIDC configuration. For this, a proxy had to be set. Our assumption is that this must also be set in the jvm. Is there a way to set the frontend these options http.proxyHost, http.proxyPort and http.nonProxyHosts.

FineGrainedLineage(
        upstreamType=FineGrainedLineageUpstreamType.FIELD_SET,
        upstreams=[fldUrn("bar3", "c2")],
        downstreamType=FineGrainedLineageDownstreamType.FIELD,
        downstreams=[fldUrn("bar", "c2")],
        confidenceScore=0.8,
        transformOperation="myfunc",
FineGrainedLineage(
        upstreamType=FineGrainedLineageUpstreamType.FIELD_SET,
        upstreams=[fldUrn("bar3", "c2")],
        downstreamType=FineGrainedLineageDownstreamType.FIELD,
        downstreams=[fldUrn("bar", "c2")],
        confidenceScore=0.8,
        transformOperation="myfunc",
FineGrainedLineage(
        upstreamType=FineGrainedLineageUpstreamType.FIELD_SET,
        upstreams=[fldUrn("bar3", "c2")],
        downstreamType=FineGrainedLineageDownstreamType.FIELD,
        downstreams=[fldUrn("bar", "c2")],
        confidenceScore=0.8,
        transformOperation="myfunc",

Hello Team , transformOperation is not displayed in UI for now ? is there any extra thing to configure this will be great feature to have

Hi How does datahub decide whether a column is nullable or not. We have various tables whose create table does not include nullable true but still datahub renders the columns as nullable PFB screenshot. datahub version: v0.8.45

Hi, is there any possibility to see how often a specific table is consumed ? Or is it just possible to see if a table is consumed ?

Is it just me or is the lineage from Tableau set up in reverse. I have a datasource used by a dashboard which is build up of a range of charts. So the hierarchy should be: Datasource -> Dashboard -> Charts. However, in DataHub they have swapped the charts and dashboard around. Is this a mistake or is there a reason i may have overlooked? A chart can only be part of one dashboard so it should always appear downstream from the dashbaord.

This is awesome! Good news!