I think this should be 11-20

Is there any url for viewing groups? I tried ingesting some users and groups into datahub. I can see users but cannot find the group

Can i ask how is user browsing activities being tracked right now? in Kibana i see that ES has a usagestats_v1 index, but its doesnt have any documents inside it. I assumed that activities are passed via kafka queue to ES, but it doesnt seem the case.

File "/usr/local/lib/python3.8/dist-packages/avrogen/avrojson.py", line 304, in _union_from_json

raise schema.AvroException('Datum union type not in schema: %s', value_type)

avro.schema.AvroException: ('Datum union type not in schema: %s', 'com.linkedin.common.Status')

Is there a way to disable lines between datasets in lineage graph view if they are connected via a task already? When we ingest our datasets we rely on pipeline tasks to detect downstream/upstream datasets so both a task as well as dataset[s] that it produces are downstream from it are recorded as downstream entities EX: in

dataset A

->

task 1

->

dataset B

graph we ingest both

task 1

and

dataset B

as downstream of

dataset A

. In dataset view we want to see

dataset B

in lineage TAB... but when we are looking at Lineage DAG we do not want to see a direct line

dataset A

->

dataset B

. only

dataset A

->

task 1

->

dataset B

. Is that possible? Today we are seeing both paths

On doing login with google got these errors a few times

Is there any way to edit user profile on UI ? I see this feature in this link https://datahubproject.io/docs/features#users. I am asking about Profile Editing Function. How can i edit profile ? Why don't we add a function like editing description of dataset ?

Hi … wanted understand how to see some sample data from the tables/views (may be top 1000 records)

@big-carpet-38439 i am tryint to implement SSO, i am making a get call to the sso , it is expecting a json response, but i want text/html response. any suggesttions on this

Hallo, I have an issue while loading a dataset. This issue occur for some dataset. I'm using Datahub version 0.7.1. Does anyone know about this issue?

datahub-frontend-react    | Caused by: com.linkedin.r2.RemoteInvocationException: Received error 414 from server for URI <http://datahub-gms>:<port>/datasets

Hi guys, friendly suggestion to maybe squeeze the results a bit better. Is not very aesthetic when the description is on multiple lines.

Maybe the scroll bar makes things a bit "ugly", but it's also the amount of height it takes.

Hi, seems columns are displayed in alphabetical order. How can I preserve original column orders stored in hive? For instance, the screenshot below shows columns are being displayed in a, b, c, ... order

Hi, I’m trying to connect Datahub Frontned with oidc Authentication, i followed the guide and successfully reach our oauth login ui, but after that i just throw this error and i couldnt log in. Anyone know why?

Caused by: java.util.concurrent.CompletionException: org.pac4j.core.exception.TechnicalException: com.nimbusds.jose.proc.BadJOSEException: Signed JWT rejected: Another algorithm expected, or no matching key(s) found
	at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273)
	at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280)
	at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1606)
	at play.core.j.HttpExecutionContext$$anon$2.run(HttpExecutionContext.scala:56)
	... 6 common frames omitted
Caused by: org.pac4j.core.exception.TechnicalException: com.nimbusds.jose.proc.BadJOSEException: Signed JWT rejected: Another algorithm expected, or no matching key(s) found
	at org.pac4j.oidc.profile.creator.OidcProfileCreator.create(OidcProfileCreator.java:138)
	at org.pac4j.oidc.profile.creator.OidcProfileCreator.create(OidcProfileCreator.java:40)
	at org.pac4j.core.client.BaseClient.retrieveUserProfile(BaseClient.java:113)
	at org.pac4j.core.client.BaseClient.getUserProfile(BaseClient.java:93)
	at org.pac4j.core.engine.DefaultCallbackLogic.perform(DefaultCallbackLogic.java:92)
	at react.auth.AuthModule$2.perform(AuthModule.java:84)
	at react.auth.AuthModule$2.perform(AuthModule.java:79)
	at org.pac4j.play.CallbackController.lambda$callback$0(CallbackController.java:56)
	at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
	... 7 common frames omitted

It would be good to have Lineage tab on the task page to show Input and output datasets. Makes navigation easier. e.g. On this page https://demo.datahubproject.io/tasks/urn:li:dataJob:(urn:li:dataFlow:(airflow,datahub_sn[…]e_ingestion,prod),ingest_usage_from_snowflake)/properties I know there is a pipeline but I have no way to find out what dataset are inputs and outputs.

Hi guys 👋🏾, I am new to DataHub and I’m wondering if someone is able to assist with the following error I’m getting in the UI? The error occurs when I click on Datasets, Pipeline, Dash etc.

Hi guys, quick question: How to hide Dashboard, Pipelines, etc. I want to hide menu without items

Hi guys, another quick question. In schema versioning, can we show the timestamp for that version? so naturally we want to know when the version is ingested

Is version history broken? I am on https://demo.datahubproject.io/dataset/urn:li:dataset:(urn:li:dataPlatform:snowflake,demo_pipeline.public.all_entities,PROD)/schema and was checking it but the comparison does not seem to be showing anything at all

As per https://github.com/linkedin/datahub/pull/2986#discussion_r684928025 I thought if some tag is applied via the UI and some via ingestion then those will be kept separate

flow_mce = models.MetadataChangeEventClass(
        proposedSnapshot=models.DataFlowSnapshotClass(
            urn=flow_urn,
            aspects=[
                models.DataFlowInfoClass(
                    name=dag_id,
                    externalUrl=flow_url,
                ),
                *tags_aspect
            ],
        )
    )

But I applied some tags via the UI and then sent some tags via the code and it seems to have overwritten what was applied via the UI. I went to the URL of the tag to check whether the UI was wrong and the tag was still present. But the tag was not applied to the Pipeline. Seems what tag is sent via airflow ingestion code will overwrite what is added via the UI

Hi - Are there any plans of integrating datahub with Apache superset? If yes what is the roadmap please.

It would be great if there are numbers on these tabs on entities. As people are adding docs for the datasets would like to focus on where we have lineages or queries. That would help in focusing our effort of adding docs to tables which we know have downstream dependencies or are being used more heavily

Bug in filters. I have marked glue sources as removed. But it is still showing up in filters

Hey team, I’ve seen some issues while rendering nested record in Avro schema. There are inner

Record

type like

buyable

field . They are rendered as

Struct

in the UI, however their fields are not seen. Maybe, we can show the nested record fields with foldable/unfoldable format. I think this feature is supposed to be handled with https://github.com/linkedin/datahub/pull/3079 but it seems that there are some missing parts. Schema in raw format:

{
  "type": "record",
  "name": "BuyNowEvent",
  "namespace": "com.xx.yy.events.BuyNowEvent",
  "doc": "This event is fired when a user clicks the \"Buy Now\" button",
  "fields": [
    {
      "name": "buyable",
      "type": {
        "type": "record",
        "name": "Buyable",
        "namespace": "com.xx.yy.events.common",
        "fields": [
          {
            "name": "type",
            "type": "string",
            "doc": "Type of buyable item; e.g. car, home"
          },
          {
            "name": "id",
            "type": "int",
            "doc": "ID of buyable item"
          }
        ]
      }
    },
    {
      "name": "createTime",
      "type": {
        "type": "long",
        "logicalType": "timestamp-millis"
      },
      "doc": "UNIX time of the event producer client when event occurred",
      "client_enrich": true
    },
    {
      "name": "sendTime",
      "type": {
        "type": "long",
        "logicalType": "timestamp-millis"
      },
      "doc": "UNIX time of the event producer client when event was sent",
      "client_enrich": true
    },
    {
      "name": "eventId",
      "type": "string",
      "doc": "Event id is a UUID generated by an event producer. Should be unique per event.",
      "client_enrich": true
    }
  ]
}

Is there a need from community on having "View in Bigquery" if dataset's platform = bigquery?

Is there pagination on Pipeline -> tasks page. As I am adding more lineages I am noticed for some of our bigger DAGs we have 18 tasks so far and pagination has not appeared. So I am starting to think pagination is not there. If not, it would be good to have pagination

This may be a dumb question that is answered in the docs and I just cannot find it but how do you create new users?

Hi everyone.. How do we resolve "Exception while fetching data (/browse/entities) : java.lang.RuntimeException: Failed to retrieve entities of type Dataset" in the UI ?

Hi.... Does the UI currently support viewing of glossary terms added at the field level. Seems to work ok at the dataset level, but not for field level glossary terms. Many thanks....

Hi Guys Please help me with this problem. After enabling LDAP authentication datahub frontend does not ask me to enter any credentials. Instead i am logged in as datahub user. I have set AUTH_JAAS_ENABLED=true and AUTH_OIDC_ENABLED=false https://datahubproject.io/docs/datahub-frontend#authentication

WHZ-Authentication {
  com.sun.security.auth.module.LdapLoginModule required
  userProvider="<ldap://host:389/dc=example,dc=com>"
  authIdentity="{USERNAME}"
  userFilter="(&(objectClass=person)(uid={USERNAME}))"
  java.naming.security.authentication="simple"
  debug="true"
  useSSL="false";
};