@bumpy-keyboard-50565 -- what is the best way to add a new aspect to Dataset (say wanted to capture/manage operational metrics of the dataset). I see one of you pointed to this link (https://github.com/linkedin/datahub/blob/master/docs/how/entity-onboarding.md). does this requires updating the .pdsc file or requires any development? does UI reflects the aspect automatically or do we need any custom development from UI side

Last modified field for upstream and downstream datasets are not showing in the front-end for the sample data ingested to datahub. Am I missing something?

Hi Team, I want to host the datahub frontend in HTTPS. But I couldn't find the path for placing the SSL certificate. Could you please help to implement it ? I am new to frontend development.

Hi Team, Has anyone implemented Google SSO Login in Datahub ? I am a python developer and have implemented the SSO with Flask. But finding it difficult to implement in Datahub. Could some one please provide some inputs to do that.

Hi, I want to run Datahub on a basepath. Currently, I'm using the docker-compose file. Is there a way to rebuild the Docker image of frontend or configure it to run on a basepath. I checked this https://github.com/linkedin/datahub/blob/master/docker/frontend/Dockerfile but can't figure out how the static files are being generated and copied to the Docker image.

Hi! Do we know what the fate of DatasetPropertiesContainer will be? I see that it’s currently dead code.

Hello, I was ingesting some kafka topics, and so, using: "platformSchema":{"documentSchema": schema}, everything works as expected, but on the front end, it appeared as such: I am using latest master from https://github.com/linkedin/datahub. Nothing too crazy appeared in the javascript console (just some 404) Am I doing something wrong / is it the intended behaviour? I was expecting to have all first level fields visible when viewing as a table.

I'm making some tweaks to the datahub frontend and getting slightly confused about the view models... It looks like the search results view and the header on the dataset detail view both use

datahub-web/@datahub/data-models/addon/entity/dataset/dataset-entity.ts

This class has an

entity

property. In the search results view, this property is populated with the dataset, as expected. In the header on the dataset detail view, this property appears to be populated with an object containing a

dataset

property which as the actual dataset. This seems to violate the type annotation, and means that most of the getter properties fall back to null/empty values. I haven't changed anything about this page so I'm not sure why this property isn't being set correctly, or if this is expected and I'm missing something about how it works. Any advice from the front-end developers?

For data-portal, I defined a dependency in

package.json

, but when building frontend, I cannot find this dependency in

node_modules

, anything else I need to do to add new dependencies?

Hey LinkedIn team, there is an issue on the front-end, when there is a self-referencing datasets in relationship tab. If I select this certain dataset, and click on it again, the page will freeze. If I select this certain dataset, and click on something else, it will not. Please let me know if this is an issue I need to submit on github. Thanks.

Hi! We get a bit frustrated with the test run at build time for the frontend when doing quick iterations, so we’re thinking about changing https://github.com/linkedin/datahub/blob/5a5c6863fa1918f2b27c2c0ee2359a3aa5fff62d/datahub-web/build.gradle#L51 into

task emberBuild(type: YarnTask, dependsOn: [execEmber, emberWorkspaceTest]) {

which would allow us to do

-x emberWorkspaceTest

when needed. Is this something the public repo would benefit from?

hi all, I tried out the datahub quickstart, but i believe the default datahub account is more like an admin account. I'm looking for the end-user perspective when accessing the catalog, are they able to interact with the published data dictionary in the form of posting comments, feedback etc?

Hi All, I tried typing in the search bar but there is no autocomplete suggestion. I checked on Chrome dev tool, there were no network call at all when I type. Is that autocomplete search disabled by default or is there anyway to enable it. I have tried to search the documentation but no lock. Am I missing something?

Hi Datahub team, on the dataset status tab (where deprecation is), at the bottom of the page, there is such error displayed, I checked network in Chrome dev tools, there is no 4XX from API. What property is it mentioning? Thanks.

We have a new Datahub instance (based on 0.6.1) and can’t seem to find the “Edit profile” button on the profile page anymore. Has it been removed, or do we have something odd in our setup?

I got a question wrt. datahub-frontend (The docker.) If I first pull:

docker pull linkedin/datahub-frontend

and then run:

docker run -it --env DATAHUB_SECRET=test --env DATAHUB_PLAY_MEM_BUFFER_SIZE=10mb --env DATAHUB_APP_VERSION=1.0 <http://docker.io/linkedin/datahub-frontend:latest|docker.io/linkedin/datahub-frontend:latest>

I’m getting the following error:

4) Error injecting constructor, java.lang.NumberFormatException: null
  at controllers.api.v1.Dataset.<init>(Dataset.java:19)
  while locating controllers.api.v1.Dataset
...
Caused by: java.lang.NumberFormatException: null

Is this normal? (Due to the fact that I haven’t set up the GMS connection yet?) Just to be sure that I’m not debugging this for nothing 🙂

Hello, does DataHub require NodeJS to be pre-installed in the dev machine?

When attempting to build from source on the master git branch, HEAD commit: b3dfa1e4

2056 | Change dataset lineage pendulum animation component (#2061)

I get the following gradle error:

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':datahub-web:emberBuild'.
> Process 'command '/home/pedro/dev/datahub/datahub-web/build/yarn/yarn-v1.13.0/bin/yarn'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at <https://help.gradle.org>

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See <https://docs.gradle.org/5.6.4/userguide/command_line_interface.html#sec:command_line_warnings>

BUILD FAILED in 21s
125 actionable tasks: 115 executed, 10 up-to-date

$ yarn install
yarn install v1.22.10
[1/4] Resolving packages...
[2/4] Fetching packages...
info fsevents@2.1.2: The platform "linux" is incompatible with this module.
info "fsevents@2.1.2" is an optional dependency and failed compatibility check. Excluding it from installation.
info fsevents@1.2.11: The platform "linux" is incompatible with this module.
info "fsevents@1.2.11" is an optional dependency and failed compatibility check. Excluding it from installation.
[3/4] Linking dependencies...
warning "workspace-aggregator-4a03fcd2-2d3d-413d-80bf-d5ee1a3df7ab > @nacho-ui/core > @fortawesome/ember-fontawesome > rollup-plugin-node-resolve@5.2.0" has unmet peer dependency "rollup@>=1.11.0".
[4/4] Building fresh packages...
$ chmod +x ./node_modules/husky/husky.js;node ./node_modules/husky/husky.js install
husky > Setting up git hooks
husky > Done
husky > Like husky? You can support the project on Patreon:
husky > <https://www.patreon.com/typicode> 🐕
Done in 141.62s.

cc @green-football-43791 it's easier to read

@big-carpet-38439 just wanted to check if we are planning to run both apps react and ember in parallel? Or just 1 app at a time? like running ember application until react app is ready and when react is ready then switch completely to react app.

Is there a way to allow manual edit of dataset schema info and/or relationship/lineage info, from DataHub UI? 🤔

similar questions for chart and dashboard. could current UI display these entities? 🤔

Hello! Please could i ask you to explain me how to create data lineage by field ? i create 2 tables {"snapshot": {"aspects":[{"com.linkedin.schema.SchemaMetadata":{ "fields":[ { "fieldPath":"foo", "description":"xxx", "nativeDataType":"string", "type":{"type":{"com.linkedin.schema.StringType":{}}} }, ]}}], "urn":"urnlidataset:(urnlidataPlatform:foo,xxx,PROD)"}} ----- than join "upstreams":[ { "auditStamp":{ "time":0, "actor":"urnlicorpuser:fbar" }, "dataset":"urnlidataset:(urnlidataPlatform:foo,barUp,PROD)", "type":"TRANSFORMED"

trying with the new React UI, getting exception while doing searches,

Exception while fetching data (/search) : java.lang.RuntimeException: Failed to execute search: entity type DATASET, query demand, filters: [], start: 0, count: 10

errors logged:

datahub-frontend-react    | 06:22:24 [Thread-233] WARN  n.g.e.SimpleDataFetcherExceptionHandler - Exception while fetching data (/search) : java.lang.RuntimeException: Failed to execute search: entity type DATASET, query published-db.published_demand, filters: [], start: 0, count: 10
datahub-frontend-react    | java.util.concurrent.CompletionException: java.lang.RuntimeException: Failed to execute search: entity type DATASET, query published-db.published_demand, filters: [], start: 0, count: 10
datahub-frontend-react    |     at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273)
datahub-frontend-react    |     at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280)
datahub-frontend-react    |     at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1592)
datahub-frontend-react    |     at java.lang.Thread.run(Thread.java:748)
datahub-frontend-react    | Caused by: java.lang.RuntimeException: Failed to execute search: entity type DATASET, query published-db.published_demand, filters: [], start: 0, count: 10
datahub-frontend-react    |     at com.linkedin.datahub.graphql.resolvers.search.SearchResolver.lambda$get$1(SearchResolver.java:62)
datahub-frontend-react    |     at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1590)
datahub-frontend-react    |     ... 1 common frames omitted

Hi guys, I ingested some test data, but UI, I get this when trying to view them:

Hi All, I'm new to DataHub and have a question regarding the Properties tab in the UI. How should data be made available on that tab? I see in the Demo that a "No Data" message is displayed for all of the datasets. Thanks!

Hello all, has anyone succesfully configured OIDC authentication using azure AD?

Hi guys, I am new to DataHub and we are building a POC in our organisation. A question: is there a possibility to visualise dataset lineage as a graph in the UI (similarly like in dbt)?

Hi all, i have a question, how do we enable or add username/password for authentication in the UI? Does it supported?