Hi folks! I have issues running

datahub docker quickstart -f docker/quickstart/docker-compose-without-neo4j-m1.quickstart.yml

. GMS instances doesn’t seem to go healthy. I’m attaching the logs.

Hey everyone, I am using a DataHub which is extracting from a MSSQL, and I have the problem that all view_definitions are empty. I am just the user and don't have the rights to look at or change the settings, but maybe you guys know what the problem is so that I can create a ticket? Thanks in advance!

Hey im trying to import some tables manually and im wondering if im using tags correctly since they are not showing up:

{
  "proposedSnapshot": {
    "com.linkedin.pegasus2avro.metadata.snapshot.DatasetSnapshot": {
      "urn": "urn:li:dataset:(urn:li:dataPlatform:s3,controller-avrodata.node_state,DEV)",
      "aspects": [
        {
          "com.linkedin.pegasus2avro.dataset.DatasetProperties": {
            "customProperties": {
              "test": "SPLAT"
            },
            "name": "controller-avrodata.node_state",
            "description": "",
            "tags": [
              "Sample"
            ]
          }
        }
      ]
    }
  }
}

Hi Guys, I am trying to build datahub-frontend with the below command. ./gradlew datahub frontenddist -x yarnTest -x yarnLint Build gets jinxed at a certain point. I could see this error while executing FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory Thank you in advance for your kind suggestions.

Stateful ingestion for glossary terms Is it supported? I have my glossaries managed in the yml files in the git repo. Is there any way I could leverage stateful ingestion to get rid of the unused ones? What I would like to achieve is when I remove a term from yml and run my, let's say

datahub ingest -c recipes/glossaries/glossary_recipe.yml

, it also gets removed from the DataHub instance. I know I could probably somehow use graphQL for that but I am looking for simpler solution at the moment. Thanks!

Hi Team, this

DataJobInputOutput()

, is looking for fields

inputDatasets, outputDatasets

but these fields can only be set by deprecated functions,

setInputDatasets(), setOutputDatasets()

. Can you please let me know if this is a known issue, or am i doing something wrong?

Facing issues when trying to do

datahub docker quickstart

Error response from daemon: image with reference acryldata/datahub-upgrade:head was found but does not match the specified platform: wanted darwin/amd64, actual: linux/amd64
..............
Unable to run quickstart - the following issues were detected:
- quickstart.sh or dev.sh is not running

Anybody else see this?

Facing issue with gms. Kafka consumer group is always rebalancing and is kind of stuck. I saw a previous thread https://datahubspace.slack.com/archives/C029A3M079U/p1650921142481779?thread_ts=1650871366.562249&cid=C029A3M079U but no resolution. Here is the analysis done so far: ========================================================================= To process the 10 partitions, we are seeing 3 active kafka clients. For every group that is getting created, 2 clients are being assigned. Then the third client tries to join the group and the whole group is dissolved to re-balance. In the next group created, again we see only 2 clients and the third client becomes spoil sport, whole process repeats. Here is the simplified log showing the issue. Team, Can you help ?

Hi Team, We have certain entities emitted to Datahub initially under wrong env/cluster called PRD, instead of PROD. We tried to delete these entities as per the documentation given. We used delete command with option --env PRD, to delete all entities under the env PRD, but this doesn't work and it shows zero entities fetched. We also tried to delete one PRD entity using --urn <URN>, but even though it showed as "deleted" , the entity shows up while using GET on the same URN ( where as hard delete works on other entities with valid env like DEV, PROD etc). Could you please guide us on how to remove all the entities under and invalid env PRD

Hey, is it at all possible to customize how object names are shown in the frontend, i.e. to be [schema_name].[object_name]? The problem is that when two objects with the same name exists in different schemas, they show up in search results without any clue with regard to which schema or database they come from, i.e. when editing the data lineage: (I am just a user and can't make look deeper into the settings, but I would like to create a ticket if possible) Thanks a lot in advance.

heelo

hello

trying to install datahub on a e2 ubuntu instance

getting errors

write /var/lib/docker/tmp/GetImageBlob2162686560: no space left on device ... Unable to run quickstart - the following issues were detected: - elasticsearch is not present - broker is not present - datahub-frontend-react is not present - datahub-gms is not present

I have selected an m6i.xlarge instance with 4 cpu, 16 GM, 10GB volume

Hello, I'm trying to locally build and deploy DataHub to a dev server for testing. I went through the instructions for the build process step-by-step indicated on this page and after building using

./gradlew build

and installing the local datahub cli to my $PATH using the commands listed on the page, I am receiving an error indicating that I cannot run the quickstart. Command Attempted:

./gradlew quickstart

Location of Command Attempted:

/home/test/datahub

(datahub root directory) Error: * What went wrong: Task 'quickstart' not found in root project 'datahub'. If anyone could assist, I would appreciate it. I've followed the instructions so I'm unclear as to what I am missing.

Hi Team, Can we search using searchAcrossEntities graphQL to search for entities using domain ? Where can I find the list of fields on which the search can be applied

hi, I'm seeing

Failed to log in! An unexpected error occurred.

on a newly setup instance on kubernetes when trying to sign in with the default datahub user, I also don't see any logs in the /tmp/ directory, any suggestions? (the same deployment for a different instance is currently working, so not sure if I'm missing some setup? the elasticsearch, mysql, and kafka setup jobs already ran)

datahub docker quickstart

fails to start zookeeper

zookeeper                  | Command [/usr/local/bin/dub path /var/lib/zookeeper/data writable] FAILED !

Anyone else faced this issue before?

datahub --debug  delete --env PROD --entity_type dataset

[2023-03-02 16:57:30,991] DEBUG    {datahub.telemetry.telemetry:219} - Sending init Telemetry

[2023-03-02 16:57:31,096] DEBUG    {datahub.upgrade.upgrade:132} - server_config:{'models': {}, 'patchCapable': True, 'versions': {'linkedin/datahub': {'version': 'v0.10.0', 'commit': '64acf353fc75bb4555c7abe37520b9dcfac2b4f4'}}, 'managedIngestion': {'defaultCliVersion': '0.10.0', 'enabled': True}, 'statefulIngestionCapable': True, 'supportsImpactAnalysis': True, 'telemetry': {'enabledCli': True, 'enabledIngestion': False}, 'datasetUrnNameCasing': False, 'retention': 'true', 'datahub': {'serverType': 'quickstart'}, 'noCode': 'true'}

[2023-03-02 16:57:32,813] DEBUG    {datahub.telemetry.telemetry:248} - Sending telemetry for function-call

Failed to connect to DataHub server at <http://localhost:8080>. Run with datahub --debug delete ... to get more information.

[2023-03-02 16:57:34,141] DEBUG    {datahub.cli.cli_utils:237} - Failed to connect with 503 Server Error: Service Unavailable for url: <http://localhost:8080/config>

[2023-03-02 16:57:34,142] DEBUG    {datahub.telemetry.telemetry:248} - Sending telemetry for function-call

Anyone else faced this issue before?

image.png

image.png

version 0.10.0

image.png

After version 0.9.6.2 default log level has set to INFO. Was it made by purpose? How can I disable it? Both, cli and ingestion logs has flood of logs.

Hi team, We are experiencing an issue with the DataHub Demo Environment. When trying to access the following error is displayed. How can we solve this problem? https://demo.datahubproject.io/authenticate?redirect_uri=%2F

Hi team, I am trying to add a new entity to the datahub-graphql core. Starting out with something very basic. I was following the guide here: https://datahubproject.io/docs/datahub-graphql-core/. But after running the

./gradlew datahub-graphql-core:build

command without any errors, I don't see any new classes appear in

datahub-graphql-core\src\mainGeneratedGraphQL\java\com

. Any idea what the problem might be?