high-hospital-85984
02/03/2021, 7:06 PMnutritious-bird-77396
02/03/2021, 9:43 PMdataset(urn: "urn:li:dataset:(urn:li:dataPlatform:kafka,bar,PROD)") {
urn
platform {
urn
}
}
I get the error
"message": "The field at path '/dataset/platform' was declared as a non null type, but the code involved in retrieving data has wrongly returned a null value. The graphql specification requires that the parent field be set to null, or if that is non nullable that it bubble up null to its parent and so on. The non-nullable type is 'DataPlatform' within parent type 'Dataset'",
even though kafka
is available in the dataPlatforms
curl '<http://localhost:8080/dataPlatforms/kafka?aspects=List(com.linkedin.dataplatform.DataPlatformInfo)>' -H 'X-RestLi-Protocol-Version:2.0.0' -s | jq
{
"name": "kafka",
"dataPlatformInfo": {
"name": "kafka",
"type": "MESSAGE_BROKER",
"datasetNameDelimiter": "."
}
}
Am i missing something?mammoth-bear-12532
bland-garden-89536
02/10/2021, 12:02 PMbland-garden-89536
02/10/2021, 2:49 PMnutritious-bird-77396
02/11/2021, 1:31 AMuser
02/11/2021, 3:08 AMincalculable-ocean-74010
02/11/2021, 4:21 PMbig-carpet-38439
02/12/2021, 3:32 PMacceptable-architect-70237
02/12/2021, 5:07 PMgms
automatically. and I noticed that if I do add a version in Kafka message as such, it won't be respected in mce
because of renamed/avro/com/linkedin/mxe/MetadataChangeEvent.avsc
. here are two questions:
1. is my understanding correct?
2. can I add version?
we try to backfill a aspect for datasets. we need to handle each version. What's best way to do so?incalculable-ocean-74010
02/15/2021, 10:06 AMhttps://raw.githubusercontent.com/linkedin/datahub/master/docs/imgs/onboard-a-new-entity.png▾
beans.xml
from the GMS-war module) I don't see anything specific to pre-existing entities.powerful-egg-69769
02/15/2021, 3:44 PMincalculable-ocean-74010
02/15/2021, 4:18 PMbig-carpet-38439
02/15/2021, 11:06 PMneeds.setup.outputs.tag
means in the github actions files?calm-motorcycle-16283
02/16/2021, 4:56 AMloud-island-88694
big-carpet-38439
02/17/2021, 5:52 PMnarrow-painting-12219
02/18/2021, 7:08 PMnutritious-bird-77396
02/18/2021, 11:53 PMname
, origin
, platform
it works but other than it throws exception….
For example: The below one works but not with fields like description
or nativeDataType
{
search(input: {type: DATASET, query: "*", filters: {field: "origin", value: "TEST" }}) {
start
count
total
entities {
... on Dataset {
urn
name
description
ownership {
owners {
owner {
urn
}
}
}
}
}
facets {
field
aggregations {
value
count
}
}
}
}
What is needed for this to work?calm-sunset-28996
02/19/2021, 10:56 AMnarrow-painting-12219
02/19/2021, 12:18 PMhigh-hospital-85984
02/19/2021, 2:12 PMgorgeous-journalist-2467
02/19/2021, 2:19 PMable-keyboard-68141
02/19/2021, 7:49 PMbulky-lunch-72217
02/21/2021, 3:41 AMcurved-magazine-23582
02/23/2021, 4:34 PMnarrow-painting-12219
02/23/2021, 8:36 PM(venv) carr@carr-VirtualBox:~/Projetos/datahub/metadata-ingestion$ datahub ingest -c ./examples/recipes/example_to_datahub_rest.yml
Traceback (most recent call last):
File "/home/carr/Projetos/datahub/venv/bin/datahub", line 11, in <module>
load_entry_point('datahub', 'console_scripts', 'datahub')()
File "/home/carr/Projetos/datahub/venv/lib/python3.6/site-packages/pkg_resources/__init__.py", line 480, in load_entry_point
return get_distribution(dist).load_entry_point(group, name)
File "/home/carr/Projetos/datahub/venv/lib/python3.6/site-packages/pkg_resources/__init__.py", line 2693, in load_entry_point
return ep.load()
File "/home/carr/Projetos/datahub/venv/lib/python3.6/site-packages/pkg_resources/__init__.py", line 2324, in load
return self.resolve()
File "/home/carr/Projetos/datahub/venv/lib/python3.6/site-packages/pkg_resources/__init__.py", line 2330, in resolve
module = __import__(self.module_name, fromlist=['__name__'], level=0)
File "/home/carr/Projetos/datahub/metadata-ingestion/src/datahub/entrypoints.py", line 13, in <module>
from datahub.ingestion.run.pipeline import Pipeline
File "/home/carr/Projetos/datahub/metadata-ingestion/src/datahub/ingestion/run/pipeline.py", line 16, in <module>
from datahub.ingestion.source import source_class_mapping
File "/home/carr/Projetos/datahub/metadata-ingestion/src/datahub/ingestion/source/__init__.py", line 8, in <module>
from .ldap import LDAPSource
File "/home/carr/Projetos/datahub/metadata-ingestion/src/datahub/ingestion/source/ldap.py", line 4, in <module>
import ldap
ModuleNotFoundError: No module named 'ldap'
narrow-painting-12219
02/24/2021, 2:50 AMnarrow-painting-12219
02/24/2021, 3:39 AMhigh-hospital-85984
02/24/2021, 1:16 PMOwner
-model states that owners can be groups. Is this a bug or by design?