Hi everyone, I am suddenly seeing this error and d...
# troubleshoot
l
Hi everyone, I am suddenly seeing this error and don't know what is causing it. Could anyone help? Thanks. Now when I try to access Domain and Glossary details page, this shows up.
g
Can you check the title name? It should not contain space, characters
l
What title name do you mean?
the title name of glossary term?
g
Yes yes, the title of the term
l
I think I do have a title name that contains space.
This is causing the problem?
g
Yes, I faced that issue last time. Then, I remove/rollback and ingest the glossary again. To confirm, you can try click (without space - should ok) and (with space).
l
I tried, all of them have the same issue.
g
Is it a term group or term?
l
a term
Copy code
10:03:52.010 [ForkJoinPool.commonPool-worker-23] ERROR c.datahub.graphql.GraphQLController:99 - Errors while executing graphQL query: "query getGlossaryTerm($urn: String!, $start: Int, $count: Int) {\n  glossaryTerm(urn: $urn) {\n    urn\n    type\n    name\n    hierarchicalName\n    isRelatedTerms: relationships(\n      input: {types: [\"IsA\"], direction: OUTGOING, start: $start, count: $count}\n    ) {\n      start\n      count\n      total\n      relationships {\n        entity {\n          ... on GlossaryTerm {\n            urn\n            __typename\n          }\n          __typename\n        }\n        __typename\n      }\n      __typename\n    }\n    hasRelatedTerms: relationships(\n      input: {types: [\"HasA\"], direction: OUTGOING, start: $start, count: $count}\n    ) {\n      start\n      count\n      total\n      relationships {\n        entity {\n          ... on GlossaryTerm {\n            urn\n            __typename\n          }\n          __typename\n        }\n        __typename\n      }\n      __typename\n    }\n    isAChildren: relationships(\n      input: {types: [\"IsA\"], direction: INCOMING, start: $start, count: $count}\n    ) {\n      start\n      count\n      total\n      relationships {\n        entity {\n          ... on GlossaryTerm {\n            urn\n            hierarchicalName\n            __typename\n          }\n          __typename\n        }\n        __typename\n      }\n      __typename\n    }\n    parentNodes {\n      ...parentNodesFields\n      __typename\n    }\n    ownership {\n      ...ownershipFields\n      __typename\n    }\n    domain {\n      ...entityDomain\n      __typename\n    }\n    institutionalMemory {\n      ...institutionalMemoryFields\n      __typename\n    }\n    properties {\n      name\n      description\n      termSource\n      sourceRef\n      sourceUrl\n      rawSchema\n      customProperties {\n        key\n        value\n        __typename\n      }\n      __typename\n    }\n    schemaMetadata(version: 0) {\n      ...schemaMetadataFields\n      __typename\n    }\n    deprecation {\n      ...deprecationFields\n      __typename\n    }\n    __typename\n  }\n}\n\nfragment parentNodesFields on ParentNodesResult {\n  count\n  nodes {\n    ...glossaryNode\n    __typename\n  }\n  __typename\n}\n\nfragment glossaryNode on GlossaryNode {\n  urn\n  type\n  properties {\n    name\n    __typename\n  }\n  children: relationships(\n    input: {types: [\"IsPartOf\"], direction: INCOMING, start: 0, count: 10000}\n  ) {\n    total\n    __typename\n  }\n  __typename\n}\n\nfragment ownershipFields on Ownership {\n  owners {\n    owner {\n      ... on CorpUser {\n        urn\n        type\n        username\n        info {\n          active\n          displayName\n          title\n          email\n          firstName\n          lastName\n          fullName\n          __typename\n        }\n        properties {\n          active\n          displayName\n          title\n          email\n          firstName\n          lastName\n          fullName\n          __typename\n        }\n        editableProperties {\n          displayName\n          title\n          pictureLink\n          email\n          __typename\n        }\n        __typename\n      }\n      ... on CorpGroup {\n        urn\n        type\n        name\n        properties {\n          displayName\n          email\n          __typename\n        }\n        info {\n          displayName\n          email\n          admins {\n            urn\n            username\n            info {\n              active\n              displayName\n              title\n              email\n              firstName\n              lastName\n              fullName\n              __typename\n            }\n            editableInfo {\n              pictureLink\n              teams\n              skills\n              __typename\n            }\n            __typename\n          }\n          members {\n            urn\n            username\n            info {\n              active\n              displayName\n              title\n              email\n              firstName\n              lastName\n              fullName\n              __typename\n            }\n            editableInfo {\n              pictureLink\n              teams\n              skills\n              __typename\n            }\n            __typename\n          }\n          groups\n          __typename\n        }\n        __typename\n      }\n      __typename\n    }\n    type\n    associatedUrn\n    __typename\n  }\n  lastModified {\n    time\n    __typename\n  }\n  __typename\n}\n\nfragment entityDomain on DomainAssociation {\n  domain {\n    urn\n    type\n    properties {\n      name\n      description\n      __typename\n    }\n    __typename\n  }\n  associatedUrn\n  __typename\n}\n\nfragment institutionalMemoryFields on InstitutionalMemory {\n  elements {\n    url\n    author {\n      urn\n      username\n      __typename\n    }\n    description\n    created {\n      actor\n      time\n      __typename\n    }\n    __typename\n  }\n  __typename\n}\n\nfragment schemaMetadataFields on SchemaMetadata {\n  aspectVersion\n  createdAt\n  datasetUrn\n  name\n  platformUrn\n  version\n  cluster\n  hash\n  platformSchema {\n    ... on TableSchema {\n      schema\n      __typename\n    }\n    ... on KeyValueSchema {\n      keySchema\n      valueSchema\n      __typename\n    }\n    __typename\n  }\n  fields {\n    ...schemaFieldFields\n    __typename\n  }\n  primaryKeys\n  foreignKeys {\n    name\n    sourceFields {\n      fieldPath\n      __typename\n    }\n    foreignFields {\n      fieldPath\n      __typename\n    }\n    foreignDataset {\n      urn\n      name\n      type\n      origin\n      uri\n      properties {\n        description\n        __typename\n      }\n      platform {\n        ...platformFields\n        __typename\n      }\n      platformNativeType\n      ownership {\n        ...ownershipFields\n        __typename\n      }\n      globalTags {\n        ...globalTagsFields\n        __typename\n      }\n      glossaryTerms {\n        ...glossaryTerms\n        __typename\n      }\n      __typename\n    }\n    __typename\n  }\n  __typename\n}\n\nfragment schemaFieldFields on SchemaField {\n  fieldPath\n  label\n  jsonPath\n  nullable\n  description\n  type\n  nativeDataType\n  recursive\n  isPartOfKey\n  globalTags {\n    ...globalTagsFields\n    __typename\n  }\n  glossaryTerms {\n    ...glossaryTerms\n    __typename\n  }\n  __typename\n}\n\nfragment globalTagsFields on GlobalTags {\n  tags {\n    tag {\n      urn\n      type\n      name\n      description\n      properties {\n        colorHex\n        __typename\n      }\n      __typename\n    }\n    associatedUrn\n    __typename\n  }\n  __typename\n}\n\nfragment glossaryTerms on GlossaryTerms {\n  terms {\n    term {\n      ...glossaryTerm\n      __typename\n    }\n    associatedUrn\n    __typename\n  }\n  __typename\n}\n\nfragment glossaryTerm on GlossaryTerm {\n  urn\n  name\n  type\n  hierarchicalName\n  properties {\n    name\n    description\n    definition\n    termSource\n    customProperties {\n      key\n      value\n      __typename\n    }\n    __typename\n  }\n  ownership {\n    ...ownershipFields\n    __typename\n  }\n  parentNodes {\n    ...parentNodesFields\n    __typename\n  }\n  __typename\n}\n\nfragment platformFields on DataPlatform {\n  urn\n  type\n  lastIngested\n  name\n  properties {\n    type\n    displayName\n    datasetNameDelimiter\n    logoUrl\n    __typename\n  }\n  displayName\n  info {\n    type\n    displayName\n    datasetNameDelimiter\n    logoUrl\n    __typename\n  }\n  __typename\n}\n\nfragment deprecationFields on Deprecation {\n  actor\n  deprecated\n  note\n  decommissionTime\n  __typename\n}\n", result: {errors=[{message=Validation error (FieldUndefined@[glossaryTerm/domain]) : Field 'domain' in type 'GlossaryTerm' is undefined, locations=[{line=70, column=5}], extensions={classification=ValidationError}}], data=null, extensions={tracing={version=1, startTime=2022-11-01T10:03:52.005835Z, endTime=2022-11-01T10:03:52.010796Z, duration=4963124, parsing={startOffset=1699409, duration=1665300}, validation={startOffset=4675141, duration=2944259}, execution={resolvers=[]}}}}, errors: [ValidationError{validationErrorType=FieldUndefined, queryPath=[glossaryTerm, domain], message=Validation error (FieldUndefined@[glossaryTerm/domain]) : Field 'domain' in type 'GlossaryTerm' is undefined, locations=[SourceLocation{line=70, column=5}], description='Validation error (FieldUndefined@[glossaryTerm/domain]) : Field 'domain' in type 'GlossaryTerm' is undefined'}]
I also found this error in the gms
g
how do you ingest the term? using UI or yml (CLI)?
l
I created the term using UI
And due to this error, I cannot use search bar anymore.
g
Hmm, sorry, dude not sure about the issue. Based on my experience, I'll delete it first. If you want to try, you can delete the term. https://datahubproject.io/docs/how/delete-metadata/
or try to ingest using CLI. If anything happens, you can roll back. https://datahubproject.io/docs/generated/ingestion/sources/business-glossary
l
Thanks! I will try to delete it first
Copy code
root@datahub-acryl-datahub-actions-69cb95c9b8-sz95n:/# datahub delete --entity_type glossaryTerm
Usage: datahub delete [OPTIONS]
Try 'datahub delete --help' for help.

Error: You must provide either an urn or a platform or an env or a query for me to delete anything
root@datahub-acryl-datahub-actions-69cb95c9b8-sz95n:/# datahub delete --urn "urn:li:glossaryTerm:6aab1f9d-134f-4a3b-aec9-a391b68c7b91"
[2022-11-01 10:43:01,676] INFO     {datahub.cli.delete_cli:142} - DataHub configured with <http://datahub-datahub-gms:8080>
[2022-11-01 10:43:01,997] ERROR    {datahub.entrypoints:192} -
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/requests/models.py", line 972, in json
    return complexjson.loads(self.text, **kwargs)
  File "/usr/local/lib/python3.10/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/usr/local/lib/python3.10/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/local/lib/python3.10/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/datahub/entrypoints.py", line 149, in main
    sys.exit(datahub(standalone_mode=False, **kwargs))
  File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.10/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/datahub/upgrade/upgrade.py", line 386, in async_wrapper
    loop.run_until_complete(run_func_check_upgrade())
  File "/usr/local/lib/python3.10/asyncio/base_events.py", line 646, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.10/site-packages/datahub/upgrade/upgrade.py", line 373, in run_func_check_upgrade
    ret = await the_one_future
  File "/usr/local/lib/python3.10/site-packages/datahub/upgrade/upgrade.py", line 366, in run_inner_func
    return await loop.run_in_executor(
  File "/usr/local/lib/python3.10/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.10/site-packages/datahub/telemetry/telemetry.py", line 343, in wrapper
    raise e
  File "/usr/local/lib/python3.10/site-packages/datahub/telemetry/telemetry.py", line 295, in wrapper
    res = func(*args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/datahub/cli/delete_cli.py", line 144, in delete
    references_count, related_aspects = delete_references(
  File "/usr/local/lib/python3.10/site-packages/datahub/cli/delete_cli.py", line 413, in delete_references
    return cli_utils.post_delete_references_endpoint(
  File "/usr/local/lib/python3.10/site-packages/datahub/cli/cli_utils.py", line 296, in post_delete_references_endpoint
    summary = parse_run_restli_response(response)
  File "/usr/local/lib/python3.10/site-packages/datahub/cli/cli_utils.py", line 208, in parse_run_restli_response
    response_json = response.json()
  File "/usr/local/lib/python3.10/site-packages/requests/models.py", line 976, in json
    raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
[2022-11-01 10:43:01,998] ERROR    {datahub.entrypoints:195} - Command failed:
	Expecting value: line 1 column 1 (char 0).
	Run with --debug to get full stacktrace.
	e.g. 'datahub --debug delete --urn urn:li:glossaryTerm:6aab1f9d-134f-4a3b-aec9-a391b68c7b91'
root@datahub-acryl-datahub-actions-69cb95c9b8-sz95n:/#troubleshoot
I got json decode error when I run delete command using CLI...
g
Try use single quote?
l
still no luck
b
Hi @lemon-cat-72045 it appears to me that something is bad about the internal state of the system. Can you provide the version of DataHub you're on and walk through the steps you took in creating the term? I'm going to try to reproduce on my side
It's possible that you have version inconsistencies in your containers as well. We recently added domain to the Glossary Term type!
Please make sure those container tags are exactly equal. This has bitten many folks before as well!
l
Thank you for the clarification! After upgrading everything to 0.9.1 the problem is fixed.
m
@big-carpet-38439 consistent container tags mean same tag names ? the reason I'm asking, we have a custom datahub actions image that has a custom tag though it is base on "FROM acryldata/datahub-actions:v0.0.9"