Hello while trying to ingest a business glossary `source ref DataHub #troubleshoot

Hello, while trying to ingest a business glossary ...

quick-megabyte-61846

06/22/2022, 8:48 AM

Hello, while trying to ingest a business glossary

source_ref

source_url

are not reflected in UI Source yaml: https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/examples/bootstrap_data/business_glossary.yml Recipe yaml:

Copy code

source:
  type: datahub-business-glossary
  config:
    file: ./business_glossary/business_glossary.yml

sink:
  type: datahub-rest
  config:
    server: <http://localhost:8080>

version: 0.8.38 PS. I added another screen with desirable effect

loud-island-88694

06/22/2022, 2:49 PM

@bulky-soccer-26729 ^

bulky-soccer-26729

06/22/2022, 2:53 PM

Hey Piotr! yeah something seems off, let me try to reproduce this and get back to you

bulky-soccer-26729

06/22/2022, 3:26 PM

alright looked into this one and thanks for your patience! so turns out this is an existing issue and something we'd really like to update. What's happening is we're setting

source_url

just fine on the

GlossaryTermProperties

aspect (you can see in you db), but we're not showing it anywhere in the UI. The Links that you see in the About section come from

InstitutionalMemoryMetadata

aspects. Obviously if you include a

source_url

in your ingestion you would expect that to show up in the UI. So I'm going to make a note of this and include this in my Business Glossary followups that I'm planning on working on over the next week or two! So expect an update / fix for this soon, but I'm not sure I can put a specific date on it quite yet. Let me know if this is more urgent or if you have any concerns!

thank you 1

quick-megabyte-61846

06/22/2022, 4:08 PM

Thank you very much for your response, It’s nothing urgent only wanted to show the problem

👍 1

salmon-angle-92685

06/23/2022, 10:04 AM

It seems to be only a syntax problem on your yaml file. Have you checked if the indentation for each yml field is correct ? Sometimes, if you only copy the yml file from git and paste it somewhere else, it won't indent correctly.

dazzling-judge-80093

06/23/2022, 10:07 AM

@millions-notebook-72121 if you rename your recipe to

business_glossary.dhub.yml

and you open it with vscode with the yaml plugin installed then you will get validation errors and typehints as well.

millions-notebook-72121

06/23/2022, 10:14 AM

thanks guys for the reply - but I don't see any syntax error indeed. Must be something else that I'm missing

dazzling-judge-80093

06/23/2022, 10:25 AM

I think you are missing the recipe file and that is the one which should be named as

.dhub.yml

The recipe file should look like this:

Copy code

source:
  type: datahub-business-glossary
  config:
    file: ./business_glossary/business_glossary.yml

sink:
  type: datahub-rest
  config:
    server: <http://localhost:8080>

and that is the file which should be passed in to

datahub ingest

5 Views

Open in Slack

Previous Next