Quick Question- I want to ingest the Glossary Term...
# all-things-deployment
s
Quick Question- I want to ingest the Glossary Terms in datahub. Do we have any API and curl command to ingest them into.
d
s
@dazzling-judge-80093 Thanks for the quick response. Yes was looking for the same.
@dazzling-judge-80093 This recipe accepts the file of glossary terms placed on OS. Don't we have anyway to place this file on s3 and consume the glossary terms ?
d
I think currently you can only load from file but it worth to create a feature request for this here -> https://feature-requests.datahubproject.io/
s
@dazzling-judge-80093 Do we need to install any package to load glossary-terms . I am trying to ingest the data using airflow dag. But its breaking with below error ..
Copy code
raise KeyError (f"Did not find a registered class for {key}")
KeyError: 'Did not find a registered class for datahub-business-glossary'
@dazzling-judge-80093 Do i need to install the plugin using below command
Copy code
pip install data-acryl[datahub-business-glossary]
d
yes, you have to install that to use the business glossary source
s
@dazzling-judge-80093 OK thanks a lot 🙂
👍 1
@dazzling-judge-80093 i installed that plugin still facing the same issue
d
hmm, I just tried this and worked for me :
Copy code
python3 -m venv venv
source venv/bin/activate
pip install acryl-datahub
and then I just used this sample recipe:
Copy code
source:
  type: datahub-business-glossary
  config:
    file: /path_to_business_glossary/business_glossary_data.yml

sink:
  type: "console"
s
@dazzling-judge-80093 I tried the same on Airflow instance but that is breaking with the same error.
d
Can you run the following to check which version of datahub is installed? :
Copy code
pip freeze | grep acryl-datahub
s
acryl-datahub==0.8.11.0
d
can you run this?
Copy code
pip install -U acryl-datahub
I think you have a too old version installed.
v0.8.17 is the latest version
s
@dazzling-judge-80093 That is the right fix for this issue
d
Awesome :)
s
@dazzling-judge-80093 But that upgrade has broken my other plugins i installed with older acryl-datahub, How i can upgrade those plugins as well , Like i installed plugins for glue using , Pip install 'acryl-datahub[glue]'
d
Can you bump those as well similar way?
s
Using -U ?
Tried that way as well but no luck on this 😞
d
what is the error you get now?
s
@dazzling-judge-80093 Not allowed to copy from VDi so captured the screen of error logs and shared