Hello community We are trying to make a change in the existi DataHub #troubleshoot

Hello community! We are trying to make a change i...

best-umbrella-88325

02/13/2023, 9:55 AM

Hello community! We are trying to make a change in the existing flow of the way glossary terms are attached to datasets, and for that reason, have been exploring the datahub source code. What we observe is that when the dataset is loaded on the UI, a GraphQL query is hit from the browser, however, no logs are visible in GMS for that request. We need that log to identify which part of the code is responsible for showing the attached glossary terms on the dataset page. Can someone help us as to which request is responsible for showing the glossary terms on the dataset or which class is responsible for doing it. Thanks in advance!

gentle-hamburger-31302

02/13/2023, 10:03 AM

Hi @best-umbrella-88325 Please check documentation for how to extract logs from GMS container https://datahubproject.io/docs/how/extract-container-logs/#step-2-find-the-log-files

best-umbrella-88325

02/13/2023, 10:04 AM

Hey @gentle-hamburger-31302 Sorry for the confusion. I have access to the logs, and am able to see them. The point here is that the logs for this particular request are not visible. The other logs, we are able to see..

astonishing-answer-96712

02/13/2023, 8:24 PM

hi @best-umbrella-88325, do you have global permissions for your instance?

big-carpet-38439

02/13/2023, 10:44 PM

@best-umbrella-88325 Thanks for the question!

big-carpet-38439

02/13/2023, 10:49 PM

So basically the GraphQL query fetches a field called

glossaryTerms

(which you're probably aware of already). This is at first populated using an aspect on the Dataset Entity called "glossaryTerms". However, this simply attaches the references (ie, the URNs) of the glossary terms related to the dataset requested. That happens here (fetched from the backend GMS and mapped into the GraphQL model). Once the URNs are associated with the Dataset, the GraphQL engine will automatically "resolve" those URNs for each individual Glossary Term to populate the rest of the fields. This occurs by invoking this batchLoad method on the GlossaryTermType. You can see that this also fetches specific aspects from GMS, maps them to GraphQL, and returns... if you've added custom fields to the Glossary Term type, you'll want to map them inside of here.

best-umbrella-88325

02/14/2023, 12:51 PM

Hey @big-carpet-38439 Thanks a ton for such a detailed answer. This immensely helps!! Have been struggling with this since a couple of weeks now. 🙂

4 Views

Open in Slack

Previous Next