Hi folks, does anyone have an example for how we a...
# getting-started
d
Hi folks, does anyone have an example for how we add our datahubbbb Glossary Terms into our dbt files so they'll show up at column level? I'm not sure where they should be added. Or is this something that needs to be configured in meta mapping? TY in advance :)
b
@helpful-optician-78938 @gray-shoe-75895 Should be able to provide some support here 🙂
g
@damp-businessperson-33501 it is configured via meta mappings!
where datahub is mapping the
data_tier
meta field into the a glossary term
does that help?
d
Hi Gabe thank you for your reply 🙂 I can see that meta mapping can be used to automatically add tags to data assets - can it also be used to add tags to individual fields within a schema?
g
Ah- I misread your original question. From the docs, “Currently, dbt meta mapping is only supported for meta elements defined at the model level (not supported for columns)“, so this is something we do not currently support, but plan to in the future.
d
Ah I see 😞 So if I'm understanding correctly, the only way to get Glossary Terms applied to columns would be through meta mapping but this isn't supported. If tags are added to columns in dbt, will they be applied to columns in DataHub? Just seeing if there's a short term solution to this so we can get our PII tagged.
g
Hey @damp-businessperson-33501 - yes! If you apply tags to columns in dbt, those will be ingested as datahub tags right now
right now the transformer just matches based on field name however
d
Thanks @green-football-43791 - We did look at the transformer option but the difficulty is we can't differentiate based on data type. We have a lot of fields that might say 'email' for example, but they're not PII, they're just boolean checks. I think we may need to look at the tagging option and see if we can get the PII label attached to the columns that way - I would rather use the Glossary Terms as that's what they're for but our biggest issue is getting everything appropriately tagged so we can then use it to create restriction policies.