A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

We want to bring all of the tags from either the `tag` or `meta` property inside our dbt documentation into DataHub. After reviewing the example <https://github.com/linkedin/datahub/blob/master/metadata-ingestion/source_docs/dbt.md|recipe>, it looks more like the command is to `Do X if Y is detected` . While this makes sense for known  tags (like PII), ideally we would send all tags from dbt to DataHub without any predefined knowledge or recipe. Any ideas on the syntax to do that?

<@U03327AGDK9> Currently what you are asking for is not supported. Please feel free to raise a request through <https://feature-requests.datahubproject.io/>. If you would like to add this feature yourself you can refer to this guide <https://datahubproject.io/docs/metadata-ingestion/developing/> and discuss in <#C017W0NTZHR|contribute> channel for any help required

Thanks for the quick response! I’ll submit a feature request.

Hey <@U03327AGDK9> - it turns out this is actually due to a bug in the dbt ingestion source- we’ll work on getting it fixed for you

We will have an update soon with an ETA. sorry about the delay

Hi <@U03327AGDK9>, I just want to understand your question more clearly. Currently, the dbt connector pulls all tags automatically from the `tags` property array of the nodes and sources. However, in your instance you have a meta property called `tag`/`meta` and you are interested in knowing how to get the values of this property ingested as the tags for the dataset into datahub via the <https://datahubproject.io/docs/metadata-ingestion/source_docs/dbt#dbt-meta-automated-mappings|meta-mapping> config param.

&gt; Currently, the dbt connector pulls all tags automatically from the `tags` property array of the nodes and sources.

I’ve tested this - and it doesn’t appear that way.

image.png

datahub is pulling all of the tags in for dataset nodes (dbt models), but not for columns. For instance, we have two tags listed for column `company_address_1`, and yet no tags show in datahub:

Hi <@U03327AGDK9>, could you share what you get when you run the following command:
`datahub get --urn '&lt;the-dataset-urn&gt;' -a schemaMetadata` ?