Hi all! I am pretty new to DataHub and maybe anyone of you could help me 🙂 I am trying to ingest from dbt source but the following error pops up:

dbtNode.columns = get_columns(catalog[dbtNode.dbt_name])
KeyError: 'seed.redshift_dbt.xxxxxxxxxx'

As I understand this object does not exist in catalog file but it is present in the manifest so I would like to exclude it from ingestion process. I saw that in the config (recipe) it is possible to add

node_type_pattern:
      deny:

but it only applies for the whole seed, like

"^seed.*"

, otherwise it doesn’t work. Is it possible to exclude this particular node (seed.redshift_dbt.xxxxxxxxxx) from ingestion?

have you tried specifying that exact node?

yes, I tried but it didn’t help. It helps only when I specify “seed” or with regex “^seed.*” but then it excludes all nodes which starts with it.

@mammoth-bear-12532 ^

@happy-magazine-52755: have you tried

"^seed.redshift_dbt.xxxxxxxxxx"

yes, I have tried but it did not help

@happy-magazine-52755 that error message tells me you’re on an old version of dbt.py file. If your object doesnt exist in the catalog file but exists in the manifest, we handle it like this in the latest

if catalog_node is None:
                report.report_warning(
                    key,
                    f"Entity {dbtNode.dbt_name} is in manifest but missing from catalog",
                )
            else:
                dbtNode.columns = get_columns(catalog_node, manifest_node)

thanks!