Hi everyone, I am trying to ingest data from dbt u...
# ingestion
t
Hi everyone, I am trying to ingest data from dbt using manifest and catalog json files. Getting key errors while running
Copy code
dbtNode.columns = get_columns(catalog[dbtNode.dbt_name])
the last was for a test that is in manifest file, any help/similar issues? It looks like any key present in catalog has to be also present in the manifest file?
g
cc @acoustic-printer-83045
a
Interesting, our test dataset didn’t have any tests. I’ll look into it, should be a simple fix.
t
I managed to take tests out of the manifest.json, the import did work then.
b
Same problem here, it looks like the dbt.py script is looking for columns in dbt objects that don't have them e.g tests
👀 1
a
I'll drop a fix into this for the PR I'm working on right now.
b
Hi @acoustic-printer-83045, @gray-shoe-75895 I've noticed that when I've tried to do the same, I'm still getting the same error. Have you applied your fix? Thank you 🙂
Here's the log:
a
That didn’t make its way into a current fix, unsure when I’ll have time to get that sorted.
b
It seemed to have worked when @fancy-fireman-15263 and I changed load_schemas: False
🙌 3