Hi,
I'm ingesting dbt metadata and I would like to...
# ingestions
steep-midnight-37232
06/16/2022, 7:06 PMHi,
I'm ingesting dbt metadata and I would like to know if it's possible to see in datahub ui the result of dbt tests. I'm able to see the definition of the tests but not the results.
Thanks for the help
l
little-megabyte-1074
06/16/2022, 7:32 PM
Hi @steep-midnight-37232! We’re currently working on changing how we handle dbt tests in the underlying Metadata model; we are hoping to support displaying dbt test outcomes in the near future but we don’t have a clear timeline just yet!
m
mammoth-bear-12532
06/16/2022, 7:33 PM
First step is changing dbt tests from
DatasetAssertionss
steep-midnight-37232
06/17/2022, 7:40 AMthank you very much for the info. I'm looking forward for the new feature then 🙂
m
mammoth-bear-12532
06/20/2022, 7:13 PM
Hi @steep-midnight-37232: good news! we were able to get dbt tests working 😄
thank you 1
👏 1
mammoth-bear-12532
06/20/2022, 7:13 PM
examples: https://demo.datahubproject.io/dataset/urn:li:dataset:(urn:li:dataPlatform:bigquery,calm[…]jaffle_shop.orders,PROD)/Validation?is_lineage_mode=false and https://demo.datahubproject.io/dataset/urn:li:dataset:(urn:li:dataPlatform:bigquery,calm[…]fle_shop.customers,PROD)/Validation?is_lineage_mode=false
mammoth-bear-12532
06/20/2022, 7:14 PM
mammoth-bear-12532
06/20/2022, 7:14 PM
do try it out and let us know how it goes
s
steep-midnight-37232
06/21/2022, 10:48 AMThat's an amazing news! I'll try it and let you know 🙂
steep-midnight-37232
06/21/2022, 10:48 AMthank you very much
steep-midnight-37232
06/22/2022, 2:54 PMHi there, I'm trying to integrate the dbt test but i'm getting this error
steep-midnight-37232
06/22/2022, 2:54 PMsteep-midnight-37232
06/22/2022, 2:55 PMthe recipe is something like this:
steep-midnight-37232
06/22/2022, 2:57 PMthe original recipe without the test_results_path parameter works fine. Could anyone help me understanding why it's not working? Thanks
m
mammoth-bear-12532
06/22/2022, 4:44 PM
Hi! You need to use the latest ingestion package from the UI. Do you know how to point the UI to a specific python version?
mammoth-bear-12532
06/22/2022, 4:48 PM
on step 4 of configuring the ingestion recipe, there is an advanced dropdown that allows you to select a specific ingestion library version. You need >= 0.8.38.2
mammoth-bear-12532
06/22/2022, 4:48 PM
so choose any version 0.8.38.2 or later
s
steep-midnight-37232
06/22/2022, 6:34 PMit worked 🙂 thank you very much
🎉 1
9 Views