Note If you're using dbt 1.3.2 or dbt Cloud. Hi <!here> 👋 Yesterday (04/01), dbt released version 1.3.2 which broke some of our functionality. We've just released version 0.6.8 of the dbt package which solves those issues. Please upgrade by editing your

packages.yml

in your dbt project.

- package: elementary-data/elementary
  version: 0.6.8

Please note that source freshness alerts are not supported for the time being as the

upload_source_freshness

macro no longer works. We advise that you remove the invocation of

dbt run-operation elementary.upload_source_freshness

from your jobs. We're working on making the source freshness results automatically upload at the

on-run-end

like the models, tests, seeds, and snapshots runs. Feel free to reach out in #C02CTC89LAX if you have any questions. Thanks.

Thanks @Elon Gliksberg Does it mean we no longer need to trigger

dbt run-operation upload_source_freshness

?

Yes, that is correct.

@Elon Gliksberg Do we know when will we have automatic upload of source freshness available 🙏

This is a great question! With this limitation coming up, I believe we will make this a priority. The main problem is that the delivery of this feature is somewhat dependent on dbt. I'll elaborate. The way we monitor all the other dbt resources is by utilizing the

on-run-end

hook to upload data about your run, such as which models errored, which tests failed, and so on. However, dbt currently does not run the

on-run-end

hook upon calling

dbt source freshness

and therefore we're unable to extract that data. We opened an issue about it in the past, but given that we had this macro as an alternative, we didn't need to make the contribution to dbt. We'll most likely contribute the additional functionality that would make the hook run on source freshness as well, and then the automatic uploading will be supported on that dbt version onwards. Worth mentioning that we still need to discuss this a bit further so can't say for certain.

Cool. Thanks for the context

Thanks! update works for me