Hi, I’m looking to run Elementary in Databricks but so far the run time has increased from 15 minutes to an hour. I’ve not implemented tests and have disabled artefacts. Do you have any advice?
👀 1
o
Or Avidov
10/19/2023, 12:50 PM
Hi @Alex Smith! which version do you use for dbt and elementary? can you please also share your dbt.log so I can see what's taking the time?
a
Alex Smith
10/19/2023, 1:07 PM
Hi, we’re using
dbt = 1.6
and elementary = 0.10.2
We’ve also checked the artifacts in Databricks and it looks like it makes all the models from scratch. It has increased from 8 to 410. Is this likely to change if we run in prod?