Hi everyone! With our team we have recentry tried to add elementary to all of our dbt pipelines, but we have noticed that the performance is not as good as we would expect. • We are using Databricks • dbt version 1.4.1 (but possibility to upgrade if that would be the issue) • elementary schema is named "quality" An example of all the queries done by elementary is as it can bee seen in the attached image. Overall, our dbt models take around 5minutes without elementary, and adding alementary it adds 2minutes to the execution time. We do not understand the reason for this 2 minutes, why does it take this long? Is there a way to make it more efficient? Please tell me if you need more detail! Thanks in advance :)

Hi Arnau, I recommend taking a look at this page for more information.

Hi Elon, I looked at it and i have tried to add the parameter:

vars:
  disable_dbt_artifacts_autoupload: true

The amount of queries have reduced, but the time has not reduced significantly. We are still facing a >1min extra execution time for the insert in invocations, run_results and test results tables. How many rows are there inserted so that it takes 1 minute? I have added the total of the queries and it only should take 15 seconds, but the run of the model, on average, takes one minute more with elementary. I attach one image of the queries now

Hey @Arnau Font, Could you open a Github issue so we'll track and make sure it's solved? Please add the runtime information from your main message to the issue as well.