Rubén Laguna
05/30/2025, 2:00 PMdbt --debug run -s elementary --threads 1 --target prod --vars '{"disable_dbt_artifacts_autoupload": "true", "columns_upload_strategy": "none"} it gets stuck on the dbt_columns step, it seems that it's still running the upload_dbt_artifacts macro and the last thing it performs it's select metadata_hash from xxx.elementary.dbt_columns order by metadata_hash. From what I see that query finishes in 14 seconds that put produces lots of rows (163Mrows, and 1.61GB) , so dbt is chocking trying to get all those metadata_hashes in memory.
I thought that the columns_upload_strategy: none will prevent this but it seems that it does not. So what should I do? From https://docs.elementary-data.com/oss/general/troubleshooting#elementary-on-run-end-hooks-are-taking-a-long-time In understand that the dbt_columns is only used in Elementary Cloud (which I'm not using), so it should be safe to dbt run -s dbt_columns --full-refresh , right?Noya Offer
06/04/2025, 9:08 AM