https://linen.dev logo
Join Slack
Powered by
Hey all We updated to `0.14` and getting this erro...
# community-support
a
Hey all We updated to 
0.14
and getting this error on Snowflake. Looks like DBT is generating an insert statement containing more values than max possible. Is there any way to fix it?
Copy code
SQL compilation error: error line 2 at position 25
maximum number of expressions in a list exceeded, expected at most 16,384, got 17,898
This is the problematic query:
Copy code
insert into "_CI_PR_321"."ELEMENTARY"."DBT_COLUMNS__tmp_20240216134429758497"
         (METADATA_HASH) values
    ('000252a5f1b9e1450a378b8ea3b891d1'),… <goes on>
a
@Aditya Vishwakarma, yes, i'm guessing you get that when upload-source-freshness?
There is a new --rows-per-insert argument to that command and it defaults to 25. I guess you can just increase it to reduce overall number of inserts.
a
I am getting this during on-run-end hooks.
dbt run —select some-model
a
Hmm, maybe dbt-elementary added the rows-per-insert functionality elsewhere but didn't make it configurable
maybe it can be configured from some env var, 1 sec
i'm not sure, sorry. check release notes for 0.15 and look at the PR. maybe there's a config
a
is there a way to disable this operation?
a
i don't know if it is even affected here - i'm guessing. which is why i'm suggesting to look at release notes / PRs that went into 0.14
a
I don’t think rows per insert impacts this. it is trying to insert 17,988 rows after all.
basically, DBT is generating an insert statement containing more values than max allowed in Snowflake. The proper way to handle this is to generate multiple insert statements and union them. This probably requires a PR but I don’t know which part of code is causing this
update: was able to hotfix by: 
disable_dbt_columns_autoupload: true
33 Views
Open in Slack
PreviousNext
Powered by