Hello everyone 😄
I use custom sql tests, which are stored in the elementary_test_results and test_result_rows tables. Now I wanted to test how many rows can be saved as a result for a test. 1000 rows can still be processed by elementary, but at 10000 rows error messages already occur with the Snowflake Connector. Without the elementary package it is possible without any problems. Has anyone already had experience with this problem?
n
Noya Offer
02/16/2025, 11:04 AM
Hey Karim!
We've seen this before and there's a workaround you can use 🙂
Add this to your dbt project:
Copy code
vars:
insert_rows_method: chunk
dbt_artifacts_chunk_size: <number lower than 10,000>
See this github issue for more details. Let me know if this helps!