Ian Ferguson
12/06/2024, 5:28 PMon-run-end failed, error: Resources exceeded during query execution: Not enough resources for query planning - too many subqueries or query is too complex.
have other folks seen this before? some cursory Googling is telling me that it's a complexity quota in BigQuery that we've hitJoost Boonzajer Flaes
12/09/2024, 10:03 AMIan Ferguson
12/09/2024, 12:43 PM0.16.1 but according to PyPI that is the latest versionJoost Boonzajer Flaes
12/09/2024, 12:49 PMpackages.yml. You should be on 0.16.2 to get this PR: https://github.com/elementary-data/dbt-data-reliability/pull/765Ian Ferguson
12/09/2024, 12:50 PMIan Ferguson
12/09/2024, 12:51 PMJoost Boonzajer Flaes
12/09/2024, 12:51 PMIan Ferguson
12/09/2024, 4:49 PMJoost Boonzajer Flaes
12/09/2024, 4:55 PMvars:
dbt_artifacts_chunk_size: 1000
query_max_size: 1000000Joost Boonzajer Flaes
12/09/2024, 4:57 PMJoost Boonzajer Flaes
12/09/2024, 4:57 PMIan Ferguson
01/14/2025, 2:37 PMon-run-end failed, error: The query is too large. The maximum standard SQL query length is 1024.00K characters, including comments and white space characters
here's what our config looks like nowIan Ferguson
01/15/2025, 2:36 PMQuery error: Transaction is aborted due to concurrent update against table tmc-data-warehouse:dbt_elementary.dbt_models ... do y'all have guidance / docs for enabling a backoff or something? most of our ELT pipelines run concurrently so this exception makes sense to meJoost Boonzajer Flaes
01/15/2025, 3:26 PMchunk_size worked! Is there any way of the pipelines consecutively?Joost Boonzajer Flaes
01/15/2025, 3:26 PMJoost Boonzajer Flaes
01/15/2025, 3:26 PMIan Ferguson
01/15/2025, 3:27 PMJoost Boonzajer Flaes
01/15/2025, 3:31 PMIan Ferguson
01/15/2025, 3:32 PMJoost Boonzajer Flaes
01/15/2025, 3:32 PMJoost Boonzajer Flaes
01/15/2025, 3:32 PMIan Ferguson
01/15/2025, 3:33 PMJoost Boonzajer Flaes
01/15/2025, 3:33 PMJoost Boonzajer Flaes
01/15/2025, 3:33 PMIan Ferguson
01/15/2025, 3:35 PMmodels post hook differs depending on the select statement?Ian Ferguson
01/15/2025, 3:36 PMJoost Boonzajer Flaes
01/15/2025, 3:37 PMJoost Boonzajer Flaes
01/15/2025, 3:37 PMIan Ferguson
01/15/2025, 3:39 PMJoost Boonzajer Flaes
01/16/2025, 7:21 AMIan Ferguson
01/16/2025, 4:58 PMIan Ferguson
01/16/2025, 4:59 PM100 and am still seeing "the query is too large"Ian Ferguson
01/16/2025, 4:59 PMIan Ferguson
01/16/2025, 6:46 PMJoost Boonzajer Flaes
01/16/2025, 6:58 PMIan Ferguson
01/16/2025, 6:59 PMIan Ferguson
01/16/2025, 6:59 PMJoost Boonzajer Flaes
01/16/2025, 6:59 PMJoost Boonzajer Flaes
01/16/2025, 7:59 PMIan Ferguson
01/16/2025, 8:00 PM